How to migrate the ADF V2 to ADF with managed Virtual network

kks8589 96

Hi Team
We have a Azure Data Factory pipelines with a storage account in a vnet . with previous versions we used self hosted ir to connect to the storage account in vnet. Without self hosted Ir in new version of ADF managed virtual network we can connect the storage account in a vnet with Autoresolve IR itself
Could you please help us how to migrate to the new version

Regards
Keerthi

MartinJaffer-MSFT 26,036 Reputation points

2020-12-09T20:38:12.973+00:00

Hello @kks8589 and welcome back to Microsoft Q&A.

Please tell me if my understanding of your situation and ask is correct.

You have an existing factory created before the Managed VNet feature was available. To securely connect to a storage account hosted inside a VNet, you created a self-hosted IR inside the same VNet.

Now you would like to replace the self-hosted IR with Private Endpoint and Azure IR in Managed Vnet.
kks8589 96 Reputation points

2020-12-10T07:16:25.987+00:00

yes @MartinJaffer-MSFT
We have an existing factory created before the Managed VNet feature was available

1 answer

MartinJaffer-MSFT 26,036 Reputation points

2020-12-10T02:03:54.447+00:00

@kks8589 I do not believe it is possible to give Managed Vnet to the built-in default AutoResolveIntegrationRuntime that does not already have it. That one is created when the Factory is created. The Managed Vnet feature is enabled / disabled during creation of the Integration Runtime. After the Integration Runtime is created, the Managed Vnet setting cannot be changed.

You can still use Managed Vnet in your Data Factory. To do so you need to create a new Azure Integration Runtime, and enable the Managed Vnet during creation. Then go update the appropriate Linked Service(s) to use the new Azure IR.

You can follow this detailed document or this tutorial for setting up the endpoints and Linked Service / Dataset.
Please sign in to rate this answer.

1 person found this answer helpful.
kks8589 96 Reputation points

2020-12-10T12:40:11.483+00:00

After creating Managed virtual network we are getting Limited icon but not full running state why?

MartinJaffer-MSFT 26,036 Reputation points

2020-12-10T20:35:19.567+00:00

Thank you for the response @kks8589 .

If when you click on More it says:

Data movement, interactive query, pipeline and external activities: Succeeded
Dataflow: Failed
IRs can take 15 minutes to be ready for dataflow from the time they are created.

This is a known bug. The fix is being rolled out right now. I did not mention it before in case the fix reached you before you made the new IR. I did not want to alarm you. The fix is expected to take effect by the end of the week.

The new Vnet IR should still work for the same things your self-hosted IR did. The self-hosted IR did not support Data Flows. If you have any existing Data Flows, I recommend you leave them as-is.

HimanshuSinha-msft 19,381 Reputation points Microsoft Employee

2020-12-17T22:49:09.407+00:00

Hello ,
We have not heard back from you on this and was just following up .
Incase if you have resolution , request you to share the same here , so that other community members can benefit from that .
Thanks
Himanshu

HimanshuSinha-msft 19,381 Reputation points Microsoft Employee

2020-12-23T19:56:24.167+00:00

Hello ,
We have not heard back from you on this and was just following up .
Incase if you have resolution , request you to share the same here , so that other community members can benefit from that .
Thanks
Himanshu

kks8589 96 Reputation points

2021-01-04T08:56:03.407+00:00

Thanks Martin for the explanation

Dhananjaya Mata 11 Reputation points

2021-04-23T03:32:14.937+00:00

hi @kks8589 ,
was this issue resolved for you ??

kks8589 96 Reputation points

2021-04-23T05:01:25.97+00:00

yes got the answer

Dhananjaya Mata 11 Reputation points

2021-04-23T05:11:35.537+00:00

hi @kks8589 ,
what was the fix ? Can you please give more details on what region were you trying to create the IR

I am trying to create in Australia east region but the problem still exists .

Dhananjaya Mata 11 Reputation points

2021-04-30T05:08:21.07+00:00

hi @HimanshuSinha-msft ,@MartinJaffer-MSFT ,
I have similar issue in Australia East location . Can you please help
As per above you have mentioned this issue was fixed .However I am still getting the same error .
Please advise .
Sign in to comment