Data Factory V2 Storage Account not Refreshing - Because it thinks its blob Storage

Debbie Edwards 521

I have created a Storage Account set to be Azure Data Lake V2 by setting the hierarchical namepace.

And I used Azure Storage Explorer to add some files into the blob Container (Which is an Azure datalake gen2)

I'm now creating a Data Lake V2 Linked Service, selected the subscription but Storage Account Name just says Loading and I cant get to any storage accounts.

I have tried closing Data Factory down and restarting but I cant get any further than this. I have changed at its in the correct Subscription and it is a ADLS Gen2

After checking Its actually available through the Blob Storage connector but I want it to be available under Data Lake Gen 2. What have I done wrong here?

Vaibhav Chaudhari 38,666 Reputation points

2020-07-31T11:23:57.943+00:00

Please verify from Configuration if HNS is enabled

===============================================

If the response helped, do "Accept Answer" and upvote it -- Vaibhav
Debbie Edwards 521 Reputation points

2020-08-03T08:19:00.35+00:00

Hierarchical Namespace is enabled and when I look at it using azure Storage Explorer it says ADLS Gen2

So I cant understand why it doesn't come up in data factory under Data Lake Gen 2 and I can only find it with the Blob Storage connector?
Vaibhav Chaudhari 38,666 Reputation points

2020-08-03T19:17:47.23+00:00

Ok, that's strange. I couldn't reproduce it.

I created linked service for Blob storage, further the drop down shows both my blob storage and ADLS gen2 account.
Same is the case when I create linked service for ADLS Gen2. Try creating support ticket if you have support plan.
Debbie Edwards 521 Reputation points

2020-08-04T13:27:19.003+00:00

I thought I may have the answer. I was adding to an old data factory so I created a new one and tried again but exactly the same thing happened. Is this because I need to add the Service principal in Authentication method or anything like that?

I have a lot of Data lake Gen 2 Storage accounts and I cant see any from data Factory. To me it feels like there is something wrong over in Data Factory.

I cant create a support ticket unfortunately,
Vaibhav Chaudhari 38,666 Reputation points

2020-08-04T14:17:26.69+00:00

Let's wait for MSFT support members to respond. They can create a one time free support request I believe.

Meanwhile you can try connecting to ADLS Gen2 using Key or SPN or MI as shown in the document - connector-azure-data-lake-storage
KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee

2020-08-05T19:15:26.037+00:00
Hi @Vaibhav Chaudhari , Thank you so much for your engagement and helping the community.

Hi @Debbie Edwards ,

So I cant understand why it doesn't come up in data factory under Data Lake Gen 2 and I can only find it with the Blob Storage connector? - As Vaibhav mentioned this sounds strange and even I tried to reproduce this on my end, but no luck. I feel this needs a deeper investigation to understand what exactly is happening.
For deeper investigation and immediate assistance, could you please send an email to AzCommunity@Microsoft.com with the below details, so that we can enable a one-time-free support for you to work closely on this matter.

Email subject: <Attn - Kranthi : Microsoft Q&A Thread title>

Thread URL: <Microsoft Q&A Thread>

Subscription ID: <your subscription id>

Data Factory Region?

ADLS Gen2 Region?

Please let me know here, once the email is sent.

Thank you
PRADEEPCHEEKATLA-MSFT 81,391 Reputation points Microsoft Employee

2020-08-06T11:06:27.537+00:00

Hey @Debbie Edwards ,
Thank you for reaching out.
We have enabled for one-time free technical support.
I hope you have received one on one support to work towards a resolution on this matter.
KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee

2020-08-10T20:25:28.223+00:00

Hi @Debbie Edwards ,

Could you please share the SR# with us for tracking this issue internally? Also please do consider to share the resolution here once your issue is resolved by the support engineer, as it would be helpful for others reading this thread.

Thank you

2 answers

KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee

2020-09-18T22:24:46.177+00:00

Hi @Debbie Edwards ,

As suggested in the support request, could you please try creating an ADLS gen2 linked service with “Enter manually” option to input the account name and account key yourself and see if that helps to resolve your issue?

Please let us know how it goes.
Looking forward to your confirmation.

Thank you and sorry for your experience

----------

Please do consider to click on "Accept Answer" and "Upvote" on the post that helps you, as it can be beneficial to other community members.
Please sign in to rate this answer.
KranthiPakala-MSFT 46,427 Reputation points Microsoft Employee

2020-09-21T16:50:47.727+00:00

Hi @Debbie Edwards ,

Following up to see if the above suggestion was helpful to resolve your issue? Please let us know if that doesn't help or if the issue still persists?

Looking forward to your confirmation.

Thank you
Sign in to comment
Debbie Edwards 521 Reputation points

2020-09-22T10:55:12.323+00:00

Hi

I got some help from Microsoft. Entering manually didn't help unfortunately but a few days ago they asked me to try again and it worked. I don't know what they did to get it working
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Share via

Data Factory V2 Storage Account not Refreshing - Because it thinks its blob Storage

2 answers