Azure Data Factory Wrangling data flow - Unexpected Error when connecting datasource

Question

Azure Data Factory Wrangling data flow - Unexpected Error when connecting datasource

Romain Pham 26

Dear Tech Community,

I am trying to use Wrangling Data Flow to perform transformation on a csv file host in my azure blob storage.
However every time I add the source data set that target my csv file and hit ok I receive the following message when power query online is launch:

Please specify how to connect.

I then click on Configure Connection

I have then 3 choice for Connection Kind: Anonymous, Basic, Organizational Account

Anonymous and Organizational Account (when clicking Sign In) always give the same error:

We encountered an unexpected error.

section Section1;
shared ABC_Finance = let
AdfDoc = Web.Contents("https://********.blob.core.windows.net/data/ABC/ABC_Finance1.txt?sv=2018-03-28&sig=xlEVzRExQJ8hgVc%2B0ZOSpXJpV73bgrGqTJjGnnfYjkc%3D&spr=https&se=2020-12-22T06%3A20%3A52Z&srt=sco&ss=bf&sp=rwl"),
Csv = Csv.Document(AdfDoc, [Delimiter = ",", Encoding = TextEncoding.Utf8, QuoteStyle = QuoteStyle.Csv])
in
Csv;
shared UserQuery = let
Source = ABC_Finance
in
Source;

I don't know what am I doing wrong. All those data and transformation are happening in the same Storage Account.

if someone can help thanks.

kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2020-12-22T12:52:21.007+00:00

Hi @Romain Pham ,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

I tried reproducing the same and transforming the CSV file using wrangling data flow and was able to do it successfully. I have used wrangling-data-flow-tutorial as reference. You can refer to attached image here.

Below are few details needed from you to further investigate the issue which you are facing

1) Can you try sharing the screenshot of the complete error which you are getting.
2)Share the sample query which you are using to transform the data in the power query.
3) If possible, please share the sample data file (attach as .txt file) .
4) Please provide the pipeline runID of the failed pipeline.
5) for the CSV file can you use it in copy activity as source and see if you are able to load the file properly.

Awaiting your Response.

Accepted answer

2 additional answers

Your answer

kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2020-12-22T12:52:21.007+00:00

Hi @Romain Pham ,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

I tried reproducing the same and transforming the CSV file using wrangling data flow and was able to do it successfully. I have used wrangling-data-flow-tutorial as reference. You can refer to attached image here.

Below are few details needed from you to further investigate the issue which you are facing

1) Can you try sharing the screenshot of the complete error which you are getting.
2)Share the sample query which you are using to transform the data in the power query.
3) If possible, please share the sample data file (attach as .txt file) .
4) Please provide the pipeline runID of the failed pipeline.
5) for the CSV file can you use it in copy activity as source and see if you are able to load the file properly.

Awaiting your Response.

Answer 1

kekiran-MSFT 391 Microsoft Employee Moderator

Hi @Romain Pham ,

Thank you for your continued patience while we were working on this issue.

Your data factory is hosted in central France region and during the investigation process our product team identified that there was some issue with the underlying infra in the region due to which Wrangling data flow was not working as expected.

Fix has been deployed for the same and we would like you to test and confirm.

Please accept an answer if correct. Original posters help the community find answers faster by identifying the correct answer. Here is how.
Want a reminder to come back and check responses? Here is how to subscribe to a notification.

Romain Pham 26 Reputation points

2021-01-07T07:42:49.54+00:00

It's fix and it's All Good!

Thank you so much Keshav for the quick feedback and thanks to the Product Team for quickly identifying and fixing the issue! Keep on the good work you guys really help us to achieve more :)

Answer 2

Romain Pham 26

Dear @Anonymous ,

Thanks for your feedback please find below screenshot of the different message I receive

2) I haven't done any transformation yet below the sample query:
let
AdfDoc = Web.Contents("https://cndatafactorysa.blob.core.windows.net/tmrdata/test.txt?sv=2018-03-28&sig=%2Ft%2BGLsVfetK4eaaAgq%2FsZjRGEEuaUYij7LZolUKIkTA%3D&spr=https&se=2020-12-24T02%3A57%3A40Z&srt=sco&ss=bf&sp=rwl"),
Csv = Csv.Document(AdfDoc, [Delimiter = ",", Encoding = TextEncoding.Utf8, QuoteStyle = QuoteStyle.Csv])
in
Csv

3) Sample data

50635-test.txt

4)There is no pipeline failed i simply connot see the file in the power query hence cannot do any transformation

5) I can copy the file without problem using copy activity i just have this issue when trying to use power query online

kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2020-12-30T08:26:25.447+00:00

Hi @Romain Pham

Thanks for connecting over mail and sharing the necessary details. We are working with the Product Group on this and we will get back to you as soon as we get the final findings from them.
kekiran-MSFT 391 Reputation points Microsoft Employee Moderator

2021-01-05T09:57:09.177+00:00

Hi @Romain Pham

Due to Holiday seasons and limit availability of the product group engineers during the time, our product team were not able to address this issue. We are working on this and will keep you posted as soon as I hear back form them.

Answer 3

Andrea Cuneo 6

Having the same issue in West Europe.
The other difference is that we're using ADLS Gen2 instead of BlobStorage. The Storage is linked with Service Principal Account.

Share via

Azure Data Factory Wrangling data flow - Unexpected Error when connecting datasource

2 additional answers

Your answer