Data factory only loading first row of xml file

Question

Data factory only loading first row of xml file

Wells, Nicholas 10

I am setting up a Data factory process for the first time to load XML data stored in Azure Blob Storage.

I go through the wizard and when it runs, the process successfully loads the first row, but not any of the subsequent rows.

What am I misconfiguring?

The data preview and data mapping is shown below.
User's image

User's image

SSingh-MSFT 16,461 Reputation points Moderator

2023-03-16T06:17:36.75+00:00
Hi @Wells, Nicholas,

Welcome to Microsoft Q&A forum and thanks for using Azure services.

Could you please check if above suggestion by Viorel helped.

If not, please let us know the below details for us to troubleshoot:

Source Details

Sink Linked Service

Activities used in the pipeline.

Sample Input and Output data to help us reproduce the scenario.

Thank you.
Wells, Nicholas 10 Reputation points

2023-03-17T01:19:24.6566667+00:00

@Viorel You were kind of on the right track. While I selected the Collection Reference as shown in the screenshot, it didn't update the fields properly below it. When I tried it again to follow your suggestion, I ended up going back and forth between the mapping screen and the destination screen because I changed my mind about what table to import the data to, and somewhere during that back and forth, it "allowed" the Name side of the mapping to update with the collection information. I successfully imported the data. Thanks for the suggestion.
SSingh-MSFT 16,461 Reputation points Moderator

2023-03-20T05:48:01.5066667+00:00

Hi @Wells, Nicholas ,

Good to know that Viorel's suggestion helped you.

We recommend you to accept the answer by Viorel which helps community members facing similar issues to get solution from accepted answers.

Thank you.
OoBiDev 20 Reputation points

2023-08-28T19:34:46.04+00:00

Same problem here, how can I fix it?

returns only the first row.
SSingh-MSFT 16,461 Reputation points Moderator

2023-08-29T04:26:17.2233333+00:00

Hi OoBiDev,

Use names like @Id, @TagName, etc. instead of $['tags']['row'][0][...] as mentioned by Viorel in the answer.

Thanks
OoBiDev 20 Reputation points

2023-08-29T06:31:36.21+00:00

Thanks for your answer.
this is my file:

observation tag and station tag works fine, but parameter tag returns only the first row.
i tried to use ParameterShortName or ParameterValue instead of ['Parameter'][0]['ParameterShortName'] and ['Parameter'][0]['ParameterValue'], it return nulls.

when i use ['Parameter'][0]['ParameterValue'] it returns only the first row, in my example : ParameterShortName =TX1 ,ParameterValue=243 and all the station details are fine.
SSingh-MSFT 16,461 Reputation points Moderator

2023-08-29T06:50:15.4333333+00:00

Hi OoBiDev,

Kindly create a fresh question over this platform to get further assistance from the team.

Thanks for your cooperation.
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
SSingh-MSFT 16,461 Reputation points Moderator

2024-02-08T05:45:02.05+00:00

Hi
Felipe Santos •, Appreciate you for sharing the solution with the community. Thanks

2 answers

Your answer

SSingh-MSFT 16,461 Reputation points Moderator

2023-03-16T06:17:36.75+00:00

Hi @Wells, Nicholas,

Welcome to Microsoft Q&A forum and thanks for using Azure services.

Could you please check if above suggestion by Viorel helped.

If not, please let us know the below details for us to troubleshoot:

Source Details

Sink Linked Service

Activities used in the pipeline.

Sample Input and Output data to help us reproduce the scenario.

Thank you.
Wells, Nicholas 10 Reputation points

2023-03-17T01:19:24.6566667+00:00

@Viorel You were kind of on the right track. While I selected the Collection Reference as shown in the screenshot, it didn't update the fields properly below it. When I tried it again to follow your suggestion, I ended up going back and forth between the mapping screen and the destination screen because I changed my mind about what table to import the data to, and somewhere during that back and forth, it "allowed" the Name side of the mapping to update with the collection information. I successfully imported the data. Thanks for the suggestion.
SSingh-MSFT 16,461 Reputation points Moderator

2023-03-20T05:48:01.5066667+00:00

Hi @Wells, Nicholas ,

Good to know that Viorel's suggestion helped you.

We recommend you to accept the answer by Viorel which helps community members facing similar issues to get solution from accepted answers.

Thank you.
OoBiDev 20 Reputation points

2023-08-28T19:34:46.04+00:00

Same problem here, how can I fix it?

returns only the first row.
SSingh-MSFT 16,461 Reputation points Moderator

2023-08-29T04:26:17.2233333+00:00

Hi OoBiDev,

Use names like @Id, @TagName, etc. instead of $['tags']['row'][0][...] as mentioned by Viorel in the answer.

Thanks
OoBiDev 20 Reputation points

2023-08-29T06:31:36.21+00:00

Thanks for your answer.
this is my file:

observation tag and station tag works fine, but parameter tag returns only the first row.
i tried to use ParameterShortName or ParameterValue instead of ['Parameter'][0]['ParameterShortName'] and ['Parameter'][0]['ParameterValue'], it return nulls.

when i use ['Parameter'][0]['ParameterValue'] it returns only the first row, in my example : ParameterShortName =TX1 ,ParameterValue=243 and all the station details are fine.
SSingh-MSFT 16,461 Reputation points Moderator

2023-08-29T06:50:15.4333333+00:00

Hi OoBiDev,

Kindly create a fresh question over this platform to get further assistance from the team.

Thanks for your cooperation.
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
SSingh-MSFT 16,461 Reputation points Moderator

2024-02-08T05:45:02.05+00:00

Hi
Felipe Santos •, Appreciate you for sharing the solution with the community. Thanks

Answer 1

Felipe Santos 5

I also went through this, do this configuration in the following image and it will work: User's image

Answer 2

Viorel 125.7K

Maybe you should write the names like @Id, @TagName, etc. instead of $['tags']['row'][0][...].

Felipe Santos 5 Reputation points

2024-02-07T18:28:51.3966667+00:00

I also went through this, do this configuration in the following image and it will work:

Share via

Data factory only loading first row of xml file

2 answers

Your answer