XML data source in azure data factory not loading single node XML files when collection reference is enabled in mapping

Question

XML data source in azure data factory not loading single node XML files when collection reference is enabled in mapping

Ravi, Rakhi(Contractor) 11

When i use XML data source with mapping projection using a multiple row XML file and enable the collection reference, single row XML files are not getting loaded..Only multiple row files are loaded. Similarly if i don't enable collection reference, only single row XML files are loaded, not the multiple row XML files.

Anonymous

2021-06-02T05:53:46.483+00:00

Could you please tell me what kind of app you are developing? A uwp app？A WPF app or other kind of apps?
Ravi, Rakhi(Contractor) 11 Reputation points

2021-06-02T06:16:27.533+00:00

I'm sorry.I.m not developing an app.The tag came under wrong tag.

In azure data factory, i'm trying to load XML file from SFTP location to blob storage. in the copy activity, as XML source in mapping section, when i enable collection reference, i'm not able to load XML file with single row. But when i disable the collection reference, i wont be able to load multiple rowed file.
Currently for solution what i'm doing is, crate copy activity with collection reference enabled for multiple rowed XML files and another copy activity with collection reference disabled for loading single rowed XML files. is there any other solution?
Anonymous

2021-06-02T06:37:56.813+00:00

I've changed the tag to Azure-data-factory so that the Azure engineers could check this.
PRADEEPCHEEKATLA 91,866 Reputation points

2021-06-02T09:53:53.39+00:00

Hello @Ravi, Rakhi(Contractor) ,

Welcome to Microsoft Q&A Platform. Thanks for posting the query.

Could you please share your XML file and the copy activity mapping json file? So that we can follow along with your ask by reproducing scenario and help you with detailed resolution.

Thank you.
PRADEEPCHEEKATLA 91,866 Reputation points

2021-06-04T09:54:22.197+00:00

Hello @Ravi, Rakhi(Contractor) ,

Follow up to see if you have had a chance to see the previous response. We need the following information to understand/investigate this issue further.
Britt 1 Reputation point

2021-09-14T22:52:29.427+00:00

Any updates on this? I'm also experiencing this issue. When there's only one entry in a collection reference, that entry gets skipped.

For example, the below banknote will be skipped:

<Deposits>
<Deposit Currency="USD">
<Banknote Qty="5" Denom="5"/>
</Deposit>
</Deposits>

But this one won't because there is more than one Banknote node.

<Deposits>
<Deposit Currency="USD">
<Banknote Qty="48" Denom="1"/>
<Banknote Qty="10" Denom="5"/>
<Banknote Qty="2" Denom="20"/>
</Deposit>
</Deposits>

If anyone has any ideas on how to handle this is Data Factory it would be much appreciated.
Annelijn Weerman 1 Reputation point

2021-12-22T12:45:27.613+00:00

I've had the same issue. Apparently, when there is only one value it is considered as an object. When it has multiple nodes, it is considered as an array.
I have also not found a solution for this.
Lourdes Almada 1 Reputation point

2021-12-28T21:54:05.727+00:00

I'm having the same issue
PRADEEPCHEEKATLA 91,866 Reputation points

2021-12-30T10:23:02.24+00:00

Hello @Annelijn Weerman and @Lourdes Almada ,

Since this thread is too old, I would recommend creating a new thread on the same forum with as much details about your issue as possible. That would make sure that your issue has better visibility in the community.