Mapping of XML in ADF

Question

Hey,

I'm trying to do mapping of XML file from HTTP connector in ADF, now the issue is that in a single column some rows are there as an Object and others as a node.

Here, in 1st screen shot the customer-work-region is an object and in the another one it is a node.
If we do the mapping according to one case, then we get an error and if we select "Skip Incompatible Rows"  we are loosing some data.

So is there any other way by which we can get data without any data loss?

Answer 1

Hi @Hitesh Srivastava ,
Welcome to Microsoft Q&A platform and thanks for posting your query.
As I understand your ask here, it seems you want to fetch the xml data , however, the data which you shared in the screenshot looks like JSON data. Please confirm on that. Here the issue is that there is an inconsistency in the type of data, few rows are of String data type and few are JSON data. Please let me know if my understanding about your query is incorrect.

In order to process the data in ADF, we need to make sure the data is consistent from the source . The error which you are getting is an expected error in this case.

To process the file without any data loss, you can consider using fault tolerance to skip incompatible data and process the log file to fetch the skipped data.

Also, you can consider writing some custom code using Azure function to convert the source data into similar datatype and then use copy activity once the datatype among all the rows match.

Hope this will help. Please let us know if any further queries.

------------------------------

• Please don't forget to click on or upvote button whenever the information provided helps you.
  Original posters help the community find answers faster by identifying the correct answer. Here is how
• Want a reminder to come back and check responses? Here is how to subscribe to a notification
• If you are interested in joining the VM program and help shape the future of Q&A: Here is how you can be part of Q&A Volunteer Moderators