XML File in Azure Data factory with different name spaces

Gijs van Gent 1

Hi,

I have several different XML files like below which have different Namespaces in the XML files.
I have created a Dataflow in ADF, but when I check in the Source, Tab projection, and I Import the projection, you will see 2 different columns names: http://www.example.nl/2021/01 and http://www.example.nl/2022/02.
When I create a dataflow with 1 XML as a source, for example with namespace: http://www.example.nl/2021/01, everything works fine, but when I read the XML file with Namespace http://www.example.nl/2022/02 and http://www.example.nl/2021/01 it will show all the data fore http://www.example.nl/2021/01 but for http://www.example.nl/2022/02 it will show no data ( NULL).

Is there a way to avoid or solve this so I can read the XML files with a dataflow?

File 1
<?xml version="1.0" encoding="UTF-8"?>
<ns0: Claim xmlns:ns0="http://www.example.nl/2021/01">
<ns0:response>
………
</ns0:response>
</ns0: Claim>

File 2
<?xml version="1.0" encoding="UTF-8"?>
<ns0: Claim xmlns:ns0="http://www.example.nl/2022/02">
<ns0:response>
………
</ns0:response>
</ns0: Claim>

Thanks in advance..

KranthiPakala-MSFT 46,642 Reputation points Microsoft Employee Moderator

2022-05-12T21:50:27.583+00:00

Hello @Gijs van Gent ,

Thanks for the question and using MS Q&A platform.

Could you please help provide the steps how you have selected multiple XML files in your source so that we can try to reporduce the issue and help assist to unblock.

Are you using two source transformations or just 1 source transformation and pointing to multiple files with wild card naming?
Please help provide few additional repro details to better assist on this issue.

Thank you
Gijs van Gent 1 Reputation point

2022-05-13T14:04:30.503+00:00

Hi,

All the XML files are located at an Azure Datalake Storage Gen2 container in one map.
I want to read all this XML files and then load/transform (flatten) them to parquet files.

I have created 1 Source in ADF and I’m pointing (reading) to all the XML files that are in the same map in the container.

In the screenshot below, you can see what the problem is.
Because the namespaces in the XML files are different each time, it will create 2 columns in the projection tab. I just want one generic XML column so it will work for each XML file.
I have tried by using one XML as an example, but when I load the other XML's (with different namespaces) it results in NULL values for all the records.

Thanks..

Your answer