This browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(172.8, 26%, 26%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EAT%3C/text%3E%3C/svg%3E)
I am converting an xml from html source to a json file using ADF. However, for one of the attributes, the 'lang' element is not getting translated.
The xml data in file is as follows:
'''
<displayname xml:lang="deAT"> Weiß</displayname>
<displayname xml:lang="deCH"> Weiß</displayname>
<displayname xml:lang="deDE"> Weiß</displayname>
<displayname xml:lang="xdefault">Colour Portable Photo Printer White</displayname>
<displayname xml:lang="enAE">Colour Portable Photo Printer White</displayname>
<displayname xml:lang="enGB">Colour Portable Photo Printer White</displayname>
<displayname xml:lang="enIE">Colour Portable Photo Printer White</displayname>
<displayname xml:lang="esES">blanco</displayname>
<displayname xml:lang="frBE"> Blanc</displayname>
<displayname xml:lang="frCH"> Blanc</displayname>
<displayname xml:lang="frFR"> Blanc</displayname>
<displayname xml:lang="itIT"> Bianco</displayname>
<displayname xml:lang="nlBE"> wit</displayname>
<displayname xml:lang="nlNL"> wit</displayname>
<displayname xml:lang="plPL"> biała</displayname>
<displayname xml:lang="ptPT"> Branco</displayname>
'''
However, in my json file in sink it is translated as follows:'
'''
"displayname": [
"Weiß",
"Weiß",
"Weiß",
"Colour Portable Photo Printer White",
"Colour Portable Photo Printer White",
"Colour Portable Photo Printer White ",
"Colour Portable Photo Printer White",
"blanco",
" Blanc",
" Blanc",
" Blanc",
" Bianco",
" wit",
" wit",
"biała",
" Branco"
],
'''
I want the 'lang' tag value to filter out data based on different languages. The array in json doesn't let me identify the language name associated i.e. nlNL, frFR etc.
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(268.8, 8%, 36%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EST%3C/text%3E%3C/svg%3E)
Welcome to Microsoft Q&A platform and thanks for posting your query here.
The issue here is that Azure Data Factory (ADF) is extracting the <displayname> values into an array but not retaining the xml:lang attributes in the transformation to JSON. To properly map and filter based on language, you need to restructure the conversion to preserve the lang attributes.
Enable Proper XML Parsing
When defining the XML dataset in ADF, ensure that the xml:lang attributes are not being ignored. If ADF does not automatically recognize attributes, consider the following:
xml:lang separately.Use a Derived Column to Structure Data as Key-Value Pairs
Instead of an array, format the JSON output as an object with language codes as keys:
{
"displayname": {
"deAT": "Weiß",
"deCH": "Weiß",
"deDE": "Weiß",
"xdefault": "Colour Portable Photo Printer White",
"enAE": "Colour Portable Photo Printer White",
"frFR": "Blanc",
"nlNL": "wit"
}
}
To achieve this, use a Derived Column transformation in Data Flow to create a structured mapping like:
struct(xml:lang, displayname)
This way, each displayname is correctly associated with its respective language.
Flatten and Filter by Language
To filter out specific languages, apply a Filter transformation:
xml:lang == "frFR"
After implementing these changes, your JSON output should correctly link each displayname value to its respective language code, making filtering easier.
I hope this information helps. Please do let us know if you have any further queries.
Kindly consider upvoting the comment if the information provided is helpful. This can assist other community members in resolving similar issues.
@Alefiya Tikiwala We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
What expression should be put in derived column transformation in the dataflow for extracting lang attribute?
Also, as you mentioned regarding 'Preserve Attributes' option in XML dataset in ADF, can you tell me where is it found? Maybe is it because my XML is derived from HTTP connection & not from ADLS? @Smaran Thoomu
@Alefiya Tikiwala Thanks for getting back!
Extracting the xml:lang attribute in Derived Column Transformation:
In your Derived Column transformation, you can create a structured mapping like this:
struct(xml:lang, displayname)
This will ensure each displayname is paired with its respective language code, making filtering easier in your JSON output.
'Preserve Attributes' Option in XML Dataset:
Unfortunately, ADF's XML dataset doesn't have a direct "Preserve Attributes" option (like in some other tools). However, since your XML comes from an HTTP connection and not ADLS, ADF might be handling it differently.
Here’s what you can try:
xml:lang) alongside values. I hope this information helps. Please do let us know if you have any further queries.
I am not able to create structured mapping in derived column transformation like you are mentioning. 'Struct' is not a valid function in expression builder: