ADF automatically break the Record from a SQL query

Question

I am using the ADF COPY activity to query a XML output for processing. The copy activity success but it breaks the XML output result into two row of record, which break in the middle of XML attribute. The first row of xml record has 2000+ row length.

What can i do to make ADF to only out a single row of record.

The sink dataset i am using the DelimitedText in azure blob storage.

Answer 1

Hi adf001 ,

Thankyou for using Microsoft Q&A platform and thanks for posting your query here.

It seems like the issue you are facing is related to the way the XML output is being processed by the ADF COPY activity. It seems the COPY activity treats the XML output as a text file and splits it into multiple rows based on the delimiter specified in the sink dataset.

To avoid this issue, kindly try using the "Binary" format for both source and sink dataset instead of xml and "DelimitedText".

Although the source dataset is of binary type, you can point it to the xml file . Similarly, in sink create the binary dataset and give the filename with .txt extension.

This will ensure that the XML output is treated as a binary file and would not split into multiple rows. The XML output should be written to the sink dataset as a single binary file.

Hope this helps! In case you still face same issue, kindly share the sample data so that I can repro the same at my end. Kindly accept the answer by clicking on Accept answer button. Thankyou