tab column deliminater or data issue in copy activity

SwarupKumarSapireddy-8219 71 Reputation points
2022-10-25T06:15:58.87+00:00

Hi all, in one of pipeline we receive data from amazon s3 and store in adls and transform activities. But from past few days we received unexpected data like there is sales Sorg column where u expect only 4digit numeric values but there were sentences in that column along with numeric values. I also checked from the source file and found out all these sentences came from data from one entry on a particular column. So what i believe is that particular entry is not Included correctly or something. Even though source file looks good while storing in adls due to the tab column deliminator i data is as not expected.So my question or doubt is something i can do from pipeline end or is it should be corrected from source itself?
]1253764-image.png

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,874 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.