tab column deliminater or data issue in copy activity

SwarupKumarSapireddy-8219 46 Reputation points

Hi all, in one of pipeline we receive data from amazon s3 and store in adls and transform activities. But from past few days we received unexpected data like there is sales Sorg column where u expect only 4digit numeric values but there were sentences in that column along with numeric values. I also checked from the source file and found out all these sentences came from data from one entry on a particular column. So what i believe is that particular entry is not Included correctly or something. Even though source file looks good while storing in adls due to the tab column deliminator i data is as not expected.So my question or doubt is something i can do from pipeline end or is it should be corrected from source itself?

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
8,503 questions
{count} votes