Error: Copy Multiple Parquet Files from ADLS2 to Synapse

Prapul Kumar Dongari 116 Reputation points
2022-05-02T03:30:08.233+00:00

Hi, I have the scenario to copy multiple Parquet files from ADLS2 to Synapse ,Here I'm using wildcard path as *.parquet but im getting following error .so how to fix 'txn' data type issue in ADF copy activity.

Thanks & Regards
Prapul Kumar197950-txn-issue.png

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,338 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,362 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,525 questions

3 answers

Sort by: Most helpful
Most helpful Newest Oldest
  1. Pratik Somaiya 4,201 Reputation points
    2022-05-02T06:03:56.137+00:00

    Hello @Prapul Kumar Dongari

    Can you check the data type of column txn, if might be an unsupported type

    You can also compare the data type of this column between parquet file and synapse

    0 comments
  2. Prapul Kumar Dongari 116 Reputation points
    2022-05-02T06:11:13.733+00:00

    Hi PratikSomaiya thanks for your valuable reply, synapse is not supporting 'txn' datatype is there any way we can ignore this error in Copy activity .

    Thanks & Regards
    PrapulKumar

    0 comments
  3. Pratik Somaiya 4,201 Reputation points
    2022-05-02T09:45:49.067+00:00

    @Prapul Kumar Dongari

    Can you please check this similar type of issue to get an idea, here they are not using copy activity but error is similar which may help

    https://social.msdn.microsoft.com/Forums/en-US/4da85184-040f-4907-985f-ec942ccb4b96/parquet-file-contained-column-errcol-which-is-of-a-nonprimitive-unsupported-type?forum=AzureDataFactory

    0 comments