question

PrapulKumarDongari-0385 avatar image
0 Votes"
PrapulKumarDongari-0385 asked ShaikMaheer-MSFT commented

Error: Copy Multiple Parquet Files from ADLS2 to Synapse

Hi, I have the scenario to copy multiple Parquet files from ADLS2 to Synapse ,Here I'm using wildcard path as *.parquet but im getting following error .so how to fix 'txn' data type issue in ADF copy activity.

Thanks & Regards
Prapul Kumar197950-txn-issue.png


azure-data-factoryazure-synapse-analyticsazure-data-lake-storage
txn-issue.png (25.5 KiB)
· 1
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

@PrapulKumarDongari-0385,

Just checking in to see if the below answer helped. If this answers your query, do click 130616-image.png and upvote 130671-image.png for the same. And, if you have any further query do let us know.

0 Votes 0 ·
PratikSomaiya avatar image
0 Votes"
PratikSomaiya answered PratikSomaiya edited

Hello @PrapulKumarDongari-0385

Can you check the data type of column txn, if might be an unsupported type

You can also compare the data type of this column between parquet file and synapse

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

PrapulKumarDongari-0385 avatar image
0 Votes"
PrapulKumarDongari-0385 answered

Hi PratikSomaiya thanks for your valuable reply, synapse is not supporting 'txn' datatype is there any way we can ignore this error in Copy activity .


Thanks & Regards
PrapulKumar

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

PratikSomaiya avatar image
0 Votes"
PratikSomaiya answered

@PrapulKumarDongari-0385

Can you please check this similar type of issue to get an idea, here they are not using copy activity but error is similar which may help

https://social.msdn.microsoft.com/Forums/en-US/4da85184-040f-4907-985f-ec942ccb4b96/parquet-file-contained-column-errcol-which-is-of-a-nonprimitive-unsupported-type?forum=AzureDataFactory

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.