ADF Generic error while moving data from ADLS Gen 2 to Synapse

AzeemK 516 Reputation points
2021-06-02T22:16:13.303+00:00

I am getting this error below while moving Data from ADLS Gen 2 .csv files to Azure Synapse. I try changing data types for destination and to max length but the errro is still there Source file have almost 3 billion rows

Exception of type 'Microsoft.SqlServer.DataWarehouse.Tds.PdwManagedToNativeInteropException' was thrown.,Source=.Net SqlClient Data Provider,SqlErrorNumber=100000,Class=16,ErrorCode=-2146232060,State=1,Errors=[{Class=16,Number=100000,State=1,Message=PdwManagedToNativeInteropException ErrorNumber: 46724, MajorCode: 467, MinorCode: 24, Severity: 20, State: 2, Exception of type 'Microsoft.SqlServer.DataWarehouse.Tds.PdwManagedToNativeInteropException' was thrown.,},],'

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,624 questions
{count} votes

1 answer

Sort by: Most helpful
  1. AzeemK 516 Reputation points
    2021-06-11T22:16:35.033+00:00

    This was happening due to inserting null value in source to not null in destination

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.