PolyBase Error .

Question

From last 2 days ...,scratching head for this problem .
funny part ... in afternoon hours this gets executed successfully .., while in evening hours the same file when we create and try to select external table . it gives this problem .

105083;The following columns in the user defined schema are incompatible with the external table schema for table 'ET_DFI_OUTPUT_CSV_Test': user defined column: ([ITEM_LABEL] NVARCHAR(2000) COLLATE SQL_Latin1_General_CP1_CI_AS) is not compatible with the type of detected external table column: ([item_label] INT), user defined column: ([ANSWER_VALUE] NVARCHAR(2000) COLLATE SQL_Latin1_General_CP1_CI_AS) is not compatible with the type of detected external table column: ([answer_value] INT). The detected external table

any idea / guess in which direction i should go .. Both the columns data can be ..either 1,2,3 or 1,1a,2b,3
our source is CSV created by powershell .

Answer 1

Hi @Rakesh Dhar ,

> The following columns in the user defined schema are incompatible with the external table schema for table 'ET_DFI_OUTPUT_CSV_Test': user defined column: ([ITEM_LABEL] NVARCHAR(2000) COLLATE SQL_Latin1_General_CP1_CI_AS) is not compatible with the type of detected external table column: ([item_label] INT),

According to MS document, the column definitions, including the data types and number of columns, must match the data in the external files. If there's a mismatch, the file rows will be rejected when querying the actual data.

---

If the response is helpful, please click "Accept Answer" and upvote it, thank you.