Error in ADF : Any type not supported for column

Amine BENJELLOUN 0 Reputation points
2024-01-15T13:42:14.6566667+00:00

Hello , using Data Factory i'm trying to fill data in a Snowflake VARIANT column. My pipeline worked successfully a few weeks ago. I haven't changed anything in the pipeline and can't get it to work again since last week. I have this error on which i can't find any info : Operation on target Data flow1 failed: {"StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: com.microsoft.dataflow.Issues: DF-EXT-005 - Any type not supported for column 'RAW' - [520 476 564 737],EXE-0001,Dataflow cannot be analyzed as a graph,\nalterRow1 sink(\n) ~> sink1","Details":""} Does it speak to anyone ? Thanks Amine

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,245 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Harishga 5,995 Reputation points Microsoft Vendor
    2024-01-16T05:11:43.26+00:00

    Hi @Amine BENJELLOUN

    Welcome to Microsoft Q&A platform and thanks for posting your question here.

    Based on the error message you provided, it seems that the issue is related to the data type of the 'RAW' column in your Snowflake sink. The error message states that "Any type not supported for column 'RAW'". This means that the data type of the 'RAW' column is not compatible with the data type of the input data.

    To troubleshoot this issue, you can try the following steps:

    • Check the data type of the 'RAW' column in your Snowflake sink. Make sure that it is compatible with the data type of the input data.
       
    • Check if there are any changes made to the input data schema or the Snowflake sink schema. If there are any changes, make sure that they are compatible with each other.
       
    • Check if there are any null values in the input data. If there are any null values, make sure that they are handled properly in the data flow.
       
    • Check the status of your file and table connections in the data flow designer. In debug mode, select Data Preview on your source transformations to ensure that you can access your data.
       
    • If everything looks correct in data preview, go into the Pipeline designer and put your data flow in a Pipeline activity. Debug the pipeline for an end-to-end test.

    Reference:
    https://learn.microsoft.com/en-us/azure/data-factory/data-flow-troubleshoot-guide

    I hope this helps! Let me know if you have any other questions.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.