Resolving Snowflake Table Access Issues in Azure Data Factory

Question

What could be the reason for a "KeyNotFoundException" when accessing newly created Snowflake tables from ADLS via Azure Data Factory, and how can it be resolved?

PS - Based on common issues that we have seen from customers and other sources, we are posting these questions to help the Azure community.

Answer 1

The "KeyNotFoundException" error when accessing newly created Snowflake tables from Azure Data Lake Storage (ADLS) via Azure Data Factory is likely due to the use of the "float" data type in the Snowflake table schema. This error does not occur with older tables, indicating that the connector and linked service are functioning correctly.

To resolve this issue, modify the Snowflake table schema to use the "decimal" data type instead of "float". This change should allow the data to be accessed without errors.

Steps to Resolve: 1. Modify the Snowflake table to use "decimal" data type for any columns currently defined as "float". 2. Ensure your Azure Data Factory pipeline settings are updated to match the new schema.

For more detailed guidance, refer to the following documentation: - Azure Data Factory Copy Activity - Integrating Snowflake with Azure Data Factory

Hope this helps. If you have any follow-up questions, please let me know. I would be happy to help.

Please do not forget to "Accept the answer" and "up-vote" wherever the information provided helps you, as this can be beneficial to other community members.