No Linkage between Azure Data Factory and Snowflake Error Outputs

Swapnil Sarkar 0 Reputation points
2024-07-18T13:25:37.9133333+00:00

There is no linkage between Azure Data Factory and Snowflake currently during times when any script activity fails, it gives us an error. But what would really help us is if we can fetch the failed query id from snowflake, it would really save us a lot of time in debugging the error.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,205 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Pinaki Ghatak 3,265 Reputation points Microsoft Employee
    2024-07-19T20:53:07.6566667+00:00

    Hello @Swapnil Sarkar

    It seems like you are looking for a way to fetch the failed query ID from Snowflake when a script activity fails in Azure Data Factory.

    One way to achieve this is by using Snowflake's query history feature. You can enable query history in Snowflake and then query the history table to retrieve the query ID of the failed query.

    You can then use this query ID to debug the error. To enable query history in Snowflake, you can follow the steps mentioned in the Snowflake documentation.

    Once query history is enabled, you can query the history table using the Snowflake connector in Azure Data Factory to retrieve the query ID.

    I hope this helps

    0 comments No comments

  2. NIKHILANETHIKUNTA 155 Reputation points Microsoft Vendor
    2024-07-29T17:50:06.87+00:00

    Hi @Swapnil Sarkar
    Thank you for reaching out regarding the error message issue with the Snowflake connector in Azure Data Factory.

    I checked with our internal team, and I'm pleased to inform you that the new version of the Snowflake connector (SnowflakeV2) has already been deployed globally. This update includes enhancements to the script activity, specifically addressing the detailed error messaging as below. User's image

    Could you please try using the updated SnowflakeV2 connector and let us know if the issue persists? Your feedback is important to us, and we want to ensure that your experience with Azure Data Factory meets your expectations.

    If you encounter any further issues or have any questions, please don't hesitate to reach out.

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments