Document for Snowflake v2 Connector Issues

AnilKumar 60 Reputation points
2024-08-09T17:38:11.8666667+00:00

Is there a comprehensive document that lists all of the issues with Snowflake v2 connector when compared to the legacy connector? We are experiencing multiple issues with it and want to see if there is any documentation available.

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,651 questions
0 comments No comments
{count} votes

Accepted answer
  1. Bhargava-MSFT 31,261 Reputation points Microsoft Employee Moderator
    2024-08-09T18:03:03.4833333+00:00

    Hello AnilKumar,

    Welcome to the Microsoft Q&A forum.

    It looks like there isn't a single comprehensive document that lists all the issues with the Snowflake v2 connector compared to the legacy connector. However, I found the below issues for your reference.

    New connector enhancements:

    Support Basic as well as Key pair authentication.Support BigDecimal in Lookup activity. The NUMBER type, as defined in Snowflake, will be displayed as a string in Lookup activity.

    Multi-statement execution in the script activity and script parameters, they are currently not supported in the new Snowflake connector for ADF.

    When migrating from the Snowflake Legacy linked service to the new Snowflake connector (SnowflakeV2), you need to ensure that your existing datasets are compatible with the new connector. There might be custom expressions, transformations, or dependencies in your datasets that may not work with the new connector

    Reference: https://learn.microsoft.com/en-us/answers/questions/1623885/data-factory-how-to-migrate-a-snowflake-legacy-con

    The new Snowflake V2 connector has issues with copying data into non-uppercase database objects. In the old implementation, all schema and table names were wrapped in double quotes, making the table name case-sensitive. This behavior has changed in the new connector

    Reference: https://learn.microsoft.com/en-us/answers/questions/1624919/v2-snowflake-connector-how-to-copy-data-into-non-u

    Differences between Snowflake and Snowflake (legacy)

    The Snowflake connector offers new functionalities and is compatible with most features of Snowflake (legacy) connector. The table below shows the feature differences between Snowflake and Snowflake (legacy).

    Expand table

    Snowflake Snowflake (legacy)
    Support Basic and Key pair authentication. Support Basic authentication.
    Support Basic and Key pair authentication. Support Basic authentication.
    Script parameters are not supported in Script activity currently. As an alternative, utilize dynamic expressions for script parameters. For more information, see Expressions and functions in Azure Data Factory and Azure Synapse Analytics. Support script parameters in Script activity.
    Support BigDecimal in Lookup activity. The NUMBER type, as defined in Snowflake, will be displayed as a string in Lookup activity. BigDecimal is not supported in Lookup activity.

    To determine the version of the Snowflake connector used in your existing Snowflake linked service, check the type property. The legacy version is identified by "type": "Snowflake", while the latest V2 version is identified by "type": "SnowflakeV2".

    The V2 version offers several enhancements over the legacy version, including:

    Autoscaling: Automatically adjusts resources based on traffic load.

    Multi-Availability Zone Operation: Provides resilience by operating across multiple availability zones.

    Static IP Support: Enhances security by allowing the use of static IP addresses.

    Reference documents:

    https://learn.microsoft.com/en-us/azure/data-factory/connector-snowflake?tabs=data-factory#upgrade-the-snowflake-linked-service

    https://learn.microsoft.com/en-us/azure/data-factory/connector-snowflake-legacy?tabs=data-factory

    feedback items:

    https://feedback.azure.com/d365community/idea/609aedf4-7718-ef11-989a-000d3ae2b698

    https://feedback.azure.com/d365community/idea/ad72222c-9245-ef11-b4ad-000d3add4ccc

    https://feedback.azure.com/d365community/idea/5e4cfdb2-e14f-ef11-b4ad-000d3ae688a1

    I hope this answers your question.

    If this answers your question, please consider accepting the answer by hitting the Accept answer and up-vote as it helps the community look for answers to similar questions.

    1 person found this answer helpful.

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.