Will ADLS Gen2 start supporting staging when using Snowflake source?

Yoismel 20 Reputation points
2024-01-31T22:36:59.4966667+00:00

I just read ADLS Gen1 is being retired and just this week I started a pipeline that gave me this error and I had to create an ADLS Gen1. Will ADLS Gen2 support staging setting when using Snowflake source?

User's image

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,547 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,363 questions
{count} votes

Accepted answer
  1. PRADEEPCHEEKATLA 90,566 Reputation points
    2024-02-01T01:39:13.7733333+00:00

    @Yoismel - Thanks for the question and using MS Q&A platform.

    This is an excepted behaviour, when you are using ADLS gen2.

    If your source data store and format meet the criteria described in this section, you can use the Copy activity to directly copy from source to Snowflake. The service checks the settings and fails the Copy activity run if the following criteria is not met:

    User's image

    Though Snowflake supports blob storage, Data Lake storage Gen2, General purpose v1 & v2 storages, loading data into snowflake is supported- through blob storage only.

    The source linked service is Azure Blob storage with shared access signature authentication. If you want to directly copy data from Azure Data Lake Storage Gen2 in the following supported format, you can create an Azure Blob linked service with SAS authentication against your ADLS Gen2 account, to avoid using staged copy to Snowflake.

    Select Azure blob storage in linked service, provide SAS URI details of Azure data lake gen2 source file.

    Blob storage linked service with data lake gen2 file:

    enter image description here

    enter image description here

    [enter image description here] (https://i.stack.imgur.com/vA22I.png)

    enter image description here

    enter image description here

    For more details, refer to Copy and transform data in Snowflake using Azure Data Factory or Azure Synapse Analytics.

    Hope this helps. Do let us know if you any further queries.


    If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.