ADF linked service for Snowflake is timing out

Shashwat Tiwary 80 Reputation points
2024-06-13T09:36:27.5366667+00:00

Hi,

In my production account we would be doing the data processing on ADF and we would be using Snowflake as a data warehouse. Also, for some ADF pipelines same Snowflake DWH will also be a source.

I first create a role, granted it permissions created a user and assigned the role to the user. Below is the query I ran.

-- Create role
CREATE ROLE data_engineer;

-- Grant privileges
GRANT USAGE ON DATABASE dev_database TO ROLE data_engineer;
GRANT USAGE ON SCHEMA dev_database.test_schema TO ROLE data_engineer;
GRANT CREATE TABLE, CREATE VIEW, CREATE STAGE 
ON SCHEMA dev_database.test_schema TO ROLE data_engineer;
GRANT SELECT, INSERT, UPDATE, DELETE 
ON ALL TABLES IN SCHEMA dev_database.test_schema TO ROLE data_engineer;
GRANT SELECT, INSERT, UPDATE, DELETE 
ON FUTURE TABLES IN SCHEMA dev_database.test_schema TO ROLE data_engineer;
GRANT SELECT ON FUTURE VIEWS IN SCHEMA dev_database.test_schema TO ROLE data_engineer;

-- Create user
CREATE USER adf_user_2
PASSWORD = '***********'
DEFAULT_ROLE = data_engineer
DEFAULT_WAREHOUSE = COMPUTE_WH
MUST_CHANGE_PASSWORD = FALSE;

-- Assign role to user
GRANT ROLE data_engineer TO USER adf_user_2;

I then used these credentials in the linked service.

User's image

But I got error - operation has timed out*.*

User's image

While I am able login to snowflake from snowflake portal with this credential, I am not sure why I am getting connection timeout for the linked service.

Any help and guidance will be helpful.

Thanks,

Shashwat

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,625 questions
{count} votes

Accepted answer
  1. Vaibhav Patil 255 Reputation points
    2024-06-13T10:55:04.2233333+00:00
    
    
          Use below steps I'm sure it would be helpful.  
          Verify VNet Integration in ADF
    

    **

    Create a Managed Virtual Network (optional):**

    • If your ADF instance needs to be part of a specific network, you can create a Managed Virtual Network within ADF.
      • Navigate to your Data Factory instance in the Azure portal.
        • Go to Author & Monitor.
          • Under the Manage tab, select Managed private endpoint.
            • Create a new managed private endpoint for Snowflake.

    Configure ADF to Use VNet:

    • In your Data Factory, navigate to Manage and then Linked services.
    • Edit or create a new linked service for Snowflake.
    • Under Network, select Integration Runtime that supports Virtual Network.
      • Ensure the Integration Runtime is associated with your desired VNet.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.