Snowflake with azure ML possible?

Question

Hi Azure, i am connecting my project with data in Snowflake to azure ML. Is that smooth to do so? What is the best way to transfer my data to azure blob storage and how? Please share any suggestions if you have same scenario.

Answer 1

Hello @Joseph Pumelon

Thanks for reaching out to us, actually you can leverage your Snowflake data source directly, you don't need to move it to Azure.

Please see here - https://learn.microsoft.com/en-us/azure/machine-learning/how-to-import-data-assets?view=azureml-api-2&tabs=cli

There is also a sample for Snowflake -

The following code samples can import data from external databases. The connection that handles the import action determines the external database data source metadata. In this sample, the code imports data from a Snowflake resource. The connection points to a Snowflake source. With a little modification, the connection can point to an Azure SQL database source and an Azure SQL database source. The imported asset type from an external database source is mltable.

from azure.ai.ml.entities import DataImport
from azure.ai.ml.data_transfer import Database
from azure.ai.ml import MLClient

# Supported connections include:
# Connection: azureml:<workspace_connection_name>
# Supported paths include:
# path: azureml://datastores/<data_store_name>/paths/<my_path>/${{name}}

ml_client = MLClient.from_config()

data_import = DataImport(
    name="<name>",
    source=Database(connection="<connection>", query="<query>"),
    path="<path>"
    )
ml_client.data.import_data(data_import=data_import)

Please let me know how it works for your scenario. I hope this helps.

Regards,

Yutong

-Please kindly accept the answer and vote 'Yes' if you feel helpful to support the community, thanks a lot.