Installing Microsoft ODBC 18 Driver in Custom Environment for Azure ML Studio Pipeline

Saeid 0

I am currently working on creating a pipeline in Azure Machine Learning Studio using the Python SDK v2 to pull data from an external data hub. To achieve this, I am using the pyodbc library to connect to the database. However, I encounter an error indicating that I need to install Microsoft ODBC 18.

I understand that I need to run a bash script to install Microsoft ODBC 18 Driver, but I am unsure how to integrate this step into a custom environment that I have created using a YAML file through the Python SDK v2.

Could you please provide guidance on how to include the installation of Microsoft ODBC 18 in my custom environment setup?

Thank you for your assistance!

Saeid 0

here's the code snipped i'm using:

authorityHostUrl = "https://login.microsoftonline.com"
authority_url = authorityHostUrl + "/" + tenant_id
context = adal.AuthenticationContext(authority_url,   api_version=None)  
token = context.acquire_token_with_client_credentials("https://database.windows.net/", clientId, clientSecret)

query = 'SELECT All * FROM XXXX'

# get bytes from token obtained
tokenb = bytes(token["accessToken"], "UTF-8")
exptoken = b'';
for i in tokenb:
    exptoken += bytes({i});
    exptoken += bytes(1);
tokenstruct = struct.pack("=i", len(exptoken)) + exptoken;

# build connection string using acquired token
connString = "Driver={ODBC Driver 18 for SQL Server};SERVER="+server+";DATABASE="+database+""
SQL_COPT_SS_ACCESS_TOKEN = 1256 
conn = pyodbc.connect(connString, attrs_before = {SQL_COPT_SS_ACCESS_TOKEN:tokenstruct});

#create a dataframe from the query
df = pd.read_sql_query(query , conn)
conn.close()

romungi-MSFT 43,651 Reputation points Microsoft Employee

2024-07-04T10:05:28.4+00:00

@Saeid With respect to custom environments, I think docker file or conda specification is required to install the required dependencies.

Did you also try to use import data feature from external databases as a datastore?

Share via

Installing Microsoft ODBC 18 Driver in Custom Environment for Azure ML Studio Pipeline