How to use Python library in SQL platform without using Databricks?

Question

Hi,

I have developed a Python library that is installed on a Databricks cluster (as a wheel file) and is used to apply a few functions on delta tables:

Import library into a notebook

Read required data from delta tables

• Run python functions on the data and store results in a delta table

I need to run the same python codes in an Azure environment that doesn't have Databricks workspace. The client doesn't use Azure Databricks and all tables are SQL tables stored in Azure SQL database.

Is there any way or service that I can use the same python library in a SQL platform without using Databricks (e.g Data Factory, Azure Function)?

It is not possible to write all codes in SQL language so I need to use the python library.

Answer 1

sqlserver can directly host python scripts, see:

https://learn.microsoft.com/en-us/sql/machine-learning/concepts/extension-python?view=sql-server-ver16

Answer 2

Hello @mohammad saber

Please see the below suggestion from Bruce on hosting python scripts.

You can try [Azure Functions]() to run your Python library in a SQL platform without using Databricks. Azure Functions is a serverless compute service that allows you to run event-driven code in a variety of languages, including Python. By using Azure Functions to run your Python library, you can apply the required functions on the data stored in your Azure SQL database without using Databricks. You can trigger the function based on a schedule or an event, depending on your requirements. Quickstart: Create a function in Azure with Python using Visual Studio Code Please let us know if that helps?