Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,402 questions
sqlserver can directly host python scripts, see:
How to use Python library in SQL platform without using Databricks?
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(16, 5%, 11%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EMS%3C/text%3E%3C/svg%3E)
Mohammad Saber
591
Reputation points
Hi,
I have developed a Python library that is installed on a Databricks cluster (as a wheel file) and is used to apply a few functions on delta tables:
Import library into a notebook
Read required data from delta tables
- Run python functions on the data and store results in a delta table
I need to run the same python codes in an Azure environment that doesn't have Databricks workspace. The client doesn't use Azure Databricks and all tables are SQL tables stored in Azure SQL database.
Is there any way or service that I can use the same python library in a SQL platform without using Databricks (e.g Data Factory, Azure Function)?
It is not possible to write all codes in SQL language so I need to use the python library.
{count} votes
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(54.400000000000006, 38%, 15%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EQ%3C/text%3E%3C/svg%3E)
QuantumCache 20,356 Reputation points2023-10-05T00:43:23.59+00:00 @Mohammad Saber Please let me know if Azure Functions are helpful?
Sign in to comment
2 answers
Sort by: Most helpful
-
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(211.20000000000002, 61%, 30%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EBS%3C/text%3E%3C/svg%3E)
Bruce (SqlWork.com) 74,536 Reputation points2023-10-04T17:59:40.4166667+00:00 -
Mohammad Saber 591 Reputation points
2023-10-04T20:41:09.6266667+00:00 Thanks.
In the environment where I am working, SQL Server Machine Learning Services is not installed.
I am thinking of using Azure Functions or calling Python script through Stored Procedure.
-
Erland Sommarskog 120.2K Reputation points MVP2023-10-04T21:35:14.7166667+00:00 sqlserver can directly host python scripts, see:
No. Mohammad is using Azure SQL Database, which does not support the Machine Learning Extensions.
Sign in to comment -
-
QuantumCache 20,356 Reputation points
2023-10-04T16:49:19.3733333+00:00 Hello @mohammad saber
Please see the below suggestion from Bruce on hosting python scripts.
You can try [Azure Functions]() to run your Python library in a SQL platform without using Databricks. Azure Functions is a serverless compute service that allows you to run event-driven code in a variety of languages, including Python. By using Azure Functions to run your Python library, you can apply the required functions on the data stored in your Azure SQL database without using Databricks. You can trigger the function based on a schedule or an event, depending on your requirements. Quickstart: Create a function in Azure with Python using Visual Studio Code Please let us know if that helps?
-
Mohammad Saber 591 Reputation points
2023-10-05T01:23:48.2833333+00:00 Yes, thank you. I think the solution is using Azure Function.
Sign in to comment -