I need sample code to connect AzureOpenAI from Azure DataBricks and manage models by MLflow.

Question

I need sample code to connect AzureOpenAI from Azure DataBricks and manage models by MLflow.

There are samples of OpenAI model management, but I would like to know if there are any sample programs for Azure OpenAI.

Do you know of any samples published on Github or elsewhere?

Answer 1

@麻記 辻 Thanks for reaching out to us, I am sorry there is no a lot of documents for reference, but below are the existing documents you can refer to -

The ai_generate_text() function is a built-in Azure Databricks SQL function that allows you to access large language models (LLMs) directly from SQL. This function currently supports access to OpenAI and Azure OpenAI models, and enables customers to use them as building blocks in data pipelines and machine learning workloads. For syntax and design patterns, see the ai_generate_text function language manual content.

https://learn.microsoft.com/en-us/azure/databricks/large-language-models/ai-onboard

Not pretty sure when you are talking about MLflow, are you talking about MLflow below, but please refer to below document -

The MLflow AI Gateway service is a powerful tool designed to streamline the usage and management of various large language model (LLM) providers, such as OpenAI and Anthropic, within an organization. It offers a high-level interface that simplifies the interaction with these services by providing a unified endpoint to handle specific LLM related requests.

https://mlflow.org/docs/latest/llms/gateway/index.html

There is also a blog to introduce some other ways to integrate OpenAI with other open resource.

https://azure.microsoft.com/en-us/blog/exploring-open-source-capabilities-in-azure-ai/

I hope this helps, please let me know how it works.

Regards,

Yutong

-Please kindly accept the answer and vote 'Yes' if you feel helpful to support the community, thanks a lot.