I need sample code to connect AzureOpenAI from Azure DataBricks and manage models by MLflow.

麻記 辻 20 Reputation points Microsoft Employee
2023-11-08T14:31:01.9733333+00:00

I need sample code to connect AzureOpenAI from Azure DataBricks and manage models by MLflow.

There are samples of OpenAI model management, but I would like to know if there are any sample programs for Azure OpenAI.

Do you know of any samples published on Github or elsewhere?

Azure Machine Learning
Azure Machine Learning
An Azure machine learning service for building and deploying models.
2,657 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,015 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,433 questions
{count} votes

Accepted answer
  1. YutongTie-MSFT 47,596 Reputation points
    2023-11-09T17:13:55.79+00:00

    @麻記 辻 Thanks for reaching out to us, I am sorry there is no a lot of documents for reference, but below are the existing documents you can refer to -

    The ai_generate_text() function is a built-in Azure Databricks SQL function that allows you to access large language models (LLMs) directly from SQL. This function currently supports access to OpenAI and Azure OpenAI models, and enables customers to use them as building blocks in data pipelines and machine learning workloads. For syntax and design patterns, see the ai_generate_text function language manual content.

    https://learn.microsoft.com/en-us/azure/databricks/large-language-models/ai-onboard

    Not pretty sure when you are talking about MLflow, are you talking about MLflow below, but please refer to below document -

    The MLflow AI Gateway service is a powerful tool designed to streamline the usage and management of various large language model (LLM) providers, such as OpenAI and Anthropic, within an organization. It offers a high-level interface that simplifies the interaction with these services by providing a unified endpoint to handle specific LLM related requests.

    https://mlflow.org/docs/latest/llms/gateway/index.html

    There is also a blog to introduce some other ways to integrate OpenAI with other open resource.

    https://azure.microsoft.com/en-us/blog/exploring-open-source-capabilities-in-azure-ai/

    I hope this helps, please let me know how it works.

    Regards,

    Yutong

    -Please kindly accept the answer and vote 'Yes' if you feel helpful to support the community, thanks a lot.

    0 comments No comments

0 additional answers

Sort by: Most helpful