Deployment of Assistant API on Azure ML prompt flow.

Question

Deployment of Assistant API on Azure ML prompt flow.

Karishma Nanda 265

Hi, I am trying to use recently launched AZURE Assistant API (link) on my own data and deploy it, but I am confused about implementing and deploying on Azure ML like how to connect my data, do I need to create vector database and store my data in there and then connect Assistant with it , or is it possible to connect your Assistant in AZURE ML Promt Flow on, and what type of IAM role do I need to implement and deploy Assistant. Please help me.

Accepted answer

0 additional answers

Your answer

Answer 1

AshokPeddakotla-MSFT 35,971 Moderator

Karishma Nanda Greetings!

I am trying to use recently launched AZURE Assistant API (link) on my own data and deploy it, but I am confused about implementing and deploying on Azure ML like how to connect my data,

Did you check this doc Get started using Azure OpenAI Assistants (Preview) already?

Regarding your question about connecting the Assistant in Azure ML Prompt Flow, I am not sure about the specific details of your use case. Can you add more details for further assistance.

However, you can use the Assistant API to interact with the model from any application that can make HTTP requests.

Regarding your role, please see Role-based access control for Azure OpenAI Service for more details.

Hope this helps. Do let me know if you have any further queries.

Karishma Nanda 265 Reputation points

2024-02-16T15:55:46.0633333+00:00

Hi Ashoka thank you for replying, yes I went through most of them, my use case is connecting assistant with tabular data, getting insight of data (use assistant as code interpreter ) and deploying it (get rest api), on AZURE ML .
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2024-02-26T15:52:06.39+00:00

Karishma Nanda

To connect the Azure OpenAI Assistant API with tabular data, you can use the Assistant API to send a prompt to the model that includes your tabular data as input. The model will use the input to generate a response that provides insights about the data. To use the Assistant API as a code interpreter, you can send a prompt to the model that includes your code as input. The model will use the input to generate a response that executes the code and provides the output.

To deploy the model as a REST API on Azure ML, you can use the Azure Machine Learning service to deploy the model as a web service. You can follow the instructions given in this document to deploy the model as a web service.

Once you have deployed the model as a web service, you can use the REST API to interact with the model from any application that can make HTTP requests. You can follow the instructions given in this document to consume the web service.

Do let me know if that helps or have any other queries.

If the response helped, please do click Accept Answer and Yes for was this answer helpful.
Karishma Nanda 265 Reputation points

2024-02-26T15:56:20.85+00:00

Thank you Ashok, I am able to connect with tabular data. You could close this thread. thank you again :)
AshokPeddakotla-MSFT 35,971 Reputation points Moderator

2024-02-26T16:04:20.01+00:00

You are welcome! Glad to hear your issue is resolved.

Share via

Deployment of Assistant API on Azure ML prompt flow.

0 additional answers

Your answer