Fine-tuning for models in Azure OpenAI

志村武信 / SHIMURA，TAKENOBU 10

Hi I'm Shimura. I work for a Japanese IT company.

I would like to fine-tuning the data into a model in GPT provided by Azure OpenAI.

Is it possible to train data to the model in a closed environment?

VasaviLankipalle-MSFT 14,576 Reputation points

2023-03-23T20:35:13.59+00:00

Hi @志村武信 / SHIMURA，TAKENOBU , Thanks for using Microsoft Q&A Platform.

You can fine-tune your own model with Azure OpenAI by using the Azure OpenAI Studio. You can import a training dataset from Azure Blob or another shared web location by providing the name and location of the file. You can also choose to use validation data in the training process of your fine-tuned model.

I'm not clear what you mean by a "closed environment". Could you please elaborate more on this?
志村武信 / SHIMURA，TAKENOBU 10 Reputation points

2023-03-24T03:38:23.2466667+00:00

@VasaviLankipalle-MSFT Thank you for your reply.

By a "closed environment" I mean an environment where people I have not given access to cannot access the models when they are being trained or used after they have been trained.

In other words, I want to make sure that people I have not authorised cannot access the data or the model when training on the model or using the model.
志村武信 / SHIMURA，TAKENOBU 10 Reputation points

2023-03-28T01:03:15.8833333+00:00

thank you for your reply.

I understand the rules regarding authority.

This concludes my question.
VasaviLankipalle-MSFT 14,576 Reputation points

2023-03-28T01:30:53.11+00:00

Hi @志村武信 / SHIMURA，TAKENOBU , Thanks for sharing. I hope it answered your question. I have converted my comment to an answer. Please take some time to accept the answer if you feel helpful. Thanks!
VasaviLankipalle-MSFT 14,576 Reputation points

2023-04-03T23:50:33.4433333+00:00

@志村武信 / SHIMURA，TAKENOBU , please take some time to accept the answer if you feel helpful. Thanks!
志村武信 / SHIMURA，TAKENOBU 10 Reputation points

2023-04-21T06:52:22.0766667+00:00

@VasaviLankipalle-MSFT
Hi, I have an additional question.
In my previous question, you mentioned that others cannot access the data and learned models that are trained into the fine-tuning model. I would like to add, can't Microsoft also access and view that training data and learned model in the same way?
Azliza Bahari 15 Reputation points Microsoft Vendor

2023-05-05T02:13:59.6366667+00:00

I have a customer who has started making Chatbots in Azure using the new Open Ai service, but is unable to use the ‘fine tuning’ feature at the moment –when will this feature be available? or is there anything they can do to activate it?

1 answer

VasaviLankipalle-MSFT 14,576 Reputation points

2023-03-28T01:28:51.55+00:00

Hi @志村武信 / SHIMURA，TAKENOBU , to ensure that only authorized people can access the data or the model when training on the model or using the model, you can use Azure role-based access control (Azure RBAC). Did you get a chance to check how to configure Azure Open AI with managed identities: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/how-to/managed-identity

Azure OpenAI does supports VNET's and Private Endpoints also: https://learn.microsoft.com/en-us/azure/cognitive-services/cognitive-services-virtual-networks?context=/azure/cognitive-services/openai/context/context

Is this something you are looking for?

I hope this helps. Let me know if you have any questions.

Regards,
Vasavi

-Please kindly accept the answer and vote 'Yes' if you feel helpful to support the community, thanks.
Please sign in to rate this answer.

1 person found this answer helpful.

0 comments No comments
Sign in to comment