encountering difficulties while trying to fine-tune an Azure OpenAI model with data stored in Blob Storage using Python can be attributed to various factors.

Question

What are your recommended strategies and tools for efficiently extracting and processing text data from PDF documents when automating the fine-tuning of Azure OpenAI models using Python?"

Answer 1

Ashish Pandey Thanks for the question,  The Add your own data is a stateless service. It is part of the AOAI chat GPT completion API all you need is to provide the CogSearch details in the API and you can use it from any application. See more details here and reference API here.

This has the relevant document prep code:

sample-app-aoai-chatGPT/scripts/data_preparation.py at main · microsoft/sample-app-aoai-chatGPT (github.com)

As mentioned in the following Document fine tuning is in private preview.