Verification and Validation of Chat completion API and Fine tuning

Seven Delta 0 Reputation points
2023-09-17T18:39:34.6833333+00:00

I’m using Azure cognitive search configured on own data and using chat completion API to ask prompts for questions on the data stored in Azure BLOB storage.

How can the prompt returned by chat completion API be verified and validated as the prompt does not return any of the confidence scores? Is there any alternative method to do this?

In addition is fine tuning of the gpt-3.5-turbo effective? Does it help better the responses on the data given in the BLOB storage? Please suggest and advise.

Azure AI Search
Azure AI Search
An Azure search service with built-in artificial intelligence capabilities that enrich information to help identify and explore relevant content at scale.
852 questions
Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
2,604 questions
{count} votes