Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
3,941 questions
Save validation completion results
![](data:image/svg+xml, %3Csvg xmlns='http://www.w3.org/2000/svg' height='64' class='font-weight-bold' style='font: 600 30.11764705882353px "SegoeUI", Arial' width='64'%3E%3Ccircle fill='hsl(246.4, 37%, 33%)' cx='32' cy='32' r='32' /%3E%3Ctext x='50%25' y='55%25' dominant-baseline='middle' text-anchor='middle' fill='%23FFF' %3EM0%3C/text%3E%3C/svg%3E)
Michelle-0463
20
Reputation points
When I train a custom model with a training and validation dataset I am able to download the results.csv file to see the binary classification metrics across each epoch. Is there a way to also save the completions that were used to compute the final metrics? Right now the only way I can get the completions is by deploying the model and then calling that model again with each of the examples in my validation dataset. Is there a better, more cost effective way of doing this during the initial training?
Azure OpenAI Service
{count} votes
-
romungi-MSFT 48,811 Reputation points Microsoft Employee2023-08-17T08:47:03.66+00:00 @Michelle-0463 Are you talking about the results file that is mentioned in this section after creating a customized model?
I do not see an option to download the completions that are used during training or testing with the REST API to GET finetuning results too.
-
Michelle-0463 20 Reputation points
2023-08-17T11:12:43.5433333+00:00 Ok thanks for confirming @romungi-MSFT that there is no way to download the completions as part of the training. So the only way to get the completions, for that fine-tuned model on the validation dataset is to deploy the model and rerun all the examples through?
-
romungi-MSFT 48,811 Reputation points Microsoft Employee
2023-09-02T14:13:33.4766667+00:00 @Michelle-0463 Yes, that is right.
Sign in to comment
Sign in to answer