Save validation completion results

Question

Save validation completion results

Michelle-0463 20

When I train a custom model with a training and validation dataset I am able to download the results.csv file to see the binary classification metrics across each epoch. Is there a way to also save the completions that were used to compute the final metrics? Right now the only way I can get the completions is by deploying the model and then calling that model again with each of the examples in my validation dataset. Is there a better, more cost effective way of doing this during the initial training?

Rohit Mungi 49,131 Reputation points Microsoft Employee Moderator

2023-08-17T08:47:03.66+00:00

@Michelle-0463 Are you talking about the results file that is mentioned in this section after creating a customized model?

I do not see an option to download the completions that are used during training or testing with the REST API to GET finetuning results too.
Michelle-0463 20 Reputation points

2023-08-17T11:12:43.5433333+00:00

Ok thanks for confirming @Rohit Mungi that there is no way to download the completions as part of the training. So the only way to get the completions, for that fine-tuned model on the validation dataset is to deploy the model and rerun all the examples through?
Rohit Mungi 49,131 Reputation points Microsoft Employee Moderator

2023-09-02T14:13:33.4766667+00:00

@Michelle-0463 Yes, that is right.