Is there a parameter to get multiple replicates of an answer from Phi3?

Angelo D Ambrosio 0 Reputation points
2024-06-13T09:40:44.25+00:00

Hello,

I'm trying to use a Phi3 model via curl API. The "n" parameter, which on OpenAI models asks the model to generate n replicates of the answer doesn't work with the Phi models. Is there an alternative or it simply doesn't implement it?

I also tried to parallelize the querying, but it gave a 500 error on 5 parallel requests.

Thanks

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,609 questions
{count} votes

2 answers

Sort by: Most helpful
  1. Deleted

    This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.


    Comments have been turned off. Learn more

  2. Deleted

    This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.


    Comments have been turned off. Learn more