Is there a parameter to get multiple replicates of an answer from Phi3?
Hello,
I'm trying to use a Phi3 model via curl API. The "n" parameter, which on OpenAI models asks the model to generate n replicates of the answer doesn't work with the Phi models. Is there an alternative or it simply doesn't implement it?
I also tried to parallelize the querying, but it gave a 500 error on 5 parallel requests.
Thanks
2 answers
Sort by: Most helpful
-
Deleted
This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Comments have been turned off. Learn more
-
Deleted
This answer has been deleted due to a violation of our Code of Conduct. The answer was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.
Comments have been turned off. Learn more