A set of technologies in .NET for building web applications and web services. Miscellaneous topics that do not fit into specific categories.
Change Kernel endpoint during failover in the same instance (Singleton GenAIService)
Hello,
I am trying to use a different endpoint during failover to another region's Azure OpenAI Service and don't see a way to change it directly from kernel object. I am trying to use the same kernel object reference, so the returned kernel object after GetChatMessageContentAsync() from ChatCompletionService has kernel data.
From what I can tell, we definitely need another kernel instance to failover as I don't see a way to only change the kernel endpoint and using singleton might be tough, and the code should check for which endpoint is active in the next request.
Is there a way I can move forward in this situation?
Thanks.