OnnxRuntimeGenAIChatCompletionService Class

Definition

Namespace:: Microsoft.SemanticKernel.Connectors.Onnx

Assembly:: Microsoft.SemanticKernel.Connectors.Onnx.dll

Package:: Microsoft.SemanticKernel.Connectors.Onnx v1.45.0-alpha

Important

Some information relates to prerelease product that may be substantially modified before it’s released. Microsoft makes no warranties, express or implied, with respect to the information provided here.

Represents a chat completion service using OnnxRuntimeGenAI.

public sealed class OnnxRuntimeGenAIChatCompletionService : IDisposable, Microsoft.SemanticKernel.ChatCompletion.IChatCompletionService

type OnnxRuntimeGenAIChatCompletionService = class
    interface IChatCompletionService
    interface IAIService
    interface IDisposable

Public NotInheritable Class OnnxRuntimeGenAIChatCompletionService
Implements IChatCompletionService, IDisposable

Inheritance: Object
OnnxRuntimeGenAIChatCompletionService

Implements: IChatCompletionService IAIService IDisposable

Constructors

OnnxRuntimeGenAIChatCompletionService(String, String, ILoggerFactory, JsonSerializerOptions)

Initializes a new instance of the OnnxRuntimeGenAIChatCompletionService class.

Properties

Attributes

Gets the AI service attributes.

Methods

Dispose()	Performs application-defined tasks associated with freeing, releasing, or resetting unmanaged resources.
GetChatMessageContentsAsync(ChatHistory, PromptExecutionSettings, Kernel, CancellationToken)	Get chat multiple chat content choices for the prompt and settings.
GetStreamingChatMessageContentsAsync(ChatHistory, PromptExecutionSettings, Kernel, CancellationToken)	Get streaming chat contents for the chat history provided using the specified settings.

Extension Methods

AsChatClient(IChatCompletionService)	Creates an IChatClient for the specified IChatCompletionService.
GetChatMessageContentAsync(IChatCompletionService, ChatHistory, PromptExecutionSettings, Kernel, CancellationToken)	Get a single chat message content for the chat history and settings provided.
GetChatMessageContentAsync(IChatCompletionService, String, PromptExecutionSettings, Kernel, CancellationToken)	Get a single chat message content for the prompt and settings.
GetChatMessageContentsAsync(IChatCompletionService, String, PromptExecutionSettings, Kernel, CancellationToken)	Get chat multiple chat message content choices for the prompt and settings.
GetStreamingChatMessageContentsAsync(IChatCompletionService, String, PromptExecutionSettings, Kernel, CancellationToken)	Get streaming chat message contents for the chat history provided using the specified settings.
GetApiVersion(IAIService)	Gets the API version from `service`'s Attributes
GetEndpoint(IAIService)	Gets the endpoint from `service`'s Attributes.
GetModelId(IAIService)	Gets the model identifier from `service`'s Attributes.

Applies to

Share via