Share via

onnx_gen_ai_settings Module

Classes

OnnxGenAISettings

Onnx Gen AI model settings.

The settings are first loaded from environment variables with the prefix '>>ONNX_GEN_AI_<<'. If the environment variables are not found, the settings can be loaded from a .env file with the encoding 'utf-8'. If the settings are not found in the .env file, the settings are ignored; however, validation will fail alerting that the settings are missing.

Optional settings for prefix '>>ONNX_GEN_AI_<<' are:

  • chat_model_folder: Path to the Onnx chat model folder (ENV: ONNX_GEN_AI_CHAT_MODEL_FOLDER).
  • text_model_folder: Path to the Onnx text model folder (ENV: ONNX_GEN_AI_TEXT_MODEL_FOLDER).