Hello! I have created an Azure Bot using Bot Framework Composer and published in Azure Portal. However, I want to use my own data and integrate with the Azure OpenAI to generate AI responses. How can I do that and deploy it on my website?

Question

1. What are the best practices for securely integrating Azure OpenAI with my Azure Bot?
2. How can I handle API calls to Azure OpenAI within the Bot Framework Composer?
3. What are the recommended steps to deploy this bot on my website using an embed link?
4. Are there any specific configurations or considerations I should be aware of to ensure smooth integration and deployment?

Answer 1

Hello @Sasank Anipeddi

Welcome to Microsoft QnA!

To answer your Questions :

Azure OpenAI Setup:

Ensure you have access to the Azure OpenAI service and have deployed a suitable model

Use KeyVault to Store your Endpoint and Key

Bot Framework Composer Integration:

1. Use the "Send an HTTP request" action in your bot's dialogs.
2. Configure the action to call the Azure OpenAI API endpoint (https://<your-resource-name>.openai.azure.com/openai/deployments/<your-deployment-name>/completions?api-version=2023-05-15).
3. Include the API key in the request headers.
4. Send the user's message as the prompt and receive the generated response from Azure OpenAI.

Link:

https://learn.microsoft.com/en-us/composer/templates/enterprise-assistant-overview

Best Practices for Secure Integration:

API Key Management:

• Store your Azure OpenAI API key in a secure location (e.g., Azure Key Vault).
• Never expose the API key directly in client-side code.
• Consider using managed identities or other authentication mechanisms to access Azure OpenAI.
• Rate Limiting:
  • Implement rate limiting to prevent excessive API calls and ensure fair usage.
• Monitoring and Logging:
  • Monitor API usage, errors, and responses to identify potential issues and track performance.

These are some of the most important details for such a Journey !

Links:

https://learn.microsoft.com/en-us/composer/

https://learn.microsoft.com/en-us/composer/how-to-use-oauth?tabs=v2x

https://learn.microsoft.com/en-us/composer/how-to-host-composer

--

I hope this helps!

Kindly mark the answer as Accepted and Upvote in case it helped!

Regards