Create a Chatbot using Azure OpenAI and Azure Bot Service

Ziggy Zulueta 480 MVP

I would like to create a chatbot that uses Azure OpenAI for its to answer questions using my own data. I would then like to use Azure Bot Service so that I can use the bot for many channels. Is this possible?

VasaviLankipalle-MSFT 14,831 Reputation points

2023-08-16T16:42:17.1866667+00:00

Hello @Ziggy Zulueta , we received your feedback that the answer provided on the thread was not helpful.

Did you get a chance to check my response? Also are you able to resolve this issue?
Ziggy Zulueta 480 Reputation points MVP

2023-08-16T16:46:15.11+00:00

Yes i was able to resolve it via the answer I provided below

Accepted answer

VasaviLankipalle-MSFT 14,831 Reputation points

2023-08-16T16:55:38.4833333+00:00
Hello @Ziggy Zulueta , I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to "Accept " the answer.

Issue: Create a Chatbot to use Azure OpenAI in order to train the bot and then use Azure Bot Service for it to be used in multiple channels.

Solution:

Go to framework composer and create the bot. https://learn.microsoft.com/en-us/composer/install-composer?tabs=windows

In the composer, you can call an HTTP Request to call the Open AI service and get the response.

The tricky part is to add logic in the composer specifically on adding the chat history in the messages array:

If user is new, then initialize the messages array to system role and initial user role

We provide an option for user to reset the whole conversation so them messages array is initialized

while the user keeps on chatting the messages array gets added

in all cases above the messages array is sent to the open ai request

Once the logic is completed and the Open AI HTTP Request and handling is done properly in the composer, then you can eventually publish the bot in Azure bot service

from there you can use the chatbot in multiple channels

Thank you again for your time and patience throughout this issue.

Regards,
Vasavi
Please remember to "Accept Answer" if any answer/reply helped, so that others in the community facing similar issues can easily find the solution.
Please sign in to rate this answer.

2 people found this answer helpful.

0 comments No comments
Sign in to comment

3 additional answers

Ziggy Zulueta 480 MVP

I was able to fulfill my requirement by doing the following:

Go to framework composer and create the bot.
In the composer, you can call an HTTP Request to call the Open AI service and get the response.
The tricky part is to add logic in the composer specifically on adding the chat history in the messages array:
1. If user is new, then initialize the messages array to system role and initial user role
  1. We provide an option for user to reset the whole conversation so them messages array is initialized
    1. while the user keeps on chatting the messages array gets added
      1. in all cases above the messages array is sent to the open ai request
Once the logic is completed and the Open AI HTTP Request and handling is done properly in the composer, then you can eventually publish the bot in Azure bot service
from there you can use the chatbot in multiple channels

Akshay Deshmukh 0 Reputation points

2023-08-30T05:08:09.4166667+00:00

Hi @Ziggy Zulueta . Good day. i am looking for a similar problem statement via Azure bot service. If you have been able to manage it already, is it possible to share the reusable code so that we can refer? Many thanks and appreciate your support!
Akshay Deshmukh 0 Reputation points

2023-09-01T13:09:30.21+00:00

Hi @Ziggy Zulueta good day If you were able to solve the problem do you have some reusable code for the same?

Ziggy Zulueta 480 MVP

{
  "$kind": "Microsoft.AdaptiveDialog",
  "$designer": {
    "name": "AzureOpenAI",
    "description": "",
    "id": "A79tBe"
  },
  "autoEndDialog": true,
  "defaultResultProperty": "dialog.result",
  "triggers": [
    {
      "$kind": "Microsoft.OnConversationUpdateActivity",
      "$designer": {
        "id": "376720",
        "comment": "This trigger runs when a conversation update activity is sent to the bot. This indicates a user or bot being added or removed from a conversation."
      },
      "actions": [
        {
          "$kind": "Microsoft.Foreach",
          "$designer": {
            "id": "518944",
            "name": "Loop: for each item",
            "comment": "For each member added to the conversation."
          },
          "itemsProperty": "turn.Activity.membersAdded",
          "actions": [
            {
              "$kind": "Microsoft.IfCondition",
              "$designer": {
                "id": "641773",
                "name": "Branch: if/else",
                "comment": "Checks that that member added ID does not match the bot ID. This prevents the greeting message from being sent when the bot is added to a conversation."
              },
              "condition": "=string(dialog.foreach.value.id) != string(turn.Activity.Recipient.id)",
              "actions": [
                {
                  "$kind": "Microsoft.SetProperty",
                  "$designer": {
                    "id": "olhRJ7"
                  },
                  "property": "user.IsNew",
                  "value": true
                },
                {
                  "$kind": "Microsoft.SendActivity",
                  "$designer": {
                    "id": "859266",
                    "name": "Send a response"
                  },
                  "activity": "${SendActivity_Greeting()}"
                }
              ]
            }
          ]
        }
      ]
    },
    {
      "$kind": "Microsoft.OnUnknownIntent",
      "$designer": {
        "id": "mb2n1u",
        "comment": "This trigger fires when an incoming activity is not handled by any other trigger."
      },
      "actions": [
        {
          "$kind": "Microsoft.IfCondition",
          "$designer": {
            "id": "H7x49i"
          },
          "condition": "=user.IsNew",
          "actions": [
            {
              "$kind": "Microsoft.SetProperty",
              "$designer": {
                "id": "J7ljw2"
              },
              "property": "user.IsNew",
              "value": false
            },
            {
              "$kind": "Microsoft.SetProperty",
              "$designer": {
                "id": "fIejiC"
              },
              "property": "user.inputData",
              "value": [
                {
                  "role": "system",
                  "content": "You are an AI assistant that helps people find information."
                },
                {
                  "role": "user",
                  "content": "${turn.activity.text}"
                }
              ]
            }
          ],
          "elseActions": [
            {
              "$kind": "Microsoft.SetProperty",
              "$designer": {
                "id": "u5QcEO"
              },
              "property": "turn.newInput",
              "value": [
                {
                  "role": "user",
                  "content": "${turn.activity.text}"
                }
              ]
            },
            {
              "$kind": "Microsoft.IfCondition",
              "$designer": {
                "id": "Xyltyt"
              },
              "condition": "=turn.activity.text == \"new\"",
              "actions": [
                {
                  "$kind": "Microsoft.SetProperty",
                  "$designer": {
                    "id": "j55pTK"
                  },
                  "property": "user.inputData",
                  "value": [
                    {
                      "role": "system",
                      "content": "You are an AI assistant that helps people find information."
                    },
                    {
                      "role": "user",
                      "content": "hi"
                    }
                  ]
                }
              ],
              "elseActions": [
                {
                  "$kind": "Microsoft.SetProperty",
                  "$designer": {
                    "id": "r1a21A"
                  },
                  "property": "user.inputData",
                  "value": "=union(user.inputData, turn.newInput)"
                }
              ]
            }
          ]
        },
        {
          "$kind": "Microsoft.HttpRequest",
          "$designer": {
            "id": "WO0jxu"
          },
          "resultProperty": "turn.results",
          "method": "POST",
          "url": "${settings.OpenAI.Endpoint}",
          "body": {
            "messages": "=user.inputData",
            "max_tokens": 800,
            "temperature": 0.55,
            "frequency_penalty": 0,
            "presence_penalty": 0,
            "top_p": 0.91,
            "stop": null,
            "dataSources": [
              {
                "type": "AzureCognitiveSearch",
                "parameters": {
                  "endpoint": "${settings.AzureCognitiveSearch.Endpoint}",
                  "key": "${settings.AzureCognitiveSearch.Key}",
                  "indexName": "${settings.AzureCognitiveSearch.Indexname}"
                }
              }
            ]
          },
          "headers": {
            "api-key": "${settings.OpenAI.APIKey}",
            "Content-Type": "application/json"
          },
          "contentType": "application/json",
          "responseType": "json"
        },
        {
          "$kind": "Microsoft.SendActivity",
          "$designer": {
            "id": "kckUH8"
          },
          "activity": "${SendActivity_kckUH8()}"
        },
        {
          "$kind": "Microsoft.SetProperty",
          "$designer": {
            "id": "xUcicB"
          },
          "property": "turn.outputData",
          "value": [
            {
              "role": "assistant",
              "content": "=turn.results.content.choices[0].messages[1].content"
            }
          ]
        },
        {
          "$kind": "Microsoft.SetProperty",
          "$designer": {
            "id": "S06ZNR"
          },
          "property": "user.inputData",
          "value": "=union(user.inputData, turn.outputData)"
        }
      ]
    }
  ],
  "generator": "AzureOpenAI.lg",
  "id": "AzureOpenAI",
  "recognizer": "AzureOpenAI.lu.qna"
}

Ziggy Zulueta 480 Reputation points MVP

2023-09-03T15:40:50.06+00:00

you can try copying and pasting this in the Azure Bot Framework composer. You need to create an Unknown Intent and paste this there. The piece of code keeps on adding chat messages given that OpenAI needs previous messages

Erdal Akkoc 0

Hi @Ziggy Zulueta , thank you for sharing your code with us. After using your code and testing it on the web chat, i get this answer by the bot:

AzureOpenAIGPT.en-us.lg:[Error] inline content: [__temp__e4036cdb50e245e29b8f3c0245ff1608]Error occurred when parsing expression ‘SendActivity_kckUH8()’. SendActivity_kckUH8 does not have an evaluator, it’s not a built-in function or a custom function., AzureOpenAIGPT.en-us.lg:[Error] inline content: [__temp__25ec760019f14f71a7d7a13b094d8598]Error occurred when parsing expression ‘SendActivity_kckUH8()’. SendActivity_kckUH8 does not have an evaluator, it’s not a built-in function or a custom function.

Can you help me please? I created an Azure Bot for creating SQL queries and now i want to add GPT3.5 to my bot to understand natural language for creating queries.

John Sanders 176 Reputation points Microsoft Employee

2023-08-15T20:09:46.06+00:00

I would suggest trying to use the preview "on your data" feature: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data
Please sign in to rate this answer.
Ziggy Zulueta 480 Reputation points MVP

2023-08-16T16:38:02.4266667+00:00

I appreciate the answer but it does not fulfill the requirement. I want the Chatbot to use Azure OpenAI in order to train the bot and then use Azure Bot Service for it to be used in multiple channels.

i was able to fullfill my requirement by doing the following in the answer i posted.
Sign in to comment
VasaviLankipalle-MSFT 14,831 Reputation points

2023-08-15T21:52:33.3866667+00:00

Hello @Ziggy Zulueta , Thanks for using Microsoft Q&A Platform.

Yes, you can use the Azure OpenAI and then Azure Bot Service. As mentioned by John, try Azure OpenAI on your data (preview) feature.

Please go through this documentation to learn how to deploy your model to Power Virtual Agents directly from Azure OpenAI studio: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data#using-power-virtual-agents

I hope this helps.

Regards,
Vasavi
Please sign in to rate this answer.
Saloni 0 Reputation points

2023-10-14T05:57:08.7333333+00:00

I don't have the option of deploying it to pva inspite of the East US location
Sign in to comment

Share via

Create a Chatbot using Azure OpenAI and Azure Bot Service

3 additional answers