Azure AI - Add your data keep disconnected

Question

Azure AI - Add your data keep disconnected

Cathie 5

Has anyone encounter this issue with Azure Open AI add your own data? What happen for us is, the connection to Azure cognitive search disappear after few hours. e.g. below is when it is connected and it works ok. tomorrow when i logged back in, it will disappear and i have to add it again. Is it because this is still preview mode?

E User's image

VasaviLankipalle-MSFT 18,716 Reputation points Moderator

2023-08-03T21:11:05.88+00:00

Hello @Cathie , Thanks for using Microsoft Q&A Platform.

I hope you have followed these settings from this documentation: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data#azure-role-based-access-controls-azure-rbac

Please check the Azure OpenAI resource and other Azure cognitive search resource details well.
Cathie 5 Reputation points

2023-08-07T00:47:59.6333333+00:00

Hi Vasavi,

Thanks for getting back to me. Yes, the account is 'Owner' in IAM for this resource. As mentioned, i was able to add own dataset and for as long as it is connected, seems to be working.

~~However, the issue is, the next day or hours later when i jump into playground again, it disappear/disconnected. e.g. screen shot below.~~

EDIT: I managed to reproduce the issue. It has nothing to do with time.

Basically, the connection stays for as long as the browser session is there / not closed. As soon as the tab is closed, the connection is gone. Video explanation provided below:

https://www.loom.com/share/b8c6359bb23947cb920b5bfd8b490496
Cathie 5 Reputation points

2023-08-10T05:53:44.8266667+00:00

Thanks, i dont think we have ability to raise a support ticket. If you can help to raise one, that would be great.
VasaviLankipalle-MSFT 18,716 Reputation points Moderator

2023-08-10T20:47:45.5933333+00:00

Hello @Cathie , I have an update for you. Sorry for the delay.

The OpenAI studio is a development tool and environment that does not maintain state across sessions. If you want to use "on your data", you should configure the data elements and deploy the web app for use within your enterprise. Once that is done, your development tasks are complete, and the web app is deployed. When we leave the studio and come back, it will have no memory of your previous activities, nor will it retain any configurations you have created.

Therefore, whoever deploys the app should save the URL of the deployed app and can share it to use the deployed app. The studio does not retain that data.

I hope this helps.
Balazs Nemeth 10 Reputation points

2023-08-16T15:14:52.25+00:00

Can confirm, the deployed app stays. If you forgot the URL, you can check it in https://portal.azure.com/#home in the proper resource group you used.

Did it with:
Cathie 5 Reputation points

2023-08-17T05:27:14.0966667+00:00

Thanks. Yes i can also confirm that the settings seems to stay once deployed to a web app.
Balazs Nemeth 10 Reputation points

2023-08-22T15:20:19.8466667+00:00

Have you met with the issue, that after a few days the App Service Azure deployment (which you can do in the Azure Open AI Studio) is unable to find the correct answers?

1 answer

Your answer

VasaviLankipalle-MSFT 18,716 Reputation points Moderator

2023-08-03T21:11:05.88+00:00

Hello @Cathie , Thanks for using Microsoft Q&A Platform.

I hope you have followed these settings from this documentation: https://learn.microsoft.com/en-us/azure/ai-services/openai/concepts/use-your-data#azure-role-based-access-controls-azure-rbac

Please check the Azure OpenAI resource and other Azure cognitive search resource details well.
Cathie 5 Reputation points

2023-08-07T00:47:59.6333333+00:00

Hi Vasavi,

Thanks for getting back to me. Yes, the account is 'Owner' in IAM for this resource. As mentioned, i was able to add own dataset and for as long as it is connected, seems to be working.

~~However, the issue is, the next day or hours later when i jump into playground again, it disappear/disconnected. e.g. screen shot below.~~

EDIT: I managed to reproduce the issue. It has nothing to do with time.

Basically, the connection stays for as long as the browser session is there / not closed. As soon as the tab is closed, the connection is gone. Video explanation provided below:

https://www.loom.com/share/b8c6359bb23947cb920b5bfd8b490496
Cathie 5 Reputation points

2023-08-10T05:53:44.8266667+00:00

Thanks, i dont think we have ability to raise a support ticket. If you can help to raise one, that would be great.
VasaviLankipalle-MSFT 18,716 Reputation points Moderator

2023-08-10T20:47:45.5933333+00:00

Hello @Cathie , I have an update for you. Sorry for the delay.

The OpenAI studio is a development tool and environment that does not maintain state across sessions. If you want to use "on your data", you should configure the data elements and deploy the web app for use within your enterprise. Once that is done, your development tasks are complete, and the web app is deployed. When we leave the studio and come back, it will have no memory of your previous activities, nor will it retain any configurations you have created.

Therefore, whoever deploys the app should save the URL of the deployed app and can share it to use the deployed app. The studio does not retain that data.

I hope this helps.
Balazs Nemeth 10 Reputation points

2023-08-16T15:14:52.25+00:00

Can confirm, the deployed app stays. If you forgot the URL, you can check it in https://portal.azure.com/#home in the proper resource group you used.

Did it with:
Cathie 5 Reputation points

2023-08-17T05:27:14.0966667+00:00

Thanks. Yes i can also confirm that the settings seems to stay once deployed to a web app.
Balazs Nemeth 10 Reputation points

2023-08-22T15:20:19.8466667+00:00

Have you met with the issue, that after a few days the App Service Azure deployment (which you can do in the Azure Open AI Studio) is unable to find the correct answers?

Answer 1

Hello @Cathie , I really appreciate your efforts in sharing this detailed information.

Looks like this is a known behavior. The OpenAI studio is a development tool and environment that does not maintain state across sessions. If you want to use "on your data", you should configure the data elements and deploy the web app for use within your enterprise. Once that is done, your development tasks are complete, and the web app is deployed. When we leave the studio and come back, it will have no memory of your previous activities, nor will it retain any configurations you have created.

Therefore, whoever deploys the app should save the URL of the deployed app and can share it to use the deployed app. The studio does not retain that data.

I hope this helps.

Regards,
Vasavi

-Please kindly accept the answer and vote 'yes' if you feel helpful to support the community, thanks.

Share via

Azure AI - Add your data keep disconnected

1 answer

Your answer