Update dataset in AI Studio

misc981 36 Reputation points
2024-06-18T05:12:24.1666667+00:00

We want to leverage chatgpt/generative AI to produce responses based on an faq file. No model training/fine-tuning involved. Tested using copilot/generative AI and results were not satisfactory. Results seen in AI Studio using a chatgpt 3.5 deployment have been encouraging (own dataset/file upload)

The faq file in question will be updated on adhoc basis.

How can the dataset in AI Studio be updated with future faq updates?

As far as I can tell, there is no way to delete existing data, and only option is to upload the new (updated) faq and set this new dataset as the data source. Currently on trial subscription. If this is the only option, concerned if there is any cap on number of files/datasets that can be uploaded/maintained.

Azure AI services
Azure AI services
A group of Azure services, SDKs, and APIs designed to make apps more intelligent, engaging, and discoverable.
2,642 questions
0 comments No comments
{count} votes

Accepted answer
  1. AshokPeddakotla-MSFT 30,406 Reputation points
    2024-06-18T11:16:31.1+00:00

    misc981 Greetings & Welcome to Microsoft Q&A forum!

    Your understanding is correct regarding data deletion.

    Data deletion is not supported. Data is immutable in AI Studio. Once you create a data version, it can't be modified or deleted. This immutability provides a level of protection when working in a team that creates production workloads.

    One thing you could try is when creating a data source with Blob, you can select the Indexer schedule. See Create an index from the Indexes tab for more details.

    Also, see How to add and manage data in your Azure AI Studio project if it helps.

    Do let me know if you have any further queries.

    0 comments No comments

1 additional answer

Sort by: Most helpful
  1. Amira Bedhiafi 19,946 Reputation points
    2024-06-18T12:49:44.6966667+00:00

    Data deletion is not supported. Data is immutable in AI Studio. Once you create a data version, it can't be modified or deleted. This immutability provides a level of protection when working in a team that creates production workloads.

    Every time there is an update to your FAQ, prepare the new version of your FAQ file and upload the new FAQ file to AI Studio.

    After uploading the new FAQ file, set it as the primary data source for generating responses.

    You can archive all versions of a data or a specific version of it.

    https://learn.microsoft.com/en-us/azure/ai-studio/how-to/data-add#archive-data

    0 comments No comments