ASSISTANTS API: Where are persistent resources stored?

Question

When interacting with the Assistants Api, some persistent resources are created, namely: Assistants, Threads and Messages. All have an unique ID and the API exposes methods/endpoints to retrieve these resources.

I can't find anywhere in the documentation an explanation of this persistency:

1. where is the data stored?
2. for how long?
3. is there a cost associated with this?
4. is gdpr compliant?

Answer 1

Lorenzo Larghi Greetings & Welcome to Microsoft Q&A forum!

Please see below answers to your queries.

where is the data stored?

There are two types of data stored in the Assistants API:

• Stateful entities: Threads, messages, and runs created during Assistants use.
• Files: Uploaded during Assistants setup or as part of a message.

Data is stored in a secure, Microsoft-managed storage account that is logically separated.

for how long?

All used data persists in this system unless you explicitly delete this data. Use the delete function with the thread ID of the thread you want to delete. Clearing the Run in the Assistants Playground does not delete threads, however deleting them using delete function will not list them in the thread page.

is there a cost associated with this?

• Inference cost (input and output) of the base model you're using for each Assistant (for example gpt-4-0125). If you've created multiple Assistants, you will be charged for the base model attached to each Assistant.
• If you've enabled the Code Interpreter tool. For example if your assistant calls Code Interpreter simultaneously in two different threads, this would create two Code Interpreter sessions, each of which would be charged. Each session is active by default for one hour, which means that you would only pay this fee once if your user keeps giving instructions to Code Interpreter in the same thread for up to one hour.
• File search is currently not billed.

For more information, see the pricing page.

is gdpr compliant?

AFAIK, The Assistant API adheres to relevant data protection regulations, such as GDPR and CCPA, to ensure that user data is handled responsibly and in compliance with applicable laws.

Please check Microsoft Products and Services Data Protection Addendum, which governs data processing by the Azure OpenAI Service except as otherwise provided in the applicable Product Terms and Microsoft Azure Legal Information

Also, see Data, privacy, and security for Azure OpenAI Service , General Data Protection Regulation Summary and Protecting privacy in Microsoft Azure: GDPR, Azure Policy Updates for more information.

Do let me know if that helps or have any other queries.

If the response helped, please do click Accept Answer and Yes for was this answer helpful.

Doing so would help other community members with similar issue identify the solution. I highly appreciate your contribution to the community.