File Handling in Azure OpenAI Assistant API

AdityaSa 801 Reputation points
2024-02-19T16:37:16.4933333+00:00

How is thread data handled and where is it stored in the state fullness of the Assistant API? Additionally, what are the security considerations for uploading files, such as where are they saved and under what permissions?

Azure OpenAI Service
Azure OpenAI Service
An Azure service that provides access to OpenAI’s GPT-3 models with enterprise capabilities.
4,081 questions
0 comments No comments
{count} votes

2 answers

Sort by: Most helpful
  1. Ramr-msft 17,826 Reputation points
    2024-02-19T16:47:01.65+00:00

    Thanks for the question, Files can be uploaded via Studio, or programmatically. The file_ids parameter is required to give tools like code_interpreter access to files. When using the File upload endpoint, you must have the purpose set to assistants to be used with the Assistants API.

    While the Assistant API maintains conversation context to provide more coherent responses, it doesn't store user data permanently. Instead, it retains context during the active conversation session to generate relevant responses.Thread data, including conversation history and context, is stored temporarily in memory during the active session. Once the session ends or times out, this data is purged from memory to ensure user privacy and data security.All data transmission between the user's device and the Assistant API is encrypted using industry-standard encryption protocols (e.g., HTTPS) to protect against unauthorized access or interception.

    The Assistant API adheres to relevant data protection regulations, such as GDPR and CCPA, to ensure that user data is handled responsibly and in compliance with applicable laws. Access to thread data is restricted to authorized personnel only, and stringent access controls are in place to prevent unauthorized access or misuse. https://learn.microsoft.com/en-us/azure/ai-services/openai/how-to/assistant#supported-file-types

    1 person found this answer helpful.
    0 comments No comments

  2. Charlie Wei 3,335 Reputation points
    2024-02-19T17:26:20.74+00:00

    Hello,

    During my research, I noticed that the Azure OpenAI documentation on Microsoft Learn does not mention file access policies. However, OpenAI's documentation does address certain data usage policies. Regrettably, as far as I am aware, the actual storage locations of the data remain a black box, and I am looking forward to more transparency in this area.

    Best regards,
    Charlie


    If you find my response helpful, please consider accepting this answer and voting 'yes' to support the community. Thank you!

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.