Share via

Azure Storage Custom File structure implementation problems for AzureOpenAI Custom Data

Ahmed Salman IN 16 Reputation points
2023-09-24T14:17:37.9633333+00:00

Hi guys,

I want to add data in a structured way for it to be accessed by the #AzureOpenAI service. The data is local community data, comprising 4 levels starting with the area, which then has multiple houses, and then each of the houses has multiple floors, and multiple rooms on each floor, and then data for items in each room. The current file structure is as follows Area -> House -> Floor -> Room.

The problem is Azure Open AI currently detects the data irrespective of any folder barriers. I want Azure Open AI to detect files based on folder barriers, so I can deploy multiple models based on each need. How should I organize this in Azure data storage so it can accessed by AOI in the correct order? My understanding is that as the Area is the top-level data that comprises multiple data inside it, it should be a container.

  • Should I create a blob storage or a container for this?
  • Can the later steps be stored as a regular folder and files inside the respective folder?

As these data will be used for Chatgpt, How do I make sure Chatgpt only accesses a specific folder and the files inside it?

I may have mixed my questions, as a newbie to Azure. But I think I made my objectives clear. Please suggest methods to implement this...

0 comments No comments

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.