How can I create a datasource using a wildcard for blob folder property?

Question

How can I create a datasource using a wildcard for blob folder property?

Gavris Vancea 5

Hello,
I am trying to integrate an Azure Datalake Gen 2 with Azure AI Search. The directory structure looks like this: docs/{entity_id}/{type}/file.pdf. I want to create an indexer that index only the files from the directories: docs/{entity_id}/basic.
I have already tried to create a datasource in Azure AI Search with a query(for the directory) which uses wildcard for the entity_id but it didn't work.

What could be the best approach for this kind of structure?

If the wildcards are not allowed, how can we workaround it?

Laxman Reddy Revuri 5,395 Reputation points Microsoft External Staff Moderator

2024-10-21T09:11:52.1733333+00:00

Hi @Gavris Vancea
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Laxman Reddy Revuri 5,395 Reputation points Microsoft External Staff Moderator

2024-10-22T14:41:37.22+00:00

Hi @Gavris Vancea
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

1 answer

Your answer

Laxman Reddy Revuri 5,395 Reputation points Microsoft External Staff Moderator

2024-10-21T09:11:52.1733333+00:00

Hi @Gavris Vancea
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.
Laxman Reddy Revuri 5,395 Reputation points Microsoft External Staff Moderator

2024-10-22T14:41:37.22+00:00

Hi @Gavris Vancea
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond with more details and we will try to help.

Answer 1

Hi @Gavris Vancea
Thanks for the question and using MS Q&A platform.
Connect the key information from your data source to the fields in your search index, including the file content and any related metadata.
Once your indexer is set up, run it to start indexing the files from the specified folders.
After running the indexer, review your search index to ensure the correct documents were added. Also, monitor the indexer for any errors or problems.
Index data from Azure Data Lake Storage Gen2
Azure Data Lake Storage Gen2 indexer - Azure AI Search | Microsoft Learn
Simple query syntax - Azure AI Search | Microsoft Learn
Partial terms, patterns, and special characters - Azure AI Search | Microsoft Learn
I hope this information is helpful. If you have any further questions, please don't hesitate to reach out.
If the answer is helpful, please click "Accept Answer" and kindly upvote it.

Share via

How can I create a datasource using a wildcard for blob folder property?

1 answer

Your answer