This ADLS Gen2 indexer maps the property 'metadata_storage_path' to the index key, which may not reindex documents if directories are renamed.

Question

With respect to Cognitive Search, the following warning message appears after each indexer run.

`
This ADLS Gen2 indexer maps the property 'metadata_storage_path' to the index key, which may not reindex documents if directories are renamed. 

Update the 'LastModified' timestamps for all the blobs in the directory to ensure they get reindexed.

`

The above message indicates that when the ADLS directory name is changed, the changed
Does this mean that only the timestamps of the BLOBs under the directory need to be updated and the indexer re-run?

Please let me know how to deal with the above message.

Answer 1

Hi @test29998411 ,

yes, that is correct. When using ADLS Gen2, changing document keys or directory names and paths breaks the internal tracking information used by indexers to know which content was indexed, and when it was last indexed. This is why you will need to update the LastModified timestamp for all the blobs in the directory.

according to this Azure doc:
" ADLS Gen2 allows directories to be renamed. When a directory is renamed, the timestamps for the blobs in that directory do not get updated. As a result, the indexer will not re-index those blobs. If you need the blobs in a directory to be reindexed after a directory rename because they now have new URLs, you will need to update the LastModified timestamp for all the blobs in the directory so that the indexer knows to re-index them during a future run. The virtual directories in Azure Blob Storage cannot be changed, so they do not have this issue. "

Hope that helps. Please let us know if you have further questions

Thanks,
Grace

------------------------------------------------------------------------------------------------------------------------------

--If the reply is helpful, please Upvote and Accept as answer--