Azure AI Search native soft delete doesn't work when chunk skill added.

Question

I have ADLS storage with files and AI Search indexer with skillset of chunking. Everithing is working good except the native deletion mechanism. When I delete a file from the ADLS and run the indexer, I see that indexer recognize the deleted file, but actually file is not deleted.
In the indexer I see an error: Cannot iterate over non-array '/document/pages'.
As far as I understand, the deletion doesn't happen because the document key field has a suffix pages_0, pages_1, etc.

So, the indexer doesn't find the deleted file key field and can't remove it. How can I fix it, delete document and/or its chunks?

Answer 1

@Cherny, Igor Thanks for clarification! I discussed this internally and came out- this might be a transient error and the chunks may be getting deleted in the next indexer run.

We recommend keeping an indexer on a schedule for any transient errors to be fixed in the next run: Indexer errors and warnings - Azure AI Search | Microsoft Learn.

If you have the indexer running on a schedule and the file is not deleted in the next run(s), suggest you to create support ticket for deeper understanding if this is something we need to fix from the product side.

Having said that reached you privately.

Hope this helps.