Azure Face Detection does not retrieve all images in a large iteration

Question

Hi everyone,

I am using Azure Face detection service and the issue I am encountering is related to iteration larger than 1000. Because I have a large number of images to retrieve information, I need to iterate them. However, whenever I iterate a large number, let's say 1000 images, I recognized that only a few of the images were retrieved of information. There is no error message shown.

How can I know it didn't read all images? When I manually input some of the images that weren't retrieved through a previous iteration, this time they were retrieved!

FYI, I haven't reached the transaction limit for my account. I'm also aware of the rate limit - 20 calls per minute, that's why I set 10 seconds after each call.

I will appreciate it if anyone has any thought or suggestion to solve this problem. Thank you so much!!

Answer 1

Hi @romungi-MSFT - Thank you for your comment. Yes I did recorded the data in a json file after making sure a whole iteration were successfully retrieved.

Please find as below the screenshot of my code. I'm sorry I cannot copy paste the whole text; whenever I try to submit my comment with the text, it shows the error as "WAF v2 has determined your request exceeded the normal web request and has blocked your request."

On a side note, I use the exception for the above errors to avoid invalid images