Azure Open AI: The service is temporarily unable to process your request. Please try again later

Question

I am trying to create embeddings for PDFs using text-embedding-3-large embedding model and continuously getting this error: InternalServerError: Error code: 503 - {'error': {'code': 'InternalServerError', 'message': 'The service is temporarily unable to process your request. Please try again later.'}}

Package: Langchain.

I already have the maximum Rate limit (Tokens per minute): 700000 and I have deployed the model in 2 locations: East US and Canada East. Both are giving same error. It works for very small PDF files (2-3 pages) but fails for larger files. Also, it works when the chunk size provided is larger than 1024 for large files but fails for a smaller chunk size.

This doesn't looks like a transient failure. I am facing this issue for 3 days. Even after taking a break of 8-10 hours, it resulted in the same error.