Could you share the model, version and region for repro'ing the case.
API version
I think issue might be with API version.
I could not find mention of 2023-05-15 API version in GA or preview rest API.
2024-10-01 and 2024-10-21 are latest GA version for Data plane and Control plane (Authoring and inference) respectively.
For Virtual network scenario
- If the OpenAI is secured with virtual network, we have to check the DNS resolution from VM in same virtual network or once connected with VPN gateways that routes back to virtual network. If it is not resolving, you might need to recreate the private endpoints or fix corrupt DNS records or virtual network links. If a Custom DNS server is in use. You might need to add all C-Records in host server as per your DNS records of your OpenAI resource.
nslookup <fqdninDNSrecords> -> private ip as mentioned in DNS record
Refernence for Troubleshooting DNS issues - https://learn.microsoft.com/en-us/azure/machine-learning/how-to-troubleshoot-secure-connection-workspace?view=azureml-api-2 - If you are trying to access the virtual network resource from public IPs, you might need to whitelist them
- Also, please whitelist the Azure OpenAI and other host URLs and ports in firewall and proxy if needed https://learn.microsoft.com/en-us/azure/ai-services/cognitive-services-virtual-networks?tabs=portal
But ideally, in case of virtual network authentication failures, it throws 403's but sometimes throws 404's too.
Status on 5th May
Customer was finally able to resolve the issue at his side after multiple modification in code
Thank you.