AMA extension creating huge ExtensionHealth log files

Question

Hi All,

 

We have observed, AMA extension creating extensionhealth log files every few minutes which is causing storage issues on the servers. 

 

Errors in the files:

[QueryIMDSEndpoint] ErrorCode:1602 ERROR: HTTP call to IMDS failed. HTTP code: 429; Reason: Too Many Requests
[QueryIMDSEndpoint] ErrorCode:1602 ERROR: HTTP call to IMDS failed. HTTP code: 429; Reason: Too Many Requests
[QueryIMDSEndpoint] ErrorCode:1602 ERROR: HTTP call to IMDS failed. HTTP code: 503; Reason: Service Unavailable

[SetImdsEnvironmentVariable] ErrorCode:429 WARN: Failed to query IMDS information from Arc IMDS. Error: 429, retried 983011020 times, scheduling next retries.

Answer 1

Interesting. Please share when you find the solution. I recommend verifying connectivity.

Start with the check command: https://learn.microsoft.com/en-us/azure/azure-arc/servers/manage-agent#check

https://learn.microsoft.com/en-us/azure/cloud-adoption-framework/scenarios/hybrid/arc-enabled-servers/eslz-arc-servers-connectivity
https://learn.microsoft.com/en-us/azure/azure-arc/servers/troubleshoot-agent-onboard

Answer 2

Hi @shashidhar joliholi

Your error could be more aligned to Azure IMDS rate limiting. You need to determine what's causing the increased requests and reduce them to 5 req/sec per VM.