AdminCenter extension enable fails on Azure Local (West Europe): token retrieval from Arc identity/HIMDS → 400, WAC certificate retrieval blocked

Kopach, Vitalii 30 Reputation points
2025-10-01T11:26:22.9733333+00:00

Hi!

We’re unable to successfully deploy Windows Admin Center in Azure (AdminCenter extension) for our Azure Local (Azure Stack HCI) cluster. The extension package installs, but the Enable phase intermittently fails when it tries to obtain an access token from Azure Arc’s identity endpoint and then retrieve the TLS certificate for WAC.

Environment Details:

  • Azure Local Version: 2509 (Freshly installed)
  • Azure Connected Machine Agent (Arc Agent) Version: 1.56.03167.2465
  • AdminCenter Extension Versions Tested: 0.62.0.0 and 0.47.0.0
  • Microsoft Hybrid Connectivity: Registered
  • Windows Admin Center (WAC) Port: 6516 (Added to azcmagent incoming connections; local firewall allow rule created)
  • Egress: TCP port 443 open; no proxy configured (HTTPS_PROXY is not set)
  • Region: West Europe

Symptoms & logs

  • Reachability check succeeds:
    • TestWACAppServiceReachability: Successfully
  • Then token retrieval fails:
    • GetAccessTokenForArc: Failed to get access token from Azure Arc's identity endpoint
    • The remote server returned an error: (400) Bad Request.
  • Certificate retrieval then cannot proceed:
    • RetrieveCertificate: Retrieving certificate from key vault using app service (doesn’t complete)
[
    {
        "status":  {
                       "status":  "error",
                       "code":  553,
                       "name":  "InvokeEnableOperation",
                       "formattedMessage":  {
                                                "message":  "Executing Enable operation",
                                                "lang":  "en-US"
                                            },
                       "operation":  "InvokeEnableOperation",
                       "substatus":  [
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "SettingDnsRecords",
                                             "formattedMessage":  {
                                                                      "message":  "Creating/updating DNS records",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "GetDataFromMetadataService",
                                             "formattedMessage":  {
                                                                      "message":  "Getting data from Azure metadata service",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "GetInstanceMetadataForArc",
                                             "formattedMessage":  {
                                                                      "message":  "Retrieving the virtual machine instance metadata information",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "GettingWacPort",
                                             "formattedMessage":  {
                                                                      "message":  "Getting Windows Admin Centers configured port",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "GettingCSPFrameAncestors",
                                             "formattedMessage":  {
                                                                      "message":  "Getting Windows Admin Center configured CSP frame ancestors",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "UpdatingWindowsAdminCenterConfiguration",
                                             "formattedMessage":  {
                                                                      "message":  "Updating Windows Admin Center Configuration",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "StoppingWindowsAdminCenterService",
                                             "formattedMessage":  {
                                                                      "message":  "Stopping Windows Admin Center service",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "UpdatingInstallationTypeSettings",
                                             "formattedMessage":  {
                                                                      "message":  "Updating Installation type for Windows Admin Center",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "UpdatingCSPSettings",
                                             "formattedMessage":  {
                                                                      "message":  "Updating CSP Frame Ancestors for Windows Admin Center",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "UpdatingCORSSettings",
                                             "formattedMessage":  {
                                                                      "message":  "Updating CORS origins for Windows Admin Center",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "UpdatingPort",
                                             "formattedMessage":  {
                                                                      "message":  "Updating port for Windows Admin Center",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "UpdatingWebSocketValidationOverride",
                                             "formattedMessage":  {
                                                                      "message":  "Updating WebSocket validation override settings",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "UpdatingTokenAuthenticationEnabled",
                                             "formattedMessage":  {
                                                                      "message":  "Updating token authentication setting",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "UpdatingAutoUpdate",
                                             "formattedMessage":  {
                                                                      "message":  "Updating auto update setting",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "SettingProxy",
                                             "formattedMessage":  {
                                                                      "message":  "Updating proxy for Windows Admin Center",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "GettingWacPort",
                                             "formattedMessage":  {
                                                                      "message":  "Getting Windows Admin Centers configured port",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "UpdatingWindowsAdminCenterConfiguration",
                                             "formattedMessage":  {
                                                                      "message":  "Updating Windows Admin Center Configuration",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "GetDataFromMetadataService",
                                             "formattedMessage":  {
                                                                      "message":  "Getting data from Azure metadata service",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "GetInstanceMetadataForArc",
                                             "formattedMessage":  {
                                                                      "message":  "Retrieving the virtual machine instance metadata information",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "success",
                                             "code":  0,
                                             "name":  "TestWACAppServiceReachability",
                                             "formattedMessage":  {
                                                                      "message":  "Testing reachability of Application Web Service of Windows Admin Center",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "error",
                                             "code":  553,
                                             "name":  "GetAccessTokenForArc",
                                             "formattedMessage":  {
                                                                      "message":  "Failed to get access token from Azure Arc\u0027s identity endpoint",
                                                                      "lang":  "en-US"
                                                                  }
                                         },
                                         {
                                             "status":  "error",
                                             "code":  553,
                                             "name":  "RetrieveCertificate",
                                             "formattedMessage":  {
                                                                      "message":  "Retrieving certificate from key vault using app service",
                                                                      "lang":  "en-US"
                                                                  }
                                         }
                                     ]
                   },
        "timestampUTC":  "2025-10-01T10:03:14Z",
        "version":  "1.0"
    }
]
Azure Local
{count} votes

Answer accepted by question author
  1. Himanshu Shekhar 1,350 Reputation points Microsoft External Staff Moderator
    2025-10-01T12:43:08+00:00

    Hi Kopach, Vitalii

    Welcome to Microsoft Q&A Platform. Thank you for reaching out & hope you are doing well.

    Verify the Azure Connected Machine Agent status by first checking if the agent is properly connected and authenticated, especially if you are using a service principal for authentication. Review the necessary role assignments for Arc-enabled servers, ensuring they have "Azure Connected Machine Resource Manager" and "Reader" roles granted. Also, verify that the Arc Machine identity has appropriate permissions to access Key Vault. While TCP 443 connectivity is confirmed, it is essential to make sure the Arc agent can reach the internal metadata service endpoint on localhost:40342, as this internal communication is required for identity operations.

    If issues persist, try restarting the Azure Connected Machine Agent service on all cluster nodes to rule out intermittent problems. Finally, use the command azcmagent show on the Arc-enabled machine to confirm the proper registration status and verify the agent's connectivity and heartbeat with Azure

    Please be noted that the Engineering team has confirmed that this has been identified as an issue with the extension and it'll be fixed with the new version (0.66.0.0). The Engineering team is planning to roll out the fixed version by next week to be globally available.

    Regards

    Himanshu

    1 person found this answer helpful.
    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as 'Accepted' by the question author and 'Recommended' by moderators, which helps users know the answer solved the author's problem.