Azure Arc Upgrade Failed - ImageNotFound

Question

Azure Arc Upgrade Failed - ImageNotFound

AZR-GP 20

Running manual upgrade of Azure Arc Resource Bridge from local powershell but it fails with an error "ImageNotFound". The console log shows the following:-

2025-01-29T17:01:54Z INFO Uploading template to the datastore... Complete

2025-01-29T17:01:55Z INFO ImageProvision: VSphere: Template Deployed. Creating snapshot and finishing aftersteps....

2025-01-29T17:01:55Z INFO ImageProvision: VSphere: Image Provision is successful

Appliance configuration was prepared successfully

Starting the upgrade

Started upgrade, waiting for the operation to complete

(ImagePreflightCheckErrorOnPrem) Upgrade Operation Failed with error: "{\n "code": "ImagePreflightCheckError",\n "message": "preflight checks failed: ImageNotFound"\n }"

Code: ImagePreflightCheckErrorOnPrem

Message: Upgrade Operation Failed with error: "{\n "code": "ImagePreflightCheckError",\n "message": "preflight checks failed: ImageNotFound"\n }"

Any ideas about to debug and resolve this?

Thanks

Naveena Patlolla 9,660 Reputation points Microsoft External Staff Moderator

2025-01-30T14:18:58.9933333+00:00
Hi AZR-Paterson, Gerry,

Welcome to Microsoft Q&A Forum, thank you for posting your query here!

Run a Preflight Check Before Upgrade

az login az account set --subscription "xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx" az connectedmachine upgrade preflight-check --name <resource-bridge-name> --resource-group <resource-group> az connectedmachine show --name <resource-bridge-name> --resource-group <resource-group>

Run the following command to check if Azure Arc Resource Bridge is properly deployed

az acr repository list --name <your-acr-name>

If the image is missing, re-download it manually:

docker pull mcr.microsoft.com/arc/azurearcbuilder:<version>

Try Upgrade with Debug mode

az arcappliance upgrade <resource-bridge-name> --config-file <path-to-config-file> --debug

Check any logs reported and Check Logs for Detailed Errors

Review the logs for more details about the failure. Logs are typically located in:

Linux: var/log/arcbridge

Windows: C:\ProgramData\AzureConnectedMachineAgent\Log

let us know if you have any further queries. I’m happy to assist you further.
Naveena Patlolla 9,660 Reputation points Microsoft External Staff Moderator

2025-02-03T04:12:53.1066667+00:00

Hi AZR-Paterson, Gerry,

Just want to check if the above Comment worked for you or else please let us know if any help, we are always here to help whenever you need us.

If the comment is helpful, please click "Upvote it"

Thankyou
Naveena Patlolla 9,660 Reputation points Microsoft External Staff Moderator

2025-02-04T05:40:43.65+00:00

Hi AZR-Paterson, Gerry,

Just want to check if the above Comment worked for you or else please let us know if any help, we are always here to help whenever you need us.

If the comment is helpful, please click "Upvote it"

Thankyou
AZR-GP 20 Reputation points

2025-02-11T17:45:58.7733333+00:00

Please refer to the updates above for more information on this case.
Deleted

This comment has been deleted due to a violation of our Code of Conduct. The comment was manually reported or identified through automated detection before action was taken. Please refer to our Code of Conduct for more information.

AZR-GP 20

Hi

Thanks for your suggestions. az connectedmachine upgrade preflight-check

This command was not recognised (upgrade).

az connectedmachine show --name <resource-bridge-name> --resource-group <resource-group>

This command did not work for the vmware resource bridge.

az acr repository list --name <your-acr-name>

No repositories were found - are these on the local VM?

The above command was modified to:-

az arcappliance upgrade vmware --config-file <path-to-config-file> --debug

This did produce a lot more output but came down to the same error.

cli.azure.cli.core.azclierror: (ImagePreflightCheckErrorOnPrem) Upgrade Operation Failed with error: "{\n  \"code\": \"ImagePreflightCheckError\",\n  \"message\": \"preCode: ImagePreflightCheckErrorOnPrem
Message: Upgrade Operation Failed with error: "{\n  \"code\": \"ImagePreflightCheckError\",\n  \"message\": \"preflight checks failed: ImageNotFound\"\n }"
az_command_data_logger: (ImagePreflightCheckErrorOnPrem) Upgrade Operation Failed with error: "{\n  \"code\": \"ImagePreflightCheckError\",\n  \"message\": \"preflight checks failed: ImageNotFound\"\n }"
Code: ImagePreflightCheckErrorOnPrem
Message: Upgrade Operation Failed with error: "{\n  \"code\": \"ImagePreflightCheckError\",\n  \"message\": \"preflight checks failed: ImageNotFound\"\n }"

I'll try and post more of the log, but previous attempt was deleted!

Please let me know if there are more suggestions to try, thanks.

AZR-GP 20

Further upgrade logs show:-

...
2025-02-11T17:09:20Z    INFO    vsphereProvider: Image Client: Checking if file is present in datastore: [ABS_Store] template-appliance-0.1.32.10710-v1.28.5/template-appliance-0.1.32.10710-v1.28.5.vmtx
2025-02-11T17:09:23Z    INFO    vsphereProvider: Image Client: Checking if file is present in datastore: [ABS_Store] template-appliance-0.1.32.10710-v1.28.5/template-appliance-0.1.32.10710-v1.28.5.vmsd
2025-02-11T17:09:25Z    INFO    vsphereProvider: Image Client: Checking if file is present in datastore: [ABS_Store] template-appliance-0.1.32.10710-v1.28.5/template-appliance-0.1.32.10710-v1.28.5.vmdk
2025-02-11T17:09:26Z    INFO    vsphereProvider: Image Client: Checking if file is present in datastore: [ABS_Store] template-appliance-0.1.32.10710-v1.28.5/template-appliance-0.1.32.10710-v1.28.5-flat.vmdk
2025-02-11T17:09:27Z    INFO    vsphereProvider: Image Client: Checking if file is present in datastore: [ABS_Store] template-appliance-0.1.32.10710-v1.28.5/template-appliance-0.1.32.10710-v1.28.5-000001.vmdk
2025-02-11T17:09:27Z    INFO    vsphereProvider: Image Client: Checking if file is present in datastore: [ABS_Store] template-appliance-0.1.32.10710-v1.28.5/template-appliance-0.1.32.10710-v1.28.5-000001-sesparse.vmdk
2025-02-11T17:09:27Z    INFO    vsphereProvider: Image Client: Checking if file is present in datastore: [ABS_Store] template-appliance-0.1.32.10710-v1.28.5/template-appliance-0.1.32.10710-v1.28.5-Snapshot1.vmsn
Appliance configuration was prepared successfully
...
Starting the upgrade
cli.azure.cli.core.sdk.policies: Request URL: 'https://management.azure.com/subscriptions/ebxyz/resourceGroups/azurearc-rg/providers/Microsoft.ResourceConnector/appliances/DC-vc-resourcebridge?api-version=2022-10-27'
cli.azure.cli.core.sdk.policies: Request method: 'PUT'
cli.azure.cli.core.sdk.policies: Request headers:
cli.azure.cli.core.sdk.policies:     'Content-Type': 'application/json'
cli.azure.cli.core.sdk.policies:     'Content-Length': '995'
cli.azure.cli.core.sdk.policies:     'Accept': 'application/json'
cli.azure.cli.core.sdk.policies:     'x-ms-client-request-id': '0ebc6d95-c032-4759-ab80-xxxxxxxx'
cli.azure.cli.core.sdk.policies:     'CommandName': 'arcappliance upgrade vmware'
cli.azure.cli.core.sdk.policies:     'ParameterSetName': '--config-file --debug'
cli.azure.cli.core.sdk.policies:     'User-Agent': 'AZURECLI/2.57.0 (MSI) azsdk-python-mgmt-resourceconnector/1.0.0 Python/3.11.7 (Windows-10-10.0.19045-SP0) arcappliance-extension-version/1.3.1'
cli.azure.cli.core.sdk.policies:     'Authorization': '*****'
cli.azure.cli.core.sdk.policies: Request body:
cli.azure.cli.core.sdk.policies: {"tags": {"City": ... "properties": {"distro": "AKSEdge", "infrastructureConfig": {"provider": "VMWare"}, "publicKey": "MIICCgKCAgxyz123...", "version": "latest"}}
urllib3.connectionpool: https://management.azure.com:443 "PUT /subscriptions/ebxxxxxxxxxxxxxxxxxxxxxxxxxxx/resourceGroups/azurearc-rg/providers/Microsoft.ResourceConnector/appliances/DC2-vc-resourcebridge?api-version=2022-10-27 HTTP/1.1" 200 1618
cli.azure.cli.core.sdk.policies: Response status: 200

...
 File "C:\Users\ccc999\.azure\cliextensions\arcappliance\azext_arcappliance\pkg\commands\upgrade.py", line 136, in upgrade_appliance
    raise e
  File "C:\Users\ccc999\.azure\cliextensions\arcappliance\azext_arcappliance\pkg\commands\upgrade.py", line 116, in upgrade_appliance
    upgrade_poller.wait()
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/tracing/decorator.py", line 76, in wrapper_use_tracer
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 261, in wait
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/_poller.py", line 176, in _start
  File "D:\a\_work\1\s\build_scripts\windows\artifacts\cli\Lib\site-packages\azure/core/polling/base_polling.py", line 745, in run
azure.core.exceptions.HttpResponseError: (ImagePreflightCheckErrorOnPrem) Upgrade Operation Failed with error: "{\n  \"code\": \"ImagePreflightCheckError\",\n  \"message\": \"preflight checks failed: ImageNotFound\"\n }"
Code: ImagePreflightCheckErrorOnPrem
Message: Upgrade Operation Failed with error: "{\n  \"code\": \"ImagePreflightCheckError\",\n  \"message\": \"preflight checks failed: ImageNotFound\"\n }"
cli.azure.cli.core.azclierror: (ImagePreflightCheckErrorOnPrem) Upgrade Operation Failed with error: "{\n  \"code\": \"ImagePreflightCheckError\",\n  \"message\": \"preflight checks failed: ImageNotFound\"\n }"
Code: ImagePreflightCheckErrorOnPrem

As noted above, this is a local VM running on a connected vCenter.

Any further suggestions appreciated.

Madugula Jahnavi 495 Reputation points Microsoft External Staff Moderator

2025-02-19T04:20:25.4133333+00:00

AZR-GP, Are you still facing the issue with above commands or logs! Can you also try reimporting the latest Resource Bridge image from Azure and retrieve the logs.
AZR-GP 20 Reputation points

2025-03-17T12:14:37.05+00:00

This has to be removed and redeployed to resolve issue.
Sadiqh Ahmed 49,571 Reputation points Microsoft External Staff Moderator

2025-03-18T19:30:25.65+00:00

@AZR-GP Thanks for sharing the solution that worked for you. This would certainly be helpful to others on this community.