Azure Connected Machine Agent fails to install

Tasos Sardelis 46

Trying to install Azure Connected Machine Agent to join a Windows 2016 server in ARC. I run the script through Powershell and the installation fails with error: Fatal error during installation.
In Event Viewer, error 11920 says: "Product: Azure Connected Machine Agent -- Error 1920. Service 'Azure Hybrid Instance Metadata Service' (himds) failed to start. Verify that you have sufficient privileges to start system services."
I am Local admin on the machine. The same script installs the agent successfully on other servers
And the InstallationLog file is attached.273195-installationlog.txt

Monalla-MSFT 12,046 Reputation points

2023-01-05T06:56:58.187+00:00

@Tasos Sardelis - Thanks for reaching out to us.
I am currently investigating this issue and will get back to you as soon as possible.

Thank you for being patient while we work on this issue.
Myint Myat 0 Reputation points

2023-08-05T17:55:49.6433333+00:00

I have found one solution for this.

Delete the AzureConnectedMachineAgent folder under the location.

Location >> C:\Program Files\AzureConnectedMachineAgent

Location >> C:\ProgramData\AzureConnectedMachineAgent

Copy AzureConnectedMachineAgent installer to C:\
Installer > right click > properties> compalibility
Select the check box for "Run this program in compatibility mode for" previous version of windows
Also for all user

Add arc installer file and folder to virus & threat protection exclusion list.

Try installing Arc.

It will work.

4 answers

brent24099 111 Reputation points

2023-03-01T20:50:48.07+00:00

I was able to get it to work. They fixed some issues in the February update, and I was told to try again, but I still had no success.

I was getting this error in c:\programdata\azureconnectedmachineagent\log\himds.log:

time="2023-03-01T15:35:15-05:00" level=info msg="Loading AgentConfig file from: C:\ProgramData\AzureConnectedMachineAgent\Config\localconfig.json"
time="2023-03-01T15:35:15-05:00" level=fatal msg="Error reading local configuration file: invalid character '\x00' looking for beginning of value"

I deleted the folder located at C:\ProgramData\AzureConnectedMachineAgent\

Once I did, I was able to successfully install ARC to the problem machines.
Please sign in to rate this answer.

1 person found this answer helpful.
PIRO BAXHERRI 0 Reputation points

2023-04-01T09:53:22.6533333+00:00

i tried to delete the folder you mentioned, It didn't work

GAURAV BHATIA 0 Reputation points Microsoft Employee

2023-08-02T08:10:46.8566667+00:00

which folder did you remove? There are three folders: certs, config, log

brent24099 111 Reputation points

2023-08-02T20:55:27.14+00:00

I deleted the entire AzureConnectedMachineAgent folder

GAURAV BHATIA 0 Reputation points Microsoft Employee

2023-08-03T01:55:37.03+00:00

I am also having this issue that when trying to install arc agent manually, it fails to start HIMDS. It says you don't have permissions to start the service. But I am admin on the node. Also when I check the service, HIMDS is not there. Any suggestions how can I fix it.
Sign in to comment
Andrew Blumhardt 9,581 Reputation points Microsoft Employee

2023-01-05T13:28:36.767+00:00

Quick items to check. Retry and make sure you are running the PS as admin. Sometimes a retry is all that is needed (possibly after a reboot). Check out the service listed. Verify that it is installed and can it be started manually. Look for System events or EDR blocks related to the himds service.
Please sign in to rate this answer.
Tasos Sardelis 46 Reputation points

2023-01-05T13:53:20.193+00:00

i confirm the Powershell is running as admin. Tried the installation script once more. Same failure event.
The himds service isn't present as the installation fails and thee agent isn't installed.
No EDR blocks but the following System Events appear:
Eventid 7009: A timeout was reached (30000 milliseconds) while waiting for the Azure Hybrid Instance Metadata Service service to connect.
Eventid 7000: The Azure Hybrid Instance Metadata Service service failed to start due to the following error: The service did not respond to the start or control request in a timely fashion.

Both events are repeated 7 times

Andrew Blumhardt 9,581 Reputation points Microsoft Employee

2023-01-06T13:45:55.18+00:00

Are you sure there is no "Azure Hybrid Instance Metadata Service" service? It seems odd that the service control manager would report a response error on a service that is not installed. Have you tried retying after a reboot? Is there any option in the control panel to remove or repair?

Tasos Sardelis 46 Reputation points

2023-01-09T07:10:36.21+00:00

Yes, I've double checked. Most probably, the service is installed during the installation and after the failure it rolls back and gets uninstalled.

Andrew Blumhardt 9,581 Reputation points Microsoft Employee

2023-01-09T15:03:10.787+00:00

I recommend opening a support case if you can. This does not appear to be a common issue. Maybe look closer at the comparison of successful and unsuccessful systems. Check the patching level. Look for unusual GPO lockdown.

Tasos Sardelis 46 Reputation points

2023-01-10T06:38:12.21+00:00

I will, thanks!

brent24099 111 Reputation points

2023-02-20T19:27:19.1133333+00:00

I'm getting the same issue but only on 2 servers. Did you have any luck fixing this?

Tasos Sardelis 46 Reputation points

2023-02-21T06:33:38.0533333+00:00

No, I haven't

brent24099 111 Reputation points

2023-02-21T13:53:19.9466667+00:00

Yeah I'm pretty sure this is a MS bug. I have a ticket in with them and they said they have other similar cases. I will post back if they resolve it.
Sign in to comment
Myint Myat 0 Reputation points

2023-08-05T18:03:46.5066667+00:00

I have found one solution for this.

Delete the AzureConnectedMachineAgent folder under the location.

Location >> C:\Program Files\AzureConnectedMachineAgent

Location >> C:\ProgramData\AzureConnectedMachineAgent

Copy AzureConnectedMachineAgent installer to C:\
Installer > right click > properties> compalibility
Select the check box for "Run this program in compatibility mode for" previous version of windows
Also for all user

Add arc installer file and folder to virus & threat protection exclusion list.

Try installing Arc.

It will work.
Please sign in to rate this answer.
Andreas Semmelmann 0 Reputation points Microsoft Employee

2023-08-09T12:08:16.72+00:00

Please be aware that you need to do further preparation if you would like to evaluate Azure Arc on a Azure VM. Here is the official documentation how to do this:
https://learn.microsoft.com/en-us/azure/azure-arc/servers/plan-evaluate-on-azure-virtual-machine
Sign in to comment
Laura Hutchcroft 0 Reputation points Microsoft Employee

2024-02-09T20:50:33.91+00:00

https://techcommunity.microsoft.com/t5/fasttrack-for-azure/the-case-of-the-rogue-azure-arc-connected-machine-agent/ba-p/4025092 troubleshooting steps as well as a link to a really good article about azure arc agent
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Share via

Azure Connected Machine Agent fails to install

4 answers