AAD Sync error

Question

New users- mail stuck  at we are preparing the mailbox. This started  last week and no changes have been made to the system.

Error below:

• System

  - Provider

   [ Name]  Directory Synchronization

  - EventID 611

   [ Qualifiers]  0

   Level 2

   Task 0

   Keywords 0x80000000000000

  - TimeCreated

   [ SystemTime]  2018-10-02T05:36:11.000000000Z

   EventRecordID 4888743

   Channel Application

   Computer xxxx-xxxx.xxxx.xxxx.xxxx.uk

   Security

• EventData

   Password hash synchronization failed for domain: xxxx. Details: Microsoft.Online.PasswordSynchronization.SynchronizationManagerException: Unable to open connection to domain: xxxx. Error: An exception occurred while attempting to locate a domain controller for domain xxxx. ---> Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsCommunicationException: An exception occurred while attempting to locate a domain controller for domain xxxx. ---> System.DirectoryServices.ActiveDirectory.ActiveDirectoryServerDownException: The server is not operational. Name: "xxxx" ---> System.Runtime.InteropServices.COMException: The server is not operational. at System.DirectoryServices.DirectoryEntry.Bind(Boolean throwIfFail) at System.DirectoryServices.DirectoryEntry.Bind() at System.DirectoryServices.DirectoryEntry.get_AdsObject() at System.DirectoryServices.PropertyValueCollection.PopulateList() at System.DirectoryServices.PropertyValueCollection..ctor(DirectoryEntry entry, String propertyName) at System.DirectoryServices.PropertyCollection.get_Item(String propertyName) at System.DirectoryServices.ActiveDirectory.PropertyManager.GetPropertyValue(DirectoryContext context, DirectoryEntry directoryEntry, String propertyName) --- End of inner exception stack trace --- at System.DirectoryServices.ActiveDirectory.PropertyManager.GetPropertyValue(DirectoryContext context, DirectoryEntry directoryEntry, String propertyName) at System.DirectoryServices.ActiveDirectory.Domain.GetDomain(DirectoryContext context) at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveDomainController() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveSourceHostname() --- End of inner exception stack trace --- at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveSourceHostname() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.CreateSourceDomainInformation() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.EstablishConnection() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.Connect() at Microsoft.Online.PasswordSynchronization.RetryUtility.<>c__DisplayClass2_0.<ExecuteWithRetry>b__0() at Microsoft.Online.PasswordSynchronization.RetryUtility.ExecuteWithRetryT at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.OpenConnection(IDrsConnection connection) --- End of inner exception stack trace --- at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.OpenConnection(IDrsConnection connection) at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.CreateConnection() at Microsoft.Online.PasswordSynchronization.DeltaSynchronizationTask.SynchronizeCredentialsToCloud() at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.SynchronizeSecrets() at Microsoft.Online.PasswordSynchronization.SynchronizationExecutionContext.SynchronizeDomain() at Microsoft.Online.PasswordSynchronization.SynchronizationManager.SynchronizeDomain(SynchronizationExecutionContext syncExecutionContext) Microsoft.Online.PasswordSynchronization.SynchronizationManagerException: Unable to open connection to domain: xxxx. Error: An exception occurred while attempting to locate a domain controller for domain xxxx. ---> Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsCommunicationException: An exception occurred while attempting to locate a domain controller for domain xxxx. ---> System.DirectoryServices.ActiveDirectory.ActiveDirectoryServerDownException: The server is not operational. Name: "xxxx" ---> System.Runtime.InteropServices.COMException: The server is not operational. at System.DirectoryServices.DirectoryEntry.Bind(Boolean throwIfFail) at System.DirectoryServices.DirectoryEntry.Bind() at System.DirectoryServices.DirectoryEntry.get_AdsObject() at System.DirectoryServices.PropertyValueCollection.PopulateList() at System.DirectoryServices.PropertyValueCollection..ctor(DirectoryEntry entry, String propertyName) at System.DirectoryServices.PropertyCollection.get_Item(String propertyName) at System.DirectoryServices.ActiveDirectory.PropertyManager.GetPropertyValue(DirectoryContext context, DirectoryEntry directoryEntry, String propertyName) --- End of inner exception stack trace --- at System.DirectoryServices.ActiveDirectory.PropertyManager.GetPropertyValue(DirectoryContext context, DirectoryEntry directoryEntry, String propertyName) at System.DirectoryServices.ActiveDirectory.Domain.GetDomain(DirectoryContext context) at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveDomainController() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveSourceHostname() --- End of inner exception stack trace --- at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveSourceHostname() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.CreateSourceDomainInformation() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.EstablishConnection() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.Connect() at Microsoft.Online.PasswordSynchronization.RetryUtility.<>c__DisplayClass2_0.<ExecuteWithRetry>b__0() at Microsoft.Online.PasswordSynchronization.RetryUtility.ExecuteWithRetryT at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.OpenConnection(IDrsConnection connection) --- End of inner exception stack trace --- at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.OpenConnection(IDrsConnection connection) at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.CreateConnection() at Microsoft.Online.PasswordSynchronization.DeltaSynchronizationTask.SynchronizeCredentialsToCloud() at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.SynchronizeSecrets() at Microsoft.Online.PasswordSynchronization.SynchronizationExecutionContext.SynchronizeDomain() at Microsoft.Online.PasswordSynchronization.SynchronizationManager.SynchronizeDomain(SynchronizationExecutionContext syncExecutionContext) Microsoft.Online.PasswordSynchronization.SynchronizationManagerException: Unable to open connection to domain: xxxx. Error: An exception occurred while attempting to locate a domain controller for domain xxxx. ---> Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsCommunicationException: An exception occurred while attempting to locate a domain controller for domain xxxx. ---> System.DirectoryServices.ActiveDirectory.ActiveDirectoryServerDownException: The server is not operational. Name: "xxxx" ---> System.Runtime.InteropServices.COMException: The server is not operational. at System.DirectoryServices.DirectoryEntry.Bind(Boolean throwIfFail) at System.DirectoryServices.DirectoryEntry.Bind() at System.DirectoryServices.DirectoryEntry.get_AdsObject() at System.DirectoryServices.PropertyValueCollection.PopulateList() at System.DirectoryServices.PropertyValueCollection..ctor(DirectoryEntry entry, String propertyName) at System.DirectoryServices.PropertyCollection.get_Item(String propertyName) at System.DirectoryServices.ActiveDirectory.PropertyManager.GetPropertyValue(DirectoryContext context, DirectoryEntry directoryEntry, String propertyName) --- End of inner exception stack trace --- at System.DirectoryServices.ActiveDirectory.PropertyManager.GetPropertyValue(DirectoryContext context, DirectoryEntry directoryEntry, String propertyName) at System.DirectoryServices.ActiveDirectory.Domain.GetDomain(DirectoryContext context) at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveDomainController() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveSourceHostname() --- End of inner exception stack trace --- at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveSourceHostname() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.CreateSourceDomainInformation() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.EstablishConnection() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.Connect() at Microsoft.Online.PasswordSynchronization.RetryUtility.<>c__DisplayClass2_0.<ExecuteWithRetry>b__0() at Microsoft.Online.PasswordSynchronization.RetryUtility.ExecuteWithRetryT at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.OpenConnection(IDrsConnection connection) --- End of inner exception stack trace --- at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.OpenConnection(IDrsConnection connection) at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.CreateConnection() at Microsoft.Online.PasswordSynchronization.DeltaSynchronizationTask.SynchronizeCredentialsToCloud() at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.SynchronizeSecrets() at Microsoft.Online.PasswordSynchronization.SynchronizationExecutionContext.SynchronizeDomain() at Microsoft.Online.PasswordSynchronization.SynchronizationManager.SynchronizeDomain(SynchronizationExecutionContext syncExecutionContext) Microsoft.Online.PasswordSynchronization.SynchronizationManagerException: Unable to open connection to domain: xxxx. Error: An exception occurred while attempting to locate a domain controller for domain xxxx. ---> Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsCommunicationException: An exception occurred while attempting to locate a domain controller for domain xxxx. ---> System.DirectoryServices.ActiveDirectory.ActiveDirectoryServerDownException: The server is not operational. Name: "xxxx" ---> System.Runtime.InteropServices.COMException: The server is not operational. at System.DirectoryServices.DirectoryEntry.Bind(Boolean throwIfFail) at System.DirectoryServices.DirectoryEntry.Bind() at System.DirectoryServices.DirectoryEntry.get_AdsObject() at System.DirectoryServices.PropertyValueCollection.PopulateList() at System.DirectoryServices.PropertyValueCollection..ctor(DirectoryEntry entry, String propertyName) at System.DirectoryServices.PropertyCollection.get_Item(String propertyName) at System.DirectoryServices.ActiveDirectory.PropertyManager.GetPropertyValue(DirectoryContext context, DirectoryEntry directoryEntry, String propertyName) --- End of inner exception stack trace --- at System.DirectoryServices.ActiveDirectory.PropertyManager.GetPropertyValue(DirectoryContext context, DirectoryEntry directoryEntry, String propertyName) at System.DirectoryServices.ActiveDirectory.Domain.GetDomain(DirectoryContext context) at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveDomainController() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveSourceHostname() --- End of inner exception stack trace --- at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.ResolveSourceHostname() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.CreateSourceDomainInformation() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.EstablishConnection() at Microsoft.Online.PasswordSynchronization.DirectoryReplicationServices.DrsConnection.Connect() at Microsoft.Online.PasswordSynchronization.RetryUtility.<>c__DisplayClass2_0.<ExecuteWithRetry>b__0() at Microsoft.Online.PasswordSynchronization.RetryUtility.ExecuteWithRetryT at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.OpenConnection(IDrsConnection connection) --- End of inner exception stack trace --- at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.OpenConnection(IDrsConnection connection) at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.CreateConnection() at Microsoft.Online.PasswordSynchronization.DeltaSynchronizationTask.SynchronizeCredentialsToCloud() at Microsoft.Online.PasswordSynchronization.PasswordSynchronizationTask.SynchronizeSecrets() at Microsoft.Online.PasswordSynchronization.SynchronizationExecutionContext.SynchronizeDomain() at Microsoft.Online.PasswordSynchronization.SynchronizationManager.SynchronizeDomain(SynchronizationExecutionContext syncExecutionContext) . <forest-info> <forest-name>WCC.xxxx</forest-name> <connector-id>c772ad10-c190-4553-bdd5-221edee880e2</connector-id> </forest-info>

Domain controller is Win 2012 R2

Answer 1

Hi Ros2,

Yes, it is recommended that you re-run the AAD Connect Wizard after you create the new enterprise admin account. 

Regards,

Alan

Answer 2

Hi Ros2,

Please feel free to let me know if you have any further concern. 

Regards,

Alan

Answer 3

Hi Alan

Thanks for the possible solutions.

I ran the ID Fix tool and it came back with no errors. I can create a new enterprise Admin. Once created, do I rerun the Azure AD connect wizard?

Regards

Ros2

Answer 4

Hi Ros2,

Greetings. This is Alan Wu from Office 365 forum support. It is my pleasure to reply to your case here. 

Appreciation on your detailed error message, via checking it, I have found that it is recycling to give an error " An exception occurred while attempting to locate a domain controller for domain xxxx".

Given the situation, the issue mainly occurs if the enterprise admin account credentials that are specified in the wizard are not unique in the Active Directory forest. Password mismatches between two or more identically named accounts in multidomain forests can cause the wizard to fail. Please take the following example.

Contoso\admin is the enterprise admin account that's specified in the Azure Active Directory Sync tool Configuration Wizard.

Contoso\admin and Fabrikam\admin are two accounts that have the same name but that exist in different domains.

Each account has a different password.

In this scenario, the password of Contoso\admin is used for all domains in the Active Directory forest during the configuration process. For example, if the password is "Password1," "Password1" is used for Fabrikam\admin. This causes the wizard to fail.

You can try one of the followings to check if the issue can be resolved. 

1. Create an enterprise admin account in which the value of the sAMAccountName attribute is unique and does not exist in each domain.
2. Update the passwords of all accounts that have identical names so that the password is the same for all those accounts.

Regards,

Alan