Do you already have configured any AAD User on that virtual machine?
If you configure the AAD join it only joins that VM into the domain but did not grant any permissions to any user, so actually, your AAD-Admin-Account has no permission on that server or at least not enough... please check.