Can you provide more details about the issue, for example how are you connecting to it and what is the error you experience?
If you have assigned the user to the VM as per here already - https://learn.microsoft.com/en-us/azure/virtual-desktop/deploy-azure-ad-joined-vm#assign-user-access-to-host-pools
Then the next steps are connecting, can you make sure you've read the following as this is where some additional steps are also required: