Go to the Outlook -> File tab -> Office Account -> Under User Information, find Connected Services.
Please check whether the site which contains the contact you want to connect is listed under Connected Services. If not, please add it.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.