Hello, are you using the new Outlook or the classic version?
Turn off “New Outlook” and switch to classic Outlook. iCloud only syncs with the classic app. Close Outlook, reopen it, then sign in again in iCloud for Windows and enable Mail, Contacts, and Calendars for Outlook.