Try to remove anything the hacker set up. Sign in to Outlook on the web, go to Settings, Mail, Rules and delete any rule you did not create. Then check Mail, Forwarding and make sure no forwarding address is listed. Also review Automatic replies and your account activity at account.microsoft.com/security to confirm no unknown access.
If emails still send after this, let me know if you see any unfamiliar sign in activity.