Not a fix, sorry. But you can vote for and comment on this Feature Request
Add the ability in New Outlook to Delete a Contact/People Category.
https://feedbackportal.microsoft.com/feedback/idea/2af4e80b-beb9-f011-aa43-7c1e526e4a18
(You must "Sign In" at the top right of the Feedback page before you can vote).