Edge (by default) continues to run in the background after you've closed the browser window...
(not sure why this decision was made, but...)
Go to:
Settings / System and Performance / (turn off startup boost, and "Continue running background extensions and apps when Microsoft Edge is closed"