Found this: https://www.petri.com/how-to-uninstall-windows-powershell
In the article it claims that PS 2 is the baseline and that trying to remove it in any way would seriously damage Windows. So it looks like installing PS 5.1 over PS 2.0 should be OK. Still going to document my PSModulePath, tho.....