Since the HDD was labeled as "E" drive with the old ssd will it automatically still be listed as E when I plug it back in?
-> Not necessarily but you can easily change the drive letter with the Disk Manager (diskmgmt.msc).
Should I shut the system down before plugging the HDD in?
-> If it is installed in a USB case, no. If you connect it with a SATA cable, yes.