Hi @MS
If you don't want to use certs or graph you can try going down the app password route. You will need to have this enabled for your tenant otherwise you will not see the functionality. I am not 100% sure app passwords work for PowerShell as it's not really secure, but you can try. (since you didn't mention what type of PowerShell scripts you are trying to run).
Manage app passwords for two-step verification
If this doesn't work for the type of PS script you are trying to run, you will have to default to using Certificates (which isn't that hard to setup/manage).
---------------------------------
If this is helpful please accept answer.