@MS Techie Thank you for reaching out.
Yes you can use Azure AD authentication with Azure SQL Database from Powershell.
Please check the articles here and here for detailed instructions.
----------
If an answer is helpful, please "Accept answer" or "Up-Vote" which might help other community members reading this thread.