Hi,
Yes, you will be charged for App Service Plan even if you don't create any app instances. Yes, you will be charged for the App Service Plan if the instances are in stopped state. The exception would be the Free tier plan.
If the above is helpful please click Accept Answer.
Thanks.
-TP