Hello @Rebecca E. Boleratz ,
To resolve your issue, please review the solution called out in this related Stackoverflow thread.
In addition to selecting MySQL in App, you may also need to create an App service plan resource.
Please dont hesitate to ping if your issue persists and we will gladly assist further.
Have a good weekend.