Hi MichelleMcCabe-5663,
Welcome to Microsoft Q&A! Thanks for posting this question.
If your Web App uses an IP based SSL certificate, get the IP address from your KUDU console and use that IP address for the *.azurewebsites.net hostname you are remote debugging by adding the IP HOSTNAME combination to the HOSTS file.
Please see this blog post for more information.
Hope that helps!
Thanks,
Grace