Hi,
When you created the custom domain for the first time, you must have added a CNAME record in your registrar or in your Azure DNS which is still pointing to the Azure Front Door's FQDN. You need to first remove the CNAME which you have created. Then try to delete the AFD again.