Thanks for asking question! If I have understood right you want to add custom domain to Static Web apps, If so, could you please confirm if you have configured CNAME with your domain provider?
As you'll need to configure a CNAME with your domain provider. Suggest you to follow steps from the official document :
Add domain using CNAME record validation
Please let us know if further query or issue remains.