So I got it working.. the issue was the pfx I had was "off" somehow and I followed the instructions here
https://github.com/MicrosoftDocs/azure-docs/issues/50164
To decompose my pfx to a cert and key and then reassemble it, and it appears to be working as expected!
Can you confirm that the CNAME on my for my DNS should be either
api.mydomain.com -> origin-abc-123-azurefd.net (the existing route that works)
api.mydomain.com -> my-frontdoor-azurefd.net (the name of the azure front door service)
I ask because last night I also switched from option 1 (which is how I had it), to option 2 and today I noticed that in the custom domains blade for my custom domain, under the DNS state column is says "CNAME is currently not detected" but it IS working now after I redid the cert.
So I just want to make sure everything is correct
Thanks,
Rich