If private key is marked as non-exportable, then there is no supported way to extract the key. There are 3rd party tools that may work (but may not, though) for you, but they are not supported and you take all risks when using these 3rd party tools.
The rest depends on what type is the certificate and how it was issued.