Hello @sammyboy123
Unfortunately you cannot get a copy of the private key if it is lost for example.
https://serverfault.com/questions/183664/recover-an-ssh-private-key
Concept of SSH-keys is described here
https://www.ssh.com/ssh/key/
You can only regenerate new key pair(private and public keys) and reset SSH configuration on Linux VM with new public key
https://learn.microsoft.com/en-us/azure/virtual-machines/troubleshooting/troubleshoot-ssh-connection
There is a possibility to store SSH keys in Azure Portal, so you can downloaded it on any of your local machines.
https://learn.microsoft.com/en-us/azure/virtual-machines/ssh-keys-portal