The basic SKU of Azure Bastion only provides an RDP connection for Windows virtual machines. For Linux it's an SSH connection only.
However, the newer Standard SKU of Azure Bastion has support for RDP for Linux virtual machines.
https://learn.microsoft.com/en-us/azure/bastion/bastion-overview#sku