Welcome to Microsoft Q&A! Thanks for posting this good question.
Yes. "Parse Server on managed Azure service' is not available in the Azure Marketplace, you could leverage Parse Server Container Image by Bitnami if your requirement fits.
Having mentioned that, I'm checking on this internally with our product engineering team and will get back to you shortly.