@Rikki Goudarzi Are you using ray_on_aml() which is now supported for reinforcement learning experiments with Azure Machine Learning?
I think the job that is created should generate more logs to check what could be the underlying issue with the compute cluster. Are you following this document from the Azure ML RL documentation?
If an answer is helpful, please click on or upvote which might help other community members reading this thread.