Azure Pipeline Monitoring

Question

Hello,

I am having an issue where I can not see any of the pipelines that we currently have running. The pipelines seem to be executing but I am unable to see them in the monitoring integration system. I used to be able to see them. Does anyone have a solution for this?

Thanks.

Answer 1

@Matthew Caffrey - Thanks for the question and using MS Q&A platform. 

Based on the information you have provided, it seems that you are unable to see the pipelines that are currently running in the monitoring integration system for Azure Synapse Analytics. 

Make sure you have necessary permissions to access the monitor your workspace pipeline runs. You can review logs and cancel running jobs and pipelines if you're a Synapse Monitoring Operator at the workspace or for a specific pipeline.

For more details, refer to Understand the roles required to perform common tasks in Azure Synapse

Here are some steps you can try to resolve the issue: 

• Try refreshing the monitoring page or logging out and back in. This can help if the dashboard has not updated properly. 
• Check if any filters are applied in the monitoring dashboard that might be hiding the pipelines. You can adjust or clear these filters to see if that resolves the issue, as illustrated in the figure below: 

• Verify that the triggers for your pipelines are active and functioning. If a trigger is disabled or misconfigured, it may affect visibility. 
• Check the logs for your pipelines to see if there are any errors or issues that could be causing them to not appear in the monitoring system. You can do this by going to the Azure Synapse Analytics workspace and looking at the pipeline runs. 

For more information refer to this: Monitor pipeline runs using Synapse Studio - Azure Synapse Analytics | Microsoft Learn 

Troubleshoot Synapse Studio - Azure Synapse Analytics | Microsoft Learn 

Hope this helps. Do let us know if you have any further queries.  

------------  

If this answers your query, do click Accept Answer and Yes for was this answer helpful. And, if you have any further query do let us know.