Azure Synapse Analytics Workspace debug window clearing automatically after 40 mins?

Question

Azure Synapse Analytics Workspace debug window clearing automatically after 40 mins?

Benoit Thiboutot 1

Hi,
I want to know if it's possible to keep the debug window on the pipeline tab opened after 40 mins?

When I debug a pipeline, it takes up to an hour. Unfortunately, the debug window clears automatically after 40 mins.
I can follow the run inside the monitor tab.

I just want to know if the limit is on the amount of lines inside the debug or a timeout, and be able to configure this so I can still see it running directly from the pipeline tab.

Thank you,
Benoit

KranthiPakala-MSFT 46,827 Reputation points Moderator

2021-08-11T08:47:32.733+00:00

Hi @Benoit Thiboutot ,

Welcome to Microsoft Q&A forum and thanks for posting your query.
This seems to be a limitation issue. We are reaching out to internal team to see if there is a way to overcome this limitation and will get back to you as soon as we have an update.

We appreciate patience.

Thank you
KranthiPakala-MSFT 46,827 Reputation points Moderator

2021-08-12T03:57:11.11+00:00

Hi @Benoit Thiboutot ,

Just wanted to double confirm if you are referring to Mapping dataflow debug run window or general debug window of a debug run instance of a pipeline in synapse workspace?

Thanks
Benoit Thiboutot 1 Reputation point

2021-08-12T12:04:11.183+00:00

Hi KranthiPakala,

I'm referring to a debug run instance in the synapse workspace.
Opening Synapse Studio, going to the Integrate tab, then selecting a pipeline and clicking on the Debug button which is about in the middle of the screen.

Thank you,
Benoit
KranthiPakala-MSFT 46,827 Reputation points Moderator

2021-08-16T01:14:48.607+00:00

Thanks for your response @Benoit Thiboutot . I have escalated this issue to Product team and will get back to as soon as we have an update. In the meantime could you please confirm if you debugged pipeline contains mapping data flow activities, if yes, is there a TTL set for 40 mins? or are you using an Azure Integration Runtime that has TTL set to 40 min in your pipeline? Could you also please confirm on this.

Thank you
Benoit Thiboutot 1 Reputation point

2021-08-16T12:06:55.03+00:00

Hi KranthiPakala,

I do not have any activities of the type MapReduce.
I have some calls to storage containers and some calls to Databricks Notebooks,

I've also looked at the integration runtimes we are using. It seems that there is a data-flow run time,
They are self-hosted and I can't see any "TTL" setting.

Thank you,
Benoit Thiboutot
KranthiPakala-MSFT 46,827 Reputation points Moderator

2021-08-17T02:57:31.453+00:00

Thanks for your response and confirmation @Benoit Thiboutot .

This issue seems strange and unable to reproduce from my end. If you have a support plan I would recommend filing a support ticket so that a support engineer can take a look at the issue over call. In case if you don't have a support plan please do let us know here so that we can work with you offline.

We look forward to your confirmation.