A task was canceled

Ryan Abbey 1,186 Reputation points
2021-12-14T03:57:31.273+00:00

One of our Synapse spark notebooks sometimes works but othertimes "runs" for half hour+ and then fails with "A task was canceled" (no details on where/what/how), how do we figure out what is causing it? Other executions of same notebook with different input data don't seem to be having an issue, just (oddly) the simplest of the inputs (that is, single source file writing to delta whereas some of the others that work fine merge a series of source files to delta)

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.