Error Code "6001"

Al W 96 Reputation points
2021-01-26T14:19:02.79+00:00

I am running a Synapse Notebook through a synapse pipeline and am getting an error code 6001 "Creating new Synapse Notebook Statement Failed" and haven't been able to find anything explaining why. When running the code manually, it runs through to the final cell where it then is supposed to write to parquets in an azure data lake. Other notebooks are writing out fine, but this one doesn't seem to finish. It will write to parquets in a couple of minutes, and then just keeps spinning and never completes. Not sure if that is related to the issue received in when running in the pipeline.

The notebook is written in pyspark.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,902 questions
0 comments No comments
{count} votes

Accepted answer
  1. Al W 96 Reputation points
    2021-01-26T18:40:36.383+00:00

    I discovered that it was caused by a function used to create the path to write to. When I replaced it with a variable for the path, it worked as expected.

    0 comments No comments

0 additional answers

Sort by: Most helpful

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.