Not able to run the synapse pipeline with %run notebook magic command

Aditya Singh 105 Reputation points
2024-03-29T14:27:39.05+00:00

I am trying to run a pipeline in Azure synapse analytics and running a notebook which has

User's image

When I am running the above command via manual notebook run its running but when I am running the same notebook via pipeline getting the below error

User's image

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,343 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
2,428 questions
Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
2,846 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
4,372 questions

1 answer

Sort by: Most helpful
Most helpful Newest Oldest
  1. Vinodh247-1375 11,206 Reputation points
    2024-03-29T14:36:53.9533333+00:00

    Hi Aditya Singh,

    Thanks for reaching out to Microsoft Q&A.

    See the rootcause and workaround suggested for the same issue in another thread. To not duplicate the answer, I am mentioning the link to that question for your reference. Please check and let me know if this helped.

    https://learn.microsoft.com/en-us/answers/questions/1622353/facing-issues-while-running-multiple-notebook-in-a

    Please 'Upvote'(Thumbs-up) and 'Accept' as an answer if the reply was helpful. This will benefit other community members who face the same issue.

    0 comments