The pipeline has encountered errors several times during its operation, please contact Azure Suppo

Jay 0 Reputation points
2025-03-03T06:17:06.4766667+00:00

In the past two days, our pipeline has encountered errors several times during its operation. We need the support of Microsoft. The pipeline mainly retrieves data from the Synapse link and writes it to the VM service. We haven't been able to find the cause of the errors. Our pipeline runs in East Asia. Could you please help check it out? The error messages are as follows:

run_id: 43f17c64-2dfd-4138-949b-42f5d0957fa4

Failed to send request to Livy due to exception=[Microsoft.Marlin.Common.Exception.LivyException]. Code: NotFound. Message: "Session '0' not found.".

run_id: fdd9c80e-7a42-4cf8-8a73-d510f3482c73

Hit unexpected exception, please retry. If the problem persists, please contact Azure Support

run_id: b77be8e1-a180-4479-9e96-e9514e9aff37

Internal Server Error in Synapse batch operation: 'Cluster creation failed due to unexpected error. Please retry.'.

run_id: 296656c2-295a-4d5b-9b3d-73071ddf3ec3

Internal Server Error in Synapse batch operation: '[plugins.HK-EA-VGDP-DATAFTY02.General-8-1-4c517d1b-28e2-436f-a0a7-66697ee837d7.6892 WorkspaceType:<ADF> CCID:<296656c2-295a-4d5b-9b3d-73071ddf3ec3>] Attempt=[1]/[3]Cluster was in terminal state=[Cancelled] before it reached 'Ready' state. Cluster job has WorkspaceName=[HK-EA-VGDP-DATAFTY02], SpecName=[General-8-1-4c517d1b-28e2-436f-a0a7-66697ee837d7], and JobId=[a0458fab-7eb1-41ef-89cc-94991409de52].'.

Microsoft 365 and Office | Development | Microsoft 365 Developer Program
{count} votes

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.