"Continuous DataFlow execution failed" error on Link connection, while following Synapse Link tutorial

Question

"Continuous DataFlow execution failed" error on Link connection, while following Synapse Link tutorial

Dario Ruben Scanferlato 20

While following this tutorial on creating a Synapse Link, I get an unclear error when trying to start the Link Connection.

I can't find any information on google about this error code.

Continuous DataFlow execution failed. Error code:'FailedToCreateMgmJob'. Error message: 'Falied to create management job, the requested operation of Data Factory 'synapsev3lp0z7'.'

User's image

Moreover, I noticed that if I test the connection after configuring it (in the right sidebar), everything is fine

User's image

When I test it on the bottom area of the page, I get an error with no information

User's image

If I try clicking on "More", there's no info

User's image

I am at a loss on how to debug this. I tried rerunning the tutorial from scratch twice, but I still get the same errors.

EDIT with more info: If I click on more details on the red "Continuous dataflow" error, the only additional info I have is a run id for the Link connection

Continuous DataFlow execution failed. Error code:'FailedToCreateMgmJob'. Error message: 'Falied to create management job, the requested operation of Data Factory 'synapseb8zp156'.' Continuous run ID: 5e7564df-e8e0-4d67-9b69-39999a2cdcb1

If I check this run ID in the Monitor page, the only additional info I get is that it's a "Configuration Error", and the link provided for the error code 8000 is not helpful

User's image

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2024-05-21T08:25:25.4966667+00:00

@Dario Ruben Scanferlato - Thanks for the question and using MS Q&A platform.

Can you please click on view details and share the error message here?

Looking forward for your response.
Dario Ruben Scanferlato 20 Reputation points

2024-05-21T11:54:22.7666667+00:00

@PRADEEPCHEEKATLA There's no additional information, beside the runID of the operation

If I check this run ID on Monitor I get no additional info, besides the fact that it's a "User Configuration Error". The documentation link for the error code 8000 is not helpful
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2024-05-22T08:17:46.7066667+00:00

@Dario Ruben Scanferlato - It looks like you are facing an error while executing a Continuous DataFlow in Azure Synapse Analytics. The error message suggests that the management job creation has failed due to some reason. This error can occur due to various reasons such as incorrect configuration settings, insufficient permissions, or network connectivity issues.

To resolve this issue, you can try the following steps:

Check if you have sufficient permissions to create a management job in the Azure Synapse Analytics instance. Ensure that you have the required role-based access control (RBAC) permissions to create and manage Data Factory resources.

Verify that the configuration settings for the Continuous DataFlow are correct. Check if the input and output datasets are configured correctly and if the mapping data flow is correctly defined.

Check if there are any network connectivity issues that might be causing the error. Ensure that the Azure Synapse Analytics instance is accessible from your network and that there are no firewall or network security group rules blocking the traffic.

If the issue persists, you can try deleting and recreating the Continuous DataFlow. This can help to resolve any configuration issues that might be causing the error.

If none of the above steps work, you may open a support ticket for further assistance.
Dario Ruben Scanferlato 20 Reputation points

2024-05-22T17:15:30.42+00:00

if I wanted an answer from an LLM, I wouldn't have asked here. Your answer is irrelevant.

EDIT: sorry for the mean comment, I'm just appalled that a Microsoft employee would give such a low effort and unhelpful answer. I'm under the impression that your only goal is to farm upvotes with the least amount of effort possible, instead of actually trying to help. Note that I also used chat GPT to try to find a solution, and the answer it gave me was 95% identical to yours.

3 answers

Your answer

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2024-05-21T08:25:25.4966667+00:00

@Dario Ruben Scanferlato - Thanks for the question and using MS Q&A platform.

Can you please click on view details and share the error message here?

Looking forward for your response.
Dario Ruben Scanferlato 20 Reputation points

2024-05-21T11:54:22.7666667+00:00

@PRADEEPCHEEKATLA There's no additional information, beside the runID of the operation

If I check this run ID on Monitor I get no additional info, besides the fact that it's a "User Configuration Error". The documentation link for the error code 8000 is not helpful
PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2024-05-22T08:17:46.7066667+00:00

@Dario Ruben Scanferlato - It looks like you are facing an error while executing a Continuous DataFlow in Azure Synapse Analytics. The error message suggests that the management job creation has failed due to some reason. This error can occur due to various reasons such as incorrect configuration settings, insufficient permissions, or network connectivity issues.

To resolve this issue, you can try the following steps:

Check if you have sufficient permissions to create a management job in the Azure Synapse Analytics instance. Ensure that you have the required role-based access control (RBAC) permissions to create and manage Data Factory resources.

Verify that the configuration settings for the Continuous DataFlow are correct. Check if the input and output datasets are configured correctly and if the mapping data flow is correctly defined.

Check if there are any network connectivity issues that might be causing the error. Ensure that the Azure Synapse Analytics instance is accessible from your network and that there are no firewall or network security group rules blocking the traffic.

If the issue persists, you can try deleting and recreating the Continuous DataFlow. This can help to resolve any configuration issues that might be causing the error.

If none of the above steps work, you may open a support ticket for further assistance.
Dario Ruben Scanferlato 20 Reputation points

2024-05-22T17:15:30.42+00:00

if I wanted an answer from an LLM, I wouldn't have asked here. Your answer is irrelevant.

EDIT: sorry for the mean comment, I'm just appalled that a Microsoft employee would give such a low effort and unhelpful answer. I'm under the impression that your only goal is to farm upvotes with the least amount of effort possible, instead of actually trying to help. Note that I also used chat GPT to try to find a solution, and the answer it gave me was 95% identical to yours.

Answer 1

Dario Ruben Scanferlato 20

Well, after re-running the tutorial setup script for the 4th time, it randomly worked.

I still get the inexplicable connection error in the 3rd and 4th screenshot, but that doesn't seem to affect the Link connection.

If anyone sumbles upon this question after a google search, I'm sorry, I don't have any solution for you. I've ran into random errors in half the tutorial exercises I've tried so far in the DP-203 course.

PRADEEPCHEEKATLA 90,641 Reputation points Moderator

2024-05-23T09:48:06.94+00:00

@Dario Ruben Scanferlato - I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

Answer 2

@Dario Ruben Scanferlato - - I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

Ask: "Continuous DataFlow execution failed" error on Link connection, while following Synapse Link tutorial?

Solution: Well, after re-running the tutorial setup script for the 4th time, it randomly worked.

If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.

Answer 3

Sheshan Doye 0

Facing Same issue with Error while starting linked-connection from Azure SQL db to Synapse :
Continuous DataFlow execution failed. Error code:'FailedToCreateMgmJob'. Error message: 'Falied to create management job, the requested operation of Data Factory 'mysynapse10'.' Continuous run ID: d76202d7-a069-499a-a7c7-b37884626e03

Didn't get resolved even after multiple retries.

What can be possible reason for above specific error?
which setting for synapse can be a issue here?

Share via

"Continuous DataFlow execution failed" error on Link connection, while following Synapse Link tutorial

3 answers

Your answer