Error on sink data to MySQL - communications link failure

2024-09-19T11:24:37.3633333+00:00

I've got a Pipeline with some Data Flow activities that runs in parallel.

User's image

I've got the error on last night's execution and I'd like some help to understand why and how to prevent it from happenning.

Job failed due to reason: at Sink 'EnviaFerias': Communications link failure The last packet successfully received from the server was 7,905,186 milliseconds ago. The last packet sent successfully to the server was 7,905,186 milliseconds ago."

All dataflows have the same standard:

  1. Source Activity: Get data from a SQL Server dataset using a query
  2. Order Activity: define received data order using column RegisterDate
  3. AlterRow Activity: to INSERT, UPDATE or DELETE data based on key column ID
  4. Sink Acitivy: to sendo transformed data into MySQL

Error happened on marked line below.

User's image

User's image

User's image

All other dataflows runned successfully.

Also, would it be possible to run only those that failed instead of the entirely Pipeline?

Best Regards.

Azure Database for MySQL
Azure Database for MySQL
An Azure managed MySQL database service for app development and deployment.
830 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
10,722 questions
{count} votes

Accepted answer
  1. Smaran Thoomu 16,005 Reputation points Microsoft Vendor
    2024-09-25T18:42:24.4733333+00:00

    Hi @Joffre L. A. Mota (LG lugar de gente)
    I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others "I'll repost your solution in case you'd like to accept the answer.

    Ask: I've got a Pipeline with some Data Flow activities that runs in parallel.

    User's image

    I've got the error on last night's execution and I'd like some help to understand why and how to prevent it from happenning.

    Job failed due to reason: at Sink 'EnviaFerias': Communications link failure The last packet successfully received from the server was 7,905,186 milliseconds ago. The last packet sent successfully to the server was 7,905,186 milliseconds ago."

    All dataflows have the same standard:

    1. Source Activity: Get data from a SQL Server dataset using a query
    2. Order Activity: define received data order using column RegisterDate
    3. AlterRow Activity: to INSERT, UPDATE or DELETE data based on key column ID
    4. Sink Acitivy: to sendo transformed data into MySQL

    Error happened on marked line below.

    User's image

    User's image

    User's image

    All other dataflows runned successfully.

    Also, would it be possible to run only those that failed instead of the entirely Pipeline?

    Solution: I've solved it by using "PURGE BINARY LOG" at MySQL.

    If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

    If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.


    Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members

    0 comments No comments

1 additional answer

Sort by: Most helpful
  1. 2024-09-24T18:48:38.0333333+00:00

    Hello, @Smaran Thoomu . Sorry for the delay.

    I've solved it by using "PURGE BINARY LOG" at MySQL.

    1 person found this answer helpful.

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.