MySQL Source Side Error in ADF

Question

MySQL Source Side Error in ADF

THULASI KUMAR MAMIDIPALLI 0

Hi Team,

We are getting the source side server failed error while running pipelines. Last few days getting this error one or two times in a day. After running the failed one manually it is running successfully.

Can you please check the below screenshot and provide the appropriate solution.

User's image

Sometimes getting the below error:

Failure happened on 'Source' side. ErrorCode=UserErrorOdbcOperationFailed,'Type=Microsoft.DataTransfer.Common.Shared.HybridDeliveryException,Message=ERROR [HY001] [Microsoft][ODBC] (10010) Memory allocation error: std::bad_alloc exception caught.,Source=Microsoft.DataTransfer.Runtime.GenericOdbcConnectors,''Type=System.Data.Odbc.OdbcException,Message=ERROR [HY001] [Microsoft][ODBC] (10010) Memory allocation error: std::bad_alloc exception caught.,Source=MySQLODBC_sb64.dll,'

Thanks

Thulasi.

THULASI KUMAR MAMIDIPALLI 0 Reputation points

2023-08-25T11:14:06.0533333+00:00

Hi Sakthi,

Thank you for your response.

MySQL database hosted on AWS cloud. And we are using Selfhosted IR.
SSingh-MSFT 16,461 Reputation points Moderator

2023-08-28T04:57:09.5733333+00:00

Hi
THULASI KUMAR MAMIDIPALLI •,

Thanks for the reply.

Ensure that the MySQL server is configured correctly. You may want to check the MySQL server configuration settings, such as the maximum memory usage and the query cache size, to ensure that they are optimized for your workload.

Since MySQL is present on AWS and the compute is used from there for source, we recommend you to raise this question over AWS community forum handing MySQL on their cloud to assist you better.

Thanks

1 answer

Your answer

THULASI KUMAR MAMIDIPALLI 0 Reputation points

2023-08-25T11:14:06.0533333+00:00

Hi Sakthi,

Thank you for your response.

MySQL database hosted on AWS cloud. And we are using Selfhosted IR.
SSingh-MSFT 16,461 Reputation points Moderator

2023-08-28T04:57:09.5733333+00:00

Hi
THULASI KUMAR MAMIDIPALLI •,

Thanks for the reply.

Ensure that the MySQL server is configured correctly. You may want to check the MySQL server configuration settings, such as the maximum memory usage and the query cache size, to ensure that they are optimized for your workload.

Since MySQL is present on AWS and the compute is used from there for source, we recommend you to raise this question over AWS community forum handing MySQL on their cloud to assist you better.

Thanks

Answer 1

Hi
THULASI KUMAR MAMIDIPALLI •,

Welcome to Microsoft Q&A forum.

As I understand, you are getting error in ADF pipeline where source is MySQL related to Memory.

Could you please let us know if the MySQL database if On-premises or on Azure?

Which Integration Runtime is in use?

What is the configuration detail of the MySQL DB?

Try to update IR setting to increase memory and retry if helps.

Also refer to Azure MySQL DB memory troubleshooting guide: https://learn.microsoft.com/en-us/azure/mysql/single-server/how-to-troubleshoot-low-memory-issues

Thanks

Share via

MySQL Source Side Error in ADF

1 answer

Your answer