ForEach/Copy Activity Error

Question

Hi All

I have a ForEach Activity, that copies data from tables in MySQL Database into tables in a Data warehouse(MySQL).
And I quite often get an error which I don't understand or know how to prevent from happening again.
I usually get the error for one or two tables in the ForEach while the other tables run successfully.

Error Code: 2200

Error Message:
'Type=MySql.Data.MySqlClient.MySqlException,Message=Failed to read the result set.,Source=MySqlConnector,''Type=System.IO.IOException,Message=Unable to read data from the transport connection: An existing connection was forcibly closed by the remote host.,Source=System,''Type=System.Net.Sockets.SocketException,Message=An existing connection was forcibly closed by the remote host,Source=System,'

Please assist with an explanation and how to prevent this from happening.

Answer 1

Hi @HimanshuSinha

Thank you for the feedback and apologies for the late response.

Yes all the tables in the ForEach start running at the same time. And yes this happens for the bigger tables. But strangely, when I receive the error and I end up not making any changes, all the tables will run as normal and successfully the following day. So I am trying to understand why we get the error and how to prevent it.

I have created a copy activity for a big table and have tried to run it, it runs successfully without giving me any error that is of course if I set a big timeout for it.

Answer 2

Hello @johannah Motshwene ,
Thanks for the ask and using the Microsoft Q&A platform .
Since you are using the foreach loop , I am assuming that the you are copying once table at a time . I am assuming that you are getting this error when you try to copy bigger tables . Can you please check this ? ( create a copy activity and select a table name which is big and try to run it .

I think increasing the timeout setting in the copy activity should help .

Please do let me know how it goes .
Thanks
Himanshu
Please do consider clicking on "Accept Answer" and "Up-vote" on the post that helps you, as it can be beneficial to other community members