Azure Data Factory System.IO.IOException, an existing connection was forced close by the remote host
Failure happened on 'Sink' side. 'Type=Npgsql.NpgsqlException,Message=Exception while writing to stream,Source=Npgsql,''Type=System.IO.IOException,Message=Unable to write data to the transport connection: An existing connection was forcibly closed by the remote host.,Source=System,''Type=System.Net.Sockets.SocketException,Message=An existing connection was forcibly closed by the remote host,Source=System,'
I'm trying to copy a big table (~7GB, 20 mio rows) from Azure postgresql database (single server) to Azure Postgresql citus hyperscale. The connection runs for around 8 minutes before disconnect with the above error.
Currently, I'm using AutoResolveIntegrationRuntime (East US) for both connections.
The same error is happening with AWS RDS postgresql DB (table is around a few GB) to Azure postgresql citus hyperscale. Pipeline runs for 7 mins before timeout