Azure Data Factory System.IO.IOException, an existing connection was forced close by the remote host

Anh Hoang Chu 1 Reputation point
2022-04-01T19:15:14.433+00:00

Failure happened on 'Sink' side. 'Type=Npgsql.NpgsqlException,Message=Exception while writing to stream,Source=Npgsql,''Type=System.IO.IOException,Message=Unable to write data to the transport connection: An existing connection was forcibly closed by the remote host.,Source=System,''Type=System.Net.Sockets.SocketException,Message=An existing connection was forcibly closed by the remote host,Source=System,'

I'm trying to copy a big table (~7GB, 20 mio rows) from Azure postgresql database (single server) to Azure Postgresql citus hyperscale. The connection runs for around 8 minutes before disconnect with the above error.
Currently, I'm using AutoResolveIntegrationRuntime (East US) for both connections.

The same error is happening with AWS RDS postgresql DB (table is around a few GB) to Azure postgresql citus hyperscale. Pipeline runs for 7 mins before timeout

Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
9,766 questions
{count} votes