Gateway issue in ADF via on premise integration runtime

Question

Gateway issue in ADF via on premise integration runtime

Thibaut MOEBS 0

Hello,

We regularly have connection issue in our Azure Data Factory when getting data through on premise integration runtime.

DM_GWPipeline_Gateway_DataSourceAccessError

This error is intermittent and happens several times by week on our 3 environments.

Technical details :

Environments : Development area, bench area, Production area
Datasources : SQL Azure (France Central Region)
Gateway type : On-Premise Data Gateway
Gateway version :
- Dev / bench : 3000.258.5 (last version)
  - Production : 3000.230.14 (to be updated this evening)
  - Authentification type : SQL Database Connection (SQL User)
  - Error message :

{"error":{"code":"DM_GWPipeline_Gateway_DataSourceAccessError","pbi.error":{"code":"DM_GWPipeline_Gateway_DataSourceAccessError","parameters":{},"details":[],"exceptionCulprit":1}}}

Last error datetime :
- PRD : 26/03/2025, 07:48:27 (Heure de Paris)
  - DEV : 25/03/2025, 10:51:31 (Heure de Paris)

Tests et observations :

We have updated the gateway on Dev and Preprod, but the issue persists
The issue is happening on the 3 environments randomly
SQL Azure Datasource is available
Data refresh is working normally most of time

Linked files :

Gateway logs of Development environment (on which last gateway version is installed)
Gateway logs of Production environment (Old version is installed)

Help assistance :

We would like to understand the root cause of this error and get recommandations to avoid those interruptions

DM_GWPipeline_Gateway_DataSourceAccessError

This error is intermittent and happens several times by week on our 3 environments.

Technical details :

Environments : Development area, bench area, Production area
Datasources : SQL Azure (France Central Region)
Gateway type : On-Premise Data Gateway
Gateway version :
- Dev / bench : 3000.258.5 (last version)
  - Production : 3000.230.14 (to be updated this evening)
  - Authentification type : SQL Database Connection (SQL User)
  - Error message :

{"error":{"code":"DM_GWPipeline_Gateway_DataSourceAccessError","pbi.error":{"code":"DM_GWPipeline_Gateway_DataSourceAccessError","parameters":{},"details":[],"exceptionCulprit":1}}}

Last error datetime :
- PRD : 26/03/2025, 07:48:27 (Heure de Paris)
  - DEV : 25/03/2025, 10:51:31 (Heure de Paris)

Tests et observations :

We have updated the gateway on Dev and Preprod, but the issue persists
The issue is happening on the 3 environments randomly
SQL Azure Datasource is available
Data refresh is working normally most of time

Linked files :

Gateway logs of Development environment (on which last gateway version is installed)
Gateway logs of Production environment (Old version is installed)

Help assistance :

We would like to understand the root cause of this error and get recommandations to avoid those interruptions

Rakesh Govindula 965 Points de réputation Personnel externe Microsoft

2025-04-02T10:41:22.6066667+00:00
Hello @Thibaut MOEBS,

This issue appears to be an intermittent connectivity problem between Azure Data Factory (ADF) and your SQL Azure database through the On-Premise Data Gateway. Since it affects all three environments and persists even after updating the gateway, here are some possible root causes and recommendations:

Possible Causes

Network Connectivity Issues

The gateway relies on outbound connections to Azure services. If there are temporary network disruptions, packet loss, or latency issues, this could cause intermittent failures.

If your firewall, proxy, or VPN setup changes dynamically, it could block or delay traffic.

On-Premise Data Gateway Overload

If multiple queries or refreshes are running simultaneously, the gateway might struggle to handle the load, leading to failures.

CPU, memory, or network constraints on the gateway server could contribute to this issue.

Gateway Configuration Issues

Incorrect data source credentials or outdated authentication tokens may sometimes cause failures.

If you use multiple gateways in a cluster, there could be issues with failover or load balancing.

Azure SQL Throttling

If your Azure SQL Database is under heavy load, it might throttle connections, leading to intermittent failures.

Look at Azure SQL DTU/CPU usage and connection limits.

Try the below settings in your environment:

Check Network Stability

Run traceroute (tracert) and ping tests from the gateway server to Azure SQL (France Central).

Ensure the gateway server can reach Azure Data Factory endpoints without packet loss.

Whitelist the required Azure Data Factory and SQL endpoints in your firewall.

Review Gateway Logs

Look for errors related to timeouts, authentication failures, or connection resets.

Cross-check timestamps of failures with network/firewall logs.

Monitor Gateway Server Performance

Check CPU, memory, and disk usage on the machine hosting the gateway.

If high utilization is observed, consider dedicating a separate machine for the gateway.

Enable High Availability Mode (if applicable)

If you are using a single On-Premise Gateway, consider setting up a cluster for load balancing.

Check Azure SQL Logs

Review Azure SQL diagnostic logs to identify if the failures correspond to throttling or maintenance events.

Hope this information helps.

Partager via

Gateway issue in ADF via on premise integration runtime

Votre réponse