Azure SQL Database Error Connection Timed Out

Question

We are trying to store results into azure sql db , through executing a code in Ataccama Application(Hosted on Azure Servers), we are getting the below error:

Note that azure sql db and Ataccama azure servers are on different subscription.

FATAL]    Problem closing JDBCWriter's WriterRunner: 'Connection timed out (Read failed)'.[STEP Component/dq_results_detail[Jdbc Writer]]
com.microsoft.sqlserver.jdbc.SQLServerException: Connection timed out (Read failed)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.terminate(SQLServerConnection.java:3422)
	at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2066)
	at com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6616)
	at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7804)
	at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7767)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection$1ConnectionCommand.doExecute(SQLServerConnection.java:3530)
	at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7417)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:3488)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.connectionCommand(SQLServerConnection.java:3534)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.commit(SQLServerConnection.java:3710)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.commit(SQLServerConnection.java:3688)
	at com.ataccama.dqc.commons.sql.decorator.ConnectionDecorator.commit(ConnectionDecorator.java:72)
	at com.ataccama.dqc.commons.sql.decorator.ConnectionDecorator.commit(ConnectionDecorator.java:72)
	at com.ataccama.dqc.commons.sql.impl.TransactionalConnectionImpl.commitTransaction(TransactionalConnectionImpl.java:35)
	at com.ataccama.dqc.io.jdbc.writer.AbstractCommitStrategy.commitOrRollback(AbstractCommitStrategy.java:122)
	at com.ataccama.dqc.io.jdbc.writer.BatchWriter.flush(BatchWriter.java:98)
	at com.ataccama.dqc.io.jdbc.writer.JdbcTableWriter.close(JdbcTableWriter.java:129)
	at com.ataccama.dqc.tasks.io.jdbc.write.JdbcWriterInstance$WriterRunner.run(JdbcWriterInstance.java:252)
	at com.ataccama.dqc.commons.threads.ThreadSet$1.run(ThreadSet.java:51)
	at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.net.SocketException: Connection timed out (Read failed)
	at java.base/java.net.SocketInputStream.socketRead0(Native Method)
	at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:168)
	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)
	at com.microsoft.sqlserver.jdbc.TDSChannel$ProxyInputStream.readInternal(IOBuffer.java:1023)
	at com.microsoft.sqlserver.jdbc.TDSChannel$ProxyInputStream.read(IOBuffer.java:1013)
	at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:484)
	at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:478)
	at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70)
	at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1455)
	at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1066)
	at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2058)
	... 18 more
16.06.2023 02:46:11 [FATAL]    Task execution failed: Connection timed out (Read failed)[STEP Component/dq_servicenow[SQL Execute]]
com.microsoft.sqlserver.jdbc.SQLServerException: Connection timed out (Read failed)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.terminate(SQLServerConnection.java:3422)
	at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2066)
	at com.microsoft.sqlserver.jdbc.TDSReader.readPacket(IOBuffer.java:6616)
	at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7804)
	at com.microsoft.sqlserver.jdbc.TDSCommand.startResponse(IOBuffer.java:7767)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection$1ConnectionCommand.doExecute(SQLServerConnection.java:3530)
	at com.microsoft.sqlserver.jdbc.TDSCommand.execute(IOBuffer.java:7417)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.executeCommand(SQLServerConnection.java:3488)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.connectionCommand(SQLServerConnection.java:3534)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.commit(SQLServerConnection.java:3710)
	at com.microsoft.sqlserver.jdbc.SQLServerConnection.commit(SQLServerConnection.java:3688)
	at com.ataccama.dqc.commons.sql.decorator.ConnectionDecorator.commit(ConnectionDecorator.java:72)
	at com.ataccama.dqc.commons.sql.decorator.ConnectionDecorator.commit(ConnectionDecorator.java:72)
	at com.ataccama.dqc.commons.sql.impl.TransactionalConnectionImpl.commitTransaction(TransactionalConnectionImpl.java:35)
	at com.ataccama.dqc.io.jdbc.writer.AbstractCommitStrategy.commitOrRollback(AbstractCommitStrategy.java:122)
	at com.ataccama.dqc.io.jdbc.writer.BatchWriter.flush(BatchWriter.java:98)
	at com.ataccama.dqc.tasks.jdbc.execute.SqlExecuteQueryProcessor.finish(SqlExecuteQueryProcessor.java:115)
	at com.ataccama.dqc.tasks.jdbc.execute.SQLStepInstanceBase$SimpleProcessingStrategy.run(SQLStepInstanceBase.java:271)
	at com.ataccama.dqc.tasks.jdbc.execute.SQLStepInstanceBase.run(SQLStepInstanceBase.java:148)
	at com.ataccama.dqc.processor.internal.runner.ComplexStepNode.runNode(ComplexStepNode.java:69)
	at com.ataccama.dqc.processor.internal.runner.RunnableNode.run(RunnableNode.java:28)
	at com.ataccama.dqc.commons.threads.AsyncExecutor$RunningTask.run(AsyncExecutor.java:135)
	at java.base/java.lang.Thread.run(Thread.java:829)
Caused by: java.net.SocketException: Connection timed out (Read failed)
	at java.base/java.net.SocketInputStream.socketRead0(Native Method)
	at java.base/java.net.SocketInputStream.socketRead(SocketInputStream.java:115)
	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:168)
	at java.base/java.net.SocketInputStream.read(SocketInputStream.java:140)
	at com.microsoft.sqlserver.jdbc.TDSChannel$ProxyInputStream.readInternal(IOBuffer.java:1023)
	at com.microsoft.sqlserver.jdbc.TDSChannel$ProxyInputStream.read(IOBuffer.java:1013)
	at java.base/sun.security.ssl.SSLSocketInputRecord.read(SSLSocketInputRecord.java:484)
	at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(SSLSocketInputRecord.java:478)
	at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(SSLSocketInputRecord.java:70)
	at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(SSLSocketImpl.java:1455)
	at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(SSLSocketImpl.java:1066)
	at com.microsoft.sqlserver.jdbc.TDSChannel.read(IOBuffer.java:2058)
	... 21 more
16.06.2023 02:46:11 [FATAL]    Error when disposing resource
com.ataccama.dqc.model.environment.AbortedExecutionException
	at com.ataccama.dqc.model.internal.modelimpl.AbortableFileSystem.checkAbortAndClose(AbortableFileSystem.java:64)
	at com.ataccama.dqc.model.internal.modelimpl.AbortableFileSystem$AbortableOutputStream.write(AbortableFileSystem.java:203)
	at java.base/java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81)
	at java.base/java.io.BufferedOutputStream.flush(BufferedOutputStream.java:142)
	at java.base/java.io.FilterOutputStream.close(FilterOutputStream.java:182)
	at com.ataccama.dqc.io.data.grouping.ClusteringKeyGrouper.closeSplitStreams(ClusteringKeyGrouper.java:432)
	at com.ataccama.dqc.io.data.grouping.ClusteringKeyGrouper.close(ClusteringKeyGrouper.java:142)
	at com.ataccama.dqc.io.data.grouping.KeyGrouper.close(KeyGrouper.java:70)
	at com.ataccama.dqc.tasks.common.group.KeyGroupingStrategy$TheGrouper.dispose(KeyGroupingStrategy.java:97)
	at com.ataccama.dqc.model.internal.modelimpl.ProcessContextInternal.stop(ProcessContextInternal.java:139)
	at com.ataccama.dqc.processor.internal.runner.RuntimeModel.stop(RuntimeModel.java:139)
	at com.ataccama.dqc.processor.engine.ProcessorEngine$Runner.stop(ProcessorEngine.java:229)
	at com.ataccama.dqd.internal.engine.process.dqc.DqdLocalPlanExecutor.dispose(DqdLocalPlanExecutor.java:110)
	at com.ataccama.dqd.internal.engine.process.dt.PlanDataOutputFactoryProvider$DqdPlanDataOutputFactory$PlanDataOutputRtm.run(PlanDataOutputFactoryProvider.java:161)
	at com.ataccama.dqd.internal.engine.process.tasks.DqcOutputPlanTask.run(DqcOutputPlanTask.java:46)
	at com.ataccama.dqd.internal.engine.process.tasks.DqcOutputPlanTask.run(DqcOutputPlanTask.java:29)
	at com.ataccama.dqd.pipeline.executor.eval.ExecutorDqdEvalProcessorBase.evaluate(ExecutorDqdEvalProcessorBase.java:250)
	at com.ataccama.dqd.pipeline.executor.eval.ExecutorDqdEvalProcessorBase.evaluateAndDisposeModel(ExecutorDqdEvalProcessorBase.java:149)
	at com.ataccama.dqd.pipeline.executor.eval.ExecutorDqdEvalProcessorBase.evaluate(ExecutorDqdEvalProcessorBase.java:142)
	at com.ataccama.dqd.pipeline.executor.eval.ExecutorDqdEvalProcessorBase.evaluateSystem(ExecutorDqdEvalProcessorBase.java:116)
	at com.ataccama.dqd.pipeline.executor.eval.ExecutorDqdEvalProcessorBase.evaluate(ExecutorDqdEvalProcessorBase.java:90)
	at com.ataccama.dqd.pipeline.executor.eval.DqdEvalLocalRuntime.run(DqdEvalLocalRuntime.java:35)
	at com.ataccama.dqc.hadoop.launch.LaunchModelRL.run(LaunchModelRL.java:54)
	at com.ataccama.dqc.hadoop.runner.RemoteRunnerBase.startJob(RemoteRunnerBase.java:113)
	at com.ataccama.dqc.hadoop.runner.RemoteRunnerBase.doRun(RemoteRunnerBase.java:92)
	at com.ataccama.dqc.hadoop.runner.RemoteRunnerBase.run(RemoteRunnerBase.java:60)
	at com.ataccama.dqc.commons.launch.RunnerMain.run(RunnerMain.java:92)
	at com.ataccama.dqc.commons.launch.RunnerMain.run(RunnerMain.java:84)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:566)
	at com.ataccama.dqc.commons.launch.RunnerMain.loadCpAndRun2(RunnerMain.java:75)
	at com.ataccama.dqc.commons.launch.RunnerMain.main(RunnerMain.java:48)

Answer 1

@Munot, Sneha Welcome to the Microsoft Q&A platform, thanks for posting the question

The error you are seeing may be related to the fact that the Azure SQL Database and the Ataccama application are on different subscriptions. By default, Azure SQL Database is configured to only allow connections from within the same subscription or from a trusted Azure service.

To allow connections from the Ataccama application, you will need to configure the firewall settings for the Azure SQL Database to allow traffic from the IP address of the Ataccama application.

Regards

Geetha