I have Managed Instance under Express Route peering Subnet, Opened Public endpoint, and provisioned port 3342 to allow public endpoint access, Linked Services are working as expected and copy activity is working great, however, when using dataflow sink is throwing following error
StatusCode":"DFExecutorUserError","Message":"Job failed due to reason: at Sink 'Group': java.lang.RuntimeException: Cannot connect to SQL database: 'jdbc:sqlserver://<servername>:3342;database=<dbname>', 'User: <username>'.[SQL Exception]Error Code:0, Error Message: The TCP/IP connection to the host <servername>.database.windows.net, port 3342 has failed. Error: \"Connection timed out: no further information.. Verify the connection properties. Make sure that an instance of SQL Server is running on the host and accepting TCP/IP connections at the port. Make sure that TCP connections to the port are not blocked by a firewall.\"., error stack:shaded.msdataflow.com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDriverError(SQLServerException.java:228)\nshaded.msdataflow.com.microsoft.sqlserver.jdbc.SQLServerException.ConvertConnectExceptionToSQLServerException(SQLServerException.java:285)\nshaded.msdataflow.com.microsoft.sq
I'm using Memory Optimized Azure Hosted IR and As far as I understand the Spark cluster is unable to see the database server/database. As I have mentioned above linked service test connection is green.
Please provide your expert advice to overcome this challenge.
Thanks in advance