While running SQL query in Azure Databricks workspace i.e. on SQL warehouse as well as on UC enabled shared cluster facing an SSL handshake error

Ashwini Gaikwad 130

Hello Team,

We have UC enabled Azure databricks workspace, also the Public access and delta sharing is disabled on our workspace. So while running the below SQL query on SQL Warehouse as well as on UC enabled shared cluster, I am receiving an error.

Please find the query ran on notebook and the error below for your reference

%sql

select workspace_id, entity_id from system.access.table_lineage where entity_type in ('NOTEBOOK') and source_table_catalog != 'system' and source_table_catalog in ('main','test_d') and target_table_catalog in ('main','test_d')

FileReadException: Error while reading file delta-sharing:/91a41d8e4d35b3bdebb6ecdcca04089f166a2fd59888ba6fc39d0fe8563a4a49.uc-deltasharing%253A%252F%252Fsystem.access.table_lineage%2523system.access.table_lineage_20240628_090343_466a14b8/xxxxxxxxxxxxxxxxxxxxxxxxxxxxx/3391xxxxx. Caused by: SSLHandshakeException: Remote host terminated the handshake Caused by: EOFException: SSL peer shut down incorrectly

Request you to please let me know how to resolve this issue.

Regards,

Ashwini Gaikwad

PRADEEPCHEEKATLA 90,226 Reputation points

2024-06-28T11:36:21.7766667+00:00

@Ashwini Gaikwad - Thanks for the question and using MS Q&A platform.

Based on the information you provided, it seems like you are encountering an SSL handshake error in Azure Databricks when running your SQL query. This error can be caused by several factors, including network configuration, certificate issues, cluster configuration, and delta sharing settings.

To troubleshoot and potentially resolve the issue, you can follow these steps:

Step 1: Check Network Configuration Ensure that your network settings allow outgoing SSL connections to the Azure Databricks endpoints. You may need to update firewall rules or network security groups.

Step 2: Update Certificates If there are updates or patches available for Azure Databricks, apply them. Ensure that the certificates used for SSL connections are current.

Step 3: Verify Cluster Configuration Review the cluster configuration to ensure there are no conflicting settings. You can try restarting the cluster to apply any new configurations.

Step 4: Review Delta Sharing Configuration Since delta sharing is disabled, make sure your query and environment are not referencing delta-sharing settings that could be causing the issue.

If none of the above step's work, it is possible that Azure Databricks is blocking the system to connect to the server. In this case, you may need to open a support ticket for further assistance.

I hope this helps! Let me know if you have any further questions.
Ashwini Gaikwad 130 Reputation points

2024-06-28T12:13:51.81+00:00

Hello @PRADEEPCHEEKATLA Thank you for your email.

Step1 : Which specific network setting of firewall or nsg rule need to be in place so that to allow outgoing SSL connections to the Azure Databricks endpoints. Can you share some reference article?

Step 2: Update Certificates If there are updates or patches available for Azure Databricks, apply them. Ensure that the certificates used for SSL connections are current - We have not uploaded any specific certificate manually, is there a need of it? can you share the reference article for the steps to follow.

Step 3: Done

Step 4: Review Delta Sharing Configuration Since delta sharing is disabled, make sure your query and environment are not referencing delta-sharing settings that could be causing the issue. - If you see the sql query which I mentioned in the question, I am not requesting/sharing anything related to delta-sharing settings.

Regards,

Ashwini Gaikwad
PRADEEPCHEEKATLA 90,226 Reputation points

2024-07-01T05:39:55.8333333+00:00

@Ashwini Gaikwad - I agree that this issue looks strange and I wasn't able to reproduce this issue. If you have a support plan could you please file a support ticket for deeper investigation and do share the SR# with us?
PRADEEPCHEEKATLA 90,226 Reputation points

2024-07-03T08:38:10.9533333+00:00

@Ashwini Gaikwad - Did you get a chance to open a support ticket?
Ashwini Gaikwad 130 Reputation points

2024-07-03T08:41:38.42+00:00

@PRADEEPCHEEKATLA yes I have created a support ticket, thank you for your assistance.
PRADEEPCHEEKATLA 90,226 Reputation points

2024-07-08T02:42:49.3866667+00:00

@Ashwini Gaikwad - Could you please share the supoort ticket number to track internally?
Ashwini Gaikwad 130 Reputation points

2024-07-08T08:09:13.11+00:00

@PRADEEPCHEEKATLA the issue is resolved now by adding the route table for system table storage url ucstprdwesteu.dfs.core.windows.net on adbpublic subnet since public access was disabled on our databricks
PRADEEPCHEEKATLA 90,226 Reputation points

2024-07-08T09:33:11.2333333+00:00

@Ashwini Gaikwad - I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

Accepted answer

PRADEEPCHEEKATLA 90,226 Reputation points

2024-07-08T09:32:50.1+00:00

@Ashwini Gaikwad - I'm glad that you were able to resolve your issue and thank you for posting your solution so that others experiencing the same thing can easily reference this! Since the Microsoft Q&A community has a policy that "The question author cannot accept their own answer. They can only accept answers by others ", I'll repost your solution in case you'd like to accept the answer .

Ask: While running SQL query in Azure Databricks workspace i.e. on SQL warehouse as well as on UC enabled shared cluster facing an SSL handshake error

Solution: The issue is resolved by adding the route table for system table storage url ucstprdwesteu.dfs.core.windows.net on adbpublic subnet since public access was disabled on our databricks

If I missed anything please let me know and I'd be happy to add it to my answer, or feel free to comment below with any additional information.

If you have any other questions, please let me know. Thank you again for your time and patience throughout this issue.

Please don’t forget to Accept Answer and Yes for "was this answer helpful" wherever the information provided helps you, this can be beneficial to other community members.
Please sign in to rate this answer.

0 comments No comments
Sign in to comment

Use comments to ask for clarification, additional information, or improvements to the question.

Share via

While running SQL query in Azure Databricks workspace i.e. on SQL warehouse as well as on UC enabled shared cluster facing an SSL handshake error

0 additional answers

Your answer