How to debug Livy server is not responding and is there any dependency to install

Mamidela Dinesh Kumar 0 Reputation points
2023-01-20T06:56:51.32+00:00

I am trying to submit a simple py file to Apache Spark Job definition to print("Hello World") but always get "Failed to submit the spark Job"

Here is the Error:

Screenshot_20230120_122142

Please help me with this.

Thank you.

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,380 questions
{count} votes

1 answer

Sort by: Most helpful
  1. Dimple Rane 921 Reputation points MVP
    2023-01-20T07:05:53.1066667+00:00

    there may be an issue with your connection to the Livy server. Some things you can try include:

    • Double checking that the Livy server is running and that your Spark job is configured to connect to the correct endpoint
    • Verify that your network is configured correctly and that there are no firewalls blocking the connection
    • Check the Livy server logs for any error messages that may provide more information about the issue

    Also, you might need to check if the livy endpoint is correct and if you have the correct version of livy installed and configured for your environment.

    0 comments No comments

Your answer

Answers can be marked as Accepted Answers by the question author, which helps users to know the answer solved the author's problem.