Azure databricks spark UI logs

Question

what's the spark UI log history for the job ran for a cluster?

Answer 1

Hello @sakuraime ,

Thanks for the question and using MS Q&A platform.

The Spark UI is the web interface of a running Spark application to monitor and inspect Spark job executions in a web browser.

Apache Spark provides a suite of Web UI/User (aka Application UI or webUI or Spark UI) Interfaces (Jobs, Stages, Tasks, Storage, Environment, Executors, and SQL) to monitor the status of your Spark/PySpark application, resource consumption of Spark cluster, and Spark configurations.

For more details, refer to the below articles:

• View cluster information in the Apache Spark UI
• Apache – Spark Web UI
• Spark Web UI – Understanding Spark Execution

Hope this helps. Do let us know if you any further queries.

---------------------------------------------------------------------------

Please "Accept the answer" if the information helped you. This will help us and others in the community as well.