Home / Companies / Onehouse / Blog / Post Details
Content Deep Dive

How to Access the Spark UI on Databricks (Step by Step)

Blog post from Onehouse

Post Details
Company
Date Published
Author
-
Word Count
1,350
Company Posts That Month
22
Language
English
Hacker News Points
-
Post removed?
No
Summary

Apache Spark UI is Databricks’ primary interface for examining Spark application behavior, including jobs, stages, tasks, executors, SQL queries, cached data, and configuration, making it useful for diagnosing slow or failed workloads. It is available only on classic all-purpose and job compute, not on serverless compute, SQL warehouses, or Databricks Free Edition, where query profiles and cell-level performance views provide alternatives. Users can access it through the Compute page for all-purpose clusters, from a notebook’s Spark Jobs details for a specific cell, or from a job run’s Compute section for scheduled tasks, provided they have the necessary compute or job permissions. Spark UI history can remain accessible after a cluster terminates, but restarting replaces prior history and terminated compute may be deleted after 30 days unless retained, so log delivery is recommended for longer-term records. Its main tabs expose execution timing, failed jobs, shuffle activity, memory and executor metrics, query plans, and specialized information for streaming, JDBC/ODBC, and Spark Connect workloads.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
Serverless 5 1,363 319 106 +11%
Real-time 3 4,128 1,085 233 -15%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.