June 2022 Summaries

Lightdash has had a busy quarter, addressing 506 issues and incorporating numerous feature requests from beta users, with a significant focus on enhancing the experience for data consumers. The recent updates emphasize charting, sharing, appearance, and discovery, including new features such as area charts, chart duplication, and view-mode for focused chart analysis. Sharing capabilities have been improved with the introduction of project level permissions and the ability to export charts in various formats, reflecting user roles and needs from larger organizations. Customization options have expanded through features like default color palettes and number formatting, allowing users to enhance the visual consistency of their dashboards. These developments, along with other enhancements like improved field search and project compilation status, are part of Lightdash's ongoing commitment to improving user experience, as detailed further in their changelog and community discussions.

User journey mapping at Lightdash revealed crucial user issues, leading to the enhancement of developer workflows for analytics engineers. This process involves defining users, mapping their tasks, and identifying pain points to solve relevant problems effectively. During a recent offsite, this method exposed previously overlooked user challenges and helped the team gain deeper insights. Specifically, the exercise highlighted inefficiencies in the developer experience, such as the lack of integration between tools and the cumbersome nature of checking changes. As a result, Lightdash aimed to improve these workflows, culminating in the launch of new features designed to address these issues. The process not only facilitated product development but also offered a structured approach for other teams to identify and tackle user challenges. Lightdash plans to prioritize future developments using the RICES framework to ensure high-impact solutions.

Lightdash introduces a novel approach to business intelligence (BI) by emphasizing the importance of self-service data access through a semantic layer that simplifies complex data queries for users. By defining metrics like "revenue" in this layer, Lightdash enables users to obtain accurate data insights without needing to understand underlying data logic or perform complicated data joins. This method, termed "The Lightdash Way," supports scalability by allowing data teams to maintain the semantic layer, ensuring that all users can access consistent and reliable data metrics. Alongside this approach, Lightdash is enhancing the productivity of Analytics Engineers by providing developer tools that integrate seamlessly with their existing workflows, such as version control and command line usage. These tools aim to improve the efficiency of building BI and reporting layers, offering features like instant developer previews, CI/CD workflows, and code generation to streamline BI project development. As part of their Demo Week, Lightdash invites users to explore these innovations and join their community for further engagement and updates.

Lightdash, a company focused on empowering users to answer data questions, introduces its new blog "Lightning Posts" alongside the launch of its first ever Demo Week. This initiative reflects their commitment to transparency and community involvement, as all product discussions and updates occur publicly on GitHub. Demo Week showcases the culmination of six weeks of development, featuring product updates and insights, and invites community feedback to influence future sprints. Despite not launching new features during Demo Week, Lightdash emphasizes early feature releases and broad announcements across multiple channels. The blog promises honest insights into building and scaling a business intelligence tool while maintaining flexibility and responsiveness in their planning process. The Demo Week schedule includes daily topics such as filters, chart creation, product planning, and dbt metrics, providing opportunities for user engagement and feedback.

Lightdash has enhanced its filtering functionalities to improve user experience and data interaction, recognizing filtering as a crucial element in data analytics for business decisions. The platform introduces a powerful and flexible filtering API that supports key features like dashboard filters, which can be applied to entire dashboards and saved for consistent views; cross-filtering, allowing users to right-click on a component of a data visualization to apply a filter across related charts; and intuitive filters in the explore view, where users can filter directly from their results table or sidebar by right-clicking on metrics or dimensions. These features aim to make filtering more integrated and user-friendly, ensuring users can easily apply filters wherever needed, enhancing the storytelling of data. The development of these features involved community feedback, with ongoing iterations to refine the experience further, inviting users to engage with Lightdash Cloud or its demo for practical exploration.

Lightdash, an open-core company, emphasizes the importance of developer experience, as the lines between contributors, users, and customers are often blurred. Recently, they introduced two improvements: more frequent, automated releases of Lightdash and faster production setups using helm charts. Automation of releases allows for smaller, frequent updates, enhancing developer satisfaction and delivering fixes and features to users quickly, while also minimizing regression bugs. The introduction of helm charts facilitates the quick installation and updating of Lightdash in Kubernetes, enabling users to secure their data and report bugs efficiently, with fixes rolled out in just two hours. This approach is also applied to manage their fully-managed Lightdash Cloud, ensuring robustness and reliability. Community feedback is encouraged, and Lightdash is actively seeking new team members.

Lightdash emerged as a pioneering business intelligence (BI) tool by supporting dbt metrics, addressing the challenges faced by modern analysts who were caught between maintaining logic in both dbt and BI tools. This integration aimed to streamline the analytics engineering workflow by using dbt as the primary source of truth for metric definitions, thus eliminating the need to sync logic across platforms. The initiative began as an experimental project called dbt2looker, which quickly evolved into Lightdash, offering a seamless development loop from raw data transformation to user-facing analytics. The concept of a "metrics layer" rapidly gained traction, heralding a new era in the data stack where metrics became integral to dbt's functionality. This evolution facilitated enhanced metric documentation, standardization, and visualization, culminating in the official launch of dbt metrics. Lightdash continues to innovate by empowering analysts to create reliable and interactive data experiences with ease, as showcased in their tutorial for building metrics using dbt and Lightdash.

Lightdash, an early-stage company, has refined its product planning process to accommodate the rapid changes typical of startups. Initially, they struggled with rigid, long-term planning that often became obsolete, but they found success with a six-week planning cycle inspired by Supabase's launch strategy. This cycle involves an initial phase of extensive planning and ideation, where they use frameworks like RICE to prioritize ideas, followed by a series of flexible breakout sessions to refine those ideas. Once priorities are set, they kick off a six-week work period where features are developed and released as they're ready. Leading up to Demo Week, the team prepares supporting content and ensures everything is ready for demonstration. Demo Week is followed by a period of rest and reflection to assess the effectiveness of the cycle and identify areas for improvement. This approach has enabled Lightdash to maintain productivity and adaptability, successfully aligning their planning with the dynamic nature of startup environments.