December 2018 Summaries

Retention analysis, often called survival analysis, is crucial for understanding and enhancing user retention alongside new-user acquisition metrics, ensuring that user growth translates into a sustainable and profitable customer base. While acquiring new users is initially exciting and prioritized, it is essential to analyze why customers continue to engage with a product, as neglecting this can lead to financial losses if acquisition costs surpass customer lifetime value (LTV). Product teams can leverage retention analysis to understand customer behaviors, segment users into cohorts, and compare retention rates to improve their strategies, such as determining how long different personas stick around, evaluating recent product changes, and measuring the impact of acquisition sources on retention. By defining meaningful retention goals, tracking in-app user behavior, and segmenting data by cohorts or acquisition sources, teams can identify key factors that influence retention and refine their approaches to boost user engagement and profitability. Additionally, measuring retention trends over time and analyzing engagement events provide insights into the quality of user retention, allowing product teams to focus on aspects that drive early user achievements and long-term customer loyalty.

Mixpanel has faced challenges in scaling its infrastructure to accommodate the growing data analysis needs of its customers, which include over 26,000 businesses and 9 trillion data points per year. To ensure quick and cost-effective insights, the company developed a distributed, column-oriented database called Arb. The scalability of Mixpanel's infrastructure has been a competitive advantage, and maintaining this edge is crucial. A unique aspect of their data workload is the flexibility of queries and data, allowing customers to perform complex real-time queries with mixed-type data schemas. Performance bottlenecks were identified in the query engine, particularly with filter performance, prompting Mixpanel to implement optimizations like vectorization and predicate pushdown, inspired by other high-scale analytics databases. By modifying its query engine to process batches of events, Mixpanel achieved a 2x improvement in query throughput for large queries. Despite the challenge of variable data types, Mixpanel inferred the required data types from queries to enable vectorization, converting mixed-type properties into uniformly typed predicates to improve performance. These enhancements have resulted in faster query latencies and better pricing models for customers, highlighting Mixpanel's commitment to delivering reliable and efficient data analysis experiences.

A North Star metric is a crucial measurement that predicts a company's long-term success by leading to revenue, reflecting customer value, and measuring progress. Coined by startup investor Sean Ellis, it aims to align all departments towards a common goal, reducing administrative tasks and fostering growth. While effective in driving focus and transparency, a North Star metric is not a singular solution, as companies may need to use metric trees to map input metrics to their North Star, aiding in strategic decision-making. Unlike "The One Metric That Matters," which targets short-term projects, a North Star is a long-term guide, adaptable over time as business priorities shift. The implementation of these metrics requires the right company culture, infrastructure, and analytics platforms to ensure meaningful insights and actions. As businesses evolve, periodically reevaluating their North Star metric ensures continuous alignment with growth objectives.

Mobile app install tracking is a crucial metric for companies to assess the success of their marketing efforts by attributing downloads to specific campaigns, such as digital ads. However, measuring installs is challenging due to the fragmented nature of app stores and the complexity of user journeys, leading companies to rely on tracking partners. While knowing the number of installs is important for understanding user acquisition, it doesn't necessarily indicate an app's success unless paired with engagement metrics like retention and conversion rates. Increasingly costly digital advertising has heightened the importance of app install data, enabling teams to refine their marketing strategies and target ads more effectively. Examples from companies like Lemonade, Grabr, and Viber illustrate how effective tracking and analytics can drive user engagement and growth by optimizing user experiences and targeting specific markets. As a result, many teams use user analytics platforms to efficiently gather data from various app stores and advertising platforms, helping them to produce accessible reports and make informed decisions.