September 2023 Summaries

Over the past few years, the snowplow-web dbt package has evolved significantly, offering enhancements that allow users to derive more value from their data with increased ease and speed. The latest updates focus on reducing the need for custom models by making it possible to add fields from the atomic events table directly to derived tables, such as page_views, sessions, and users, simply by setting variables. This streamlines the process that previously required creating custom models for each new field. The package introduces customizable session identifiers and a set of base macros that encapsulate core sessionization logic, providing users with the flexibility to tailor the package's functionality to their specific needs. These improvements not only enhance usability but also optimize performance, as seen in the ability to use load_tstamp for efficient session timestamping. The package aims to handle complex sessionization scenarios through manifest tables, ensuring complete and accurate processing of session data while minimizing costs. Looking ahead, the developers plan to extend these features to additional packages and explore new integrations to unify web and mobile data.

Snowplow has expanded its data collection capabilities on Microsoft Azure by introducing additional data destinations, including Databricks, Azure Synapse Analytics, Azure Fabric, and OneLake, supported by the new Snowplow Lake Loader. Unlike traditional loaders, the Lake Loader streams data to a data lake using Open Table Formats like Delta, which allows for cost-effective storage and efficient queries from compatible data warehouses. This new approach ensures well-structured data by automatically managing schema changes and supports various cloud platforms and open table formats, such as AWS, GCP, Delta, Apache Iceberg, and Apache Hudi. The Lake Loader is currently in early stages, being tested with major customers, and future developments include expanding cloud and destination support, with additional Quick Start guides and a compatible release for Snowplow's BDP Enterprise offering on Azure.

Digital analytics plays a crucial role in marketing decisions, and Google Analytics (GA) has been a longstanding tool in this domain, notably transitioning from Universal Analytics (UA) to Google Analytics 4 (GA4) in 2023. This shift has forced teams to adapt to GA4 or seek alternatives amidst challenges such as limited customer behavior insights, compliance issues, and data integration difficulties. GA4's reliance on first-party cookies faces restrictions from browsers like Safari and Firefox, leading to inaccurate user behavior tracking. Additionally, GA4's compliance with GDPR is questioned due to data processing outside the EU, prompting regulatory scrutiny and risk of fines. Alternatives like Snowplow offer more robust features, including first-party server-set cookies, real-time data streaming, and customizable data pipelines, which enhance data richness, compliance, and integration into data warehouses. These capabilities address the limitations of GA4 by offering greater control, data quality, and future-proofing of analytics strategies, as exemplified by companies like Trinny London and Autotrader, who have embraced Snowplow for more comprehensive analytics solutions.

Snowplow has introduced a "Cookie Extension Service" to address the challenges posed by Apple's Safari 16.4 update, which limits the lifetime of server-set first-party cookies to a maximum of seven days under certain conditions. This service is designed to extend the lifetime of cookies up to 400 days, thereby enhancing the ability to track customer journeys and perform accurate analyses across digital platforms. Originally known as 'ID Service', the Cookie Extension Service generates a unique browser identifier and is integrated with Snowplow's latest tracker release, version 3.15, which supports JavaScript and browser tracking. By deploying this service within the same IP space as the main web application, organizations can maintain the effectiveness of their tracking tools despite changes in tracking protection mechanisms like Safari's Intelligent Tracking Prevention (ITP). The deployment can be customized through various methods, such as API endpoints or middleware, ensuring flexibility without requiring changes to existing tracking setups.

Snowplow provides a comprehensive solution for creating a unified customer view by utilizing a structured event-tracking system that incorporates multiple user identifiers, including domain_userid, network_userid, and user_id, along with additional identifiers like user_ipaddress and user_fingerprint. This multi-identifier approach offers flexibility in user tracking, enabling analysts to conduct in-depth analyses of user behavior across sessions and sites, even as third-party cookie support diminishes. Snowplow supports advanced tracking through login events, making user identification more reliable by enabling mapping between user IDs and domain_userids, which is crucial for businesses aiming to integrate Snowplow data with their existing customer data systems. The system's ability to track user cohorts and analyze user engagement over time allows companies to accurately attribute marketing efforts and understand customer journeys, even in complex scenarios where users interact with their services across different devices or browsers.

Snowplow has been recognized as an 'Analytics & Data Capture One to Watch' in Snowflake's Modern Marketing Data Stack 2023 report, highlighting its role in enabling organizations to harness first-party customer behavioral data for real-time personalization and advanced analytics. The report, based on data from over 8,100 customers, outlines ten essential technology categories for effective marketing data stacks, emphasizing the importance of unifying, analyzing, and activating data for revenue growth. Snowplow's new offering, 'Snowplow Digital Analytics, Powered by Snowflake,' provides marketers with a real-time AI-ready data foundation while ensuring compliance and data protection. This application allows organizations to maintain full control and transparency over customer data, enhancing their ability to personalize customer interactions and leverage AI. Snowplow's collaboration with Snowflake aims to deliver best-of-breed marketing data solutions, empowering over 10,000 organizations, including notable names like Strava and Autotrader, to improve customer engagement while adhering to data governance standards.