Data Observability for Petabyte-Scale Game Telemetry

2K Games, a leading video game publisher, harnesses a vast amount of telemetry data from its popular franchises to enhance game development, marketing, and player experience. The data collected, ranging from player interactions to purchasing behaviors, is critical for making informed decisions but presents challenges in volume, velocity, and visibility. To address these issues, 2K implemented Soda Cloud, a platform providing real-time data observability and anomaly detection, enabling proactive management of data quality and reducing false positives that plagued their previous system. This transition has allowed 2K to maintain a high standard of data accuracy, improve operational efficiency, and better align marketing and engineering efforts. The integration of Soda Cloud has also facilitated the creation of a centralized dashboard for monitoring data quality, thereby preventing data issues from reaching consumers and fostering a culture of proactive problem-solving. Looking forward, 2K aims to expand its data governance and develop ML observability capabilities to further enhance its data strategy, leveraging Soda's tools for automated reporting and data contract implementation.