December 2022 Summaries

Over the past six months, the team has significantly enhanced the performance and reliability of their Replay tool, increasing the P50 Butter Score from 30 to 90, with 43% of replays starting in 15 seconds and resolving requests in under 2 seconds. Key improvements include parallelization with Turbo Replay, integration of low-level libraries like Snappy and Avro, and caching of expensive operations. While acknowledging that challenges remain, the focus is on further increasing the reliability of debugging sessions. The team is transitioning to Chrome for Mac and Windows, reimagining React DevTools, and exploring advanced features like assisted debugging and time-travel debugging, aiming to make these innovative solutions mainstream. Additionally, Replay is improving its blog platform and enhancing features like source maps and autocomplete suggestions, with the broader goal of making time-travel debugging a practical, everyday tool.

A recent post detailed the process of debugging GitHub's authentication flow to programmatically manage pull request checks, initially outlining a seven-step method involving creating an app, private key, JWT, and token. Despite this complexity, a more streamlined approach was discovered after consulting with Gregor, a developer of the octokit SDK, which reduced the process to four steps using the @octokit/app package. This simplified method involves creating an app, fetching the installation ID, and creating an octokit instance for the installation, enabling easier interaction with GitHub repositories. The post provides a JavaScript code example demonstrating how to fetch issues from a specified repository using this more efficient approach.

Replay is developing a time-travel debugger for JavaScript, specifically targeting the challenge of intermittent browser test failures by working on a side project called Replay Visuals. This project, hosted on Vercel and backed by Supabase, aims to save snapshots from browser test runs and streamline the workflow for approving visual regressions. A significant challenge encountered was managing GitHub Check Runs, as they can only be handled via GitHub Apps rather than personal tokens. This necessitated the creation of a GitHub App to generate a JSON Web Token (JWT) and subsequently a token for the Check Run. The process involved overcoming hurdles with JWT creation, such as ensuring correct time calculations and avoiding expiration-related errors by setting an expiration 9 minutes in the future. Despite the availability of GitHub's Octokit library for authentication, the developers found it more effective to break the problem into smaller parts rather than relying on the library, suggesting that Octokit could enhance its setup process with better error messages and troubleshooting documentation.

Replay Builder has been launched, offering users the ability to create unlimited apps without token limits, featuring flat pricing and production-ready capabilities. This new tool allows for extensive app development without restrictions, enabling users to build as much as they desire for a single price. The announcement was part of a series of updates, including insights from organizing the Vibe coding contest and the introduction of Nut as a paid service.

The release of the Cypress panel marks an advancement in debugging capabilities for users working with the Cypress plugin, featuring test steps, assertions, and network events that enhance the debugging experience. This new panel is the third framework integration following React and Redux, reflecting the importance of understanding test failures in CI environments. The discussion also touches upon the potential of AI, particularly ChatGPT, in aiding software development by enhancing debugging processes with features like print statement analysis. Additional updates include a newly built comments editor with enhanced collaboration features, improvements to source search, and a re-engineered stepping state machine for more precise navigation in time-travel debugging.