Developing with OpenAI and Observability

Honeycomb introduced a new Query Assistant feature that leverages ChatGPT to generate queries from natural language questions, with tracing built into its development from the outset to ensure smooth operation. The development team, including Tanya Romankova and Craig Atkinson, focused on enhancing visibility into how the feature operates, especially concerning the time taken by different processes. For instance, they discovered that while the API call to ChatGPT took 840ms, additional steps such as constructing the prompt and truncating the list of fields accounted for significant delays, leading them to implement optimizations. Through observability, they improved the feature's performance by refining these processes, demonstrating how such insights can enhance development and maintain visibility in production. The announcement encourages users to explore this feature by signing up for Honeycomb.