P99 CONF 2025 Recap: Latency to LLMs

P99 CONF 2025, hosted by Tim Koopmans, showcased a series of talks from global engineers on improving system performance, with a particular focus on reducing latency, especially P99 latency. The conference covered a wide array of topics, including modern systems programming, database and storage innovations, and the burgeoning role of artificial intelligence in vector search and large language models (LLMs). Key highlights included presentations by PayPal and TigerBeetle on managing unpredictable latency outliers, ScyllaDB's low-latency vector search engine, and discussions on performance engineering and testing. The prominence of the Rust programming language was notable, with several projects highlighted for their use of Rust to optimize performance, though Go and C++ also featured. Noteworthy presentations included Chip Huyen's keynote on optimizing LLM inference and discussions on AI-assisted analytics, underscoring the conference's focus on cutting-edge advancements in technology. The event concluded with acknowledgments to the organizers and the community, highlighting the collaborative spirit of the participants and their contributions to the field.