March 2026 Summaries

Pinecone has developed a system named Janitor to efficiently manage and delete stale and orphaned data objects in their immutable blob storage infrastructure, which helps reduce storage costs. The immutable design means each write operation creates a new file rather than modifying existing ones, leading to an accumulation of unnecessary data that cannot be immediately deleted without risking service reliability. Janitor addresses this problem by categorizing deletions into three modes—normal, orphan, and customer deletion—each with its own safety protocols and timing to ensure data is safely removed. The system operates on a protocol of identify, verify, and execute, ensuring only verified data is deleted, and it employs a conservative approach to minimize errors. Janitor's robust testing framework uses property-based tests and a mock clock to simulate long-term behavior in seconds, enabling quick identification and resolution of bugs. The implementation of Janitor has made data deletion at Pinecone more predictable and auditable, alleviating previous challenges and ensuring that storage remains cost-effective and operationally efficient without impacting customer service.

In AI applications, the term "performance" encompasses two distinct concepts: infrastructure metrics, such as latency, throughput, and cost, and result quality, including accuracy, precision, and relevance. Confusing these two types of performance can lead to misalignment between teams and unmet expectations among stakeholders. Infrastructure performance involves measurable parameters essential for system functionality, while result quality pertains to the user experience and the effectiveness of the retrieval pipeline. The article underscores the importance of independently measuring and optimizing both types of performance to ensure a balanced approach, as focusing solely on one can lead to improvements in infrastructure but degrade user experience, as seen in a case study where cost reduction led to a decline in result quality.