Vespa Product Updates, May 2020

In May 2020, Vespa introduced several updates to enhance its big data processing and serving engine, widely used by platforms like Yahoo News and Verizon Media Ad Platform. Key improvements included better slow node tolerance, enabling applications to balance query costs more efficiently and optimize cost versus performance in high-query settings by grouping content nodes. Multi-threaded compilation of rank profiles, which are crucial for document scoring, was introduced, significantly reducing compile time to 10% for large models and facilitating quicker content node startups during rolling upgrades. Additionally, Vespa improved its attribute loading process to minimize peak memory usage at startup, making memory management more efficient for applications with varying attribute sizes. Feed performance was enhanced by blocking compaction during high document removal rates, while tensor performance saw optimizations in simple joins, with further enhancements scheduled for June. These updates reflect Vespa's ongoing commitment to leveraging community feedback to drive its development.