January 2024 Summaries

Vespa has introduced a new IN query operator designed to enhance the efficiency and simplicity of filtering documents by matching fields against a set of values, replacing the need for multiple OR conditions. This operator is optimized for both singlevalue and multivalue fields with basic types such as byte, int, long, or string, and offers significantly improved performance over the previously used weightedSet operator. Performance tests demonstrated that the IN operator provides substantial latency reductions, especially when dealing with a large number of values, achieving up to a 12.5x speedup in some scenarios. This enhancement is available in Vespa version 8.293.15, and those interested can find further details in the reference documentation and join the Vespa community for more insights.

The blog post discusses the capabilities of Vespa in redefining hybrid search by effectively integrating both sparse and dense representational approaches for efficient information retrieval and ranking. Vespa's ability to handle large-scale document collections is highlighted through its support for phased ranking, allowing retrieval and ranking to be expressed in the same query using operators like nearestNeighbor and wand. The post contrasts Vespa's approach with traditional systems, emphasizing the advantages of using Vespa's query language for top-k scoring without scoring all documents. It explores the use of sparse representations through models like BM25 and SPLADE, leveraging dynamic pruning algorithms such as WAND to optimize search efficiency. Additionally, dense representations use vector similarity functions, often requiring transformations with language models, and Vespa supports hybrid retrieval by combining sparse and dense methods within a single query. The post concludes by indicating that the combination of sparse and dense ranking signals will be further discussed in a subsequent post.

Vespa Cloud Enclave is a new premium feature from Vespa Cloud that allows users to deploy their applications within their own AWS or GCP accounts, offering greater control over data and network configurations. This feature is particularly beneficial for applications with specific network connectivity or policy requirements and those with committed cloud provider spends. By using Vespa Cloud Enclave, applications can be hosted within private networks configured inside the user's cloud account, providing transparency and ease of management through provided Terraform modules. The service is aimed at customers with a minimum spend, and onboarding involves working with Vespa Cloud's support team to integrate and deploy the Enclave application, ensuring seamless provisioning and management of resources within the user's cloud environment.