The Latest Benchmark Between Vectara, OpenAI and Cohere’s Embedding Models

Vectara's Boomerang embedding model, launched in September 2023, is designed for production use cases and is compared to the latest embedding models from OpenAI and Cohere. Boomerang demonstrates comparable performance to OpenAI and Cohere models in English language tasks, while it significantly outperforms them in multilingual and cross-lingual tasks, according to benchmarks such as SQuAD, XQuAD-R, and MIRACLE. The model is designed to balance precision, embedding size, and storage costs, with Boomerang and Cohere V3/V3 light being optimal choices for achieving high precision with low storage costs. Boomerang's embedding size is 768, offering a cost-effective storage solution compared to larger models like OpenAI's text-embedding-3-large. Overall, Boomerang is presented as an effective choice for production environments, optimizing trade-offs between quality and resource efficiency.