Company
Date Published
Author
Manuel Meyer
Word count
1034
Language
English
Hacker News points
None

Summary

Dust, a French company co-founded by former OpenAI Research Engineer Stanislas Polu, is leveraging artificial intelligence to enhance business productivity through customizable AI assistants. The company's platform focuses on deploying large language models (LLMs) across organizations to support and improve team productivity, particularly using retrieval augmented generation (RAG) to manage and utilize company data stored in various SaaS applications. To achieve this, Dust has partnered with the vector database Qdrant, valued for its open-source nature, Rust compatibility, and effective data management capabilities. Dust initially used Qdrant Cloud for quick deployment and centralized billing within their Google Cloud environment, then optimized their setup by exploiting Qdrant's features like MMAP payload control and Scalar Quantization for efficient data storage and cost reduction. The collaboration has allowed Dust to scale its application smoothly, maintaining high performance and low latency, and significantly reducing operational costs. Looking ahead, Dust plans to expand its platform by integrating additional applications and enhancing its structured data capabilities to further empower companies in executing their internal GenAI strategies.