Scale AI Agent Speed and Savings with Langflow and NVIDIA NeMo Microservices

DataStax has partnered with NVIDIA to integrate their NeMo microservices into its data and AI platforms, including Astra DB, DataStax Hyper-Converged Database, and the DataStax AI Platform. This partnership aims to provide scalable RAG (retrieval-augmented generation) and hybrid search functionality for GenAI applications. The integration of NeMo microservices has resulted in significant improvements in performance, cost-effectiveness, and latency, with sub-12ms latency on NVIDIA H100 GPUs. DataStax has also launched Astra Vectorize, which enables embedding generation at the database tier, and DataStax Hyper Converged Data (HCD) Platform, which brings OpenSearch and Apache Pulsar to enable GenAI and vector search capabilities. The partnership with NVIDIA has enabled DataStax to create a platform that harnesses the full potential of its data through AI, turning information into intelligence and intelligence into action.