How to Keep a Voice AI Knowledge Base Updated When Your Source of Truth Lives in SharePoint, Azure, or Private Docs
Blog post from Retell AI
The discussed architecture enables a Voice AI to efficiently manage a dynamic knowledge base with sources like SharePoint, Azure, or private documents, by using a vector index that mirrors authoritative documents and employing Microsoft Graph webhooks and Event Grid notifications for incremental updates. This approach overcomes limitations of first-party tools like Copilot Studio, which lacks automatic refresh capabilities, and Azure AI Search, which is not designed for real-time voice applications. The system ensures rapid propagation of source edits to the voice agent in minutes, leveraging Retell AI's API for authenticated content pushes, enabling the voice agent to answer queries from a curated mirror of a private corpus. This setup involves using service-principal authentication for secure data handling and combines real-time Event Grid notifications with batch reconciliation via change feeds to maintain data integrity. The architecture also emphasizes the importance of selecting appropriate document sources and tailoring chunking and retrieval settings to optimize performance while ensuring compliance with regulatory standards.