Company
Date Published
Author
Isabelle Nguyen
Word count
1199
Language
English
Hacker News points
None

Summary

We built a generative AI assistant for easier navigation of our technical documentation using deepset Cloud, an LLM platform that combines an intuitive user interface with a powerful backend. The solution uses retrieval augmented generation (RAG) pipeline with hybrid retrieval to answer questions in natural language and provide pointers to relevant documentation pages. We used the guided workflow in deepset Cloud to set up the prototype quickly, which was customized by adding or removing components as needed. To refine the prompt, we used the prompt explorer, a sandbox environment that lets users design the perfect prompt, and implemented a solution for links by adding them to the documents' metadata. The AI solution seamlessly integrates with our platform's user interface, providing a win for all stakeholders: technical writers, users, and solution engineers.