Introducing Vectara’s Custom Prompt Engine

Vectara has introduced a new feature called Custom Retrieval Augmented Generation (RAG) Prompt Engine, which allows the integration of retrieved documents and their metadata directly into generative processes. This feature is particularly beneficial for applications like automatically answering RFIs/RFPs by using previously provided answers, drafting Jira tickets from user feedback, and converting text into markdown format, thus enhancing automation and efficiency in these tasks. The system utilizes Velocity Templates to manage and format the data, enabling users to customize prompts and responses effectively. A practical example of its use is demonstrated through a Google Sheets integration, where the RAG system answers questions based on past RFI data, showcasing the potential for custom workflows and application integrations. This feature, currently available to Scale users, aims to streamline data retrieval and response generation, encouraging users to explore its capabilities and provide feedback for further enhancement.