Home / Companies / PubNub / Blog / Post Details
Content Deep Dive

Build a LLM Chatbot with a Custom Knowledge Base

Blog post from PubNub

Post Details
Company
Date Published
Author
Markus Kohler
Word Count
1,115
Company Posts That Month
24
Language
English
Hacker News Points
-
Post removed?
No
Summary

With the growing attention on large language models (LLMs) like GPT-4 and GPT-3.5, the principle "Garbage in, garbage out" emphasizes the importance of quality input in both prompt engineering and fine-tuning. A novel approach to leveraging LLMs involves building a chatbot with a custom knowledge base, using tools like PubNub and Vectara, to answer questions based on proprietary data. The process involves setting up a vector database on Vectara, where data is indexed into vector embeddings for efficient semantic search. The architecture uses PubNub Functions to manage interactions, signaling when the AI is processing and returning results from Vectara's semantic search. This setup allows businesses to utilize secure, internal data for AI-driven insights, with the flexibility to use other vector databases like Pinecone or Weaviate.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 8 2,401 292 122 -7%
Vector Search 7 2,087 216 81 +23%
Serverless 1 785 157 75 +6%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.