Home / Companies / LllamaIndex / Blog / Post Details
Content Deep Dive

Why doesn’t OpenAI just update it?

Blog post from LllamaIndex

Post Details
Company
Date Published
Author
Yi Ding
Word Count
497
Company Posts That Month
6
Language
English
Hacker News Points
-
Post removed?
No
Summary

ChatGPT's knowledge cutoff is two years old, and updating it is costly due to the expensive process of training new language models and cleaning data. To work around the limitation of outdated data, developers can use Retrieval Augmented Generation (RAG), a method that involves searching for relevant context, providing it to the language model, and obtaining improved responses. Despite its seemingly complex nature, RAG is straightforward and widely adopted by open-source projects, including LlamaIndex, which integrates with numerous vector databases. Fine-tuning, another technique, involves creating a custom model on top of an existing one, though it requires more effort and data. Knowing when to employ RAG or fine-tuning, or a combination of both, is crucial. For applications not needing recent data, the current ChatGPT is sufficient, while various chatbots like Google Bard and BingGPT use RAG to offer more updated information.

Trends Found in this Post
Trend Post Mentions Total Month Mentions Posts Companies MoM
LLM 7 2,134 271 94 -26%
RAG 7 466 92 33 +83%
AI Model Fine-tuning 4 498 94 48 -24%
Use This Data

Use this post, company, and trend context to find content marketing opportunities, perform competitive analysis, or address product feature gaps via the Plushcap MCP server or the Plushcap API.