Player FM 앱으로 오프라인으로 전환하세요!
CAG vs RAG: Which One is Right for You?
Manage episode 463729420 series 3496315
In the early days of LLMs, context windows, which is what we send them as text, were small, often capped at just 4,000 tokens (or 3,000 words), making it impossible to load all relevant context.
This limitation gave rise to approaches like Retrieval-Augmented Generation (RAG) in 2023, which dynamically fetches the necessary context.
As LLMs evolved to support much larger context windows—up to 100k or even millions of tokens—new approaches like caching, or CAG, began to emerge, offering a true alternative to RAG...
►Full article and references: https://www.louisbouchard.ai/cag-vs-rag/
►Build Your First Scalable Product with LLMs: https://academy.towardsai.net/courses/beginner-to-advanced-llm-dev?ref=1f9b29
►Master LLMs and Get Industry-ready Now: https://academy.towardsai.net/?ref=1f9b29
►Our ebook: https://academy.towardsai.net/courses/buildingllmsforproduction?ref=1f9b29
►Twitter: https://twitter.com/Whats_AI
►My Newsletter (My AI updates and news clearly explained): https://louisbouchard.substack.com/
►Join Our AI Discord: https://discord.gg/learnaitogether
43 에피소드
Manage episode 463729420 series 3496315
In the early days of LLMs, context windows, which is what we send them as text, were small, often capped at just 4,000 tokens (or 3,000 words), making it impossible to load all relevant context.
This limitation gave rise to approaches like Retrieval-Augmented Generation (RAG) in 2023, which dynamically fetches the necessary context.
As LLMs evolved to support much larger context windows—up to 100k or even millions of tokens—new approaches like caching, or CAG, began to emerge, offering a true alternative to RAG...
►Full article and references: https://www.louisbouchard.ai/cag-vs-rag/
►Build Your First Scalable Product with LLMs: https://academy.towardsai.net/courses/beginner-to-advanced-llm-dev?ref=1f9b29
►Master LLMs and Get Industry-ready Now: https://academy.towardsai.net/?ref=1f9b29
►Our ebook: https://academy.towardsai.net/courses/buildingllmsforproduction?ref=1f9b29
►Twitter: https://twitter.com/Whats_AI
►My Newsletter (My AI updates and news clearly explained): https://louisbouchard.substack.com/
►Join Our AI Discord: https://discord.gg/learnaitogether
43 에피소드
모든 에피소드
×플레이어 FM에 오신것을 환영합니다!
플레이어 FM은 웹에서 고품질 팟캐스트를 검색하여 지금 바로 즐길 수 있도록 합니다. 최고의 팟캐스트 앱이며 Android, iPhone 및 웹에서도 작동합니다. 장치 간 구독 동기화를 위해 가입하세요.