Free Lesson
Build a Document Processing Pipeline for RAG Systems
30 min
May 6, 2024 2:00 PM
Virtual (Zoom)
In this video
What you'll learn
Setup: the components that you need to have
Understand the different components required: document loading, parsing, text chunking, and embedding creation.
Develop: we'll write some code
Set up a basic pipeline to parse some technical documentation to get you started using open source tools.
Caveats: going from development to production
Common caveats when taking such a system to production.
Why this topic matters
Retrieval Augmented Generation or RAG is a 🔥 hot topic.
But to use RAG you need to have data to retrieve. Most commonly in organizations this data is in some form of document.
Understanding the "what" and "how" of creating a document processing pipeline will enable you to move faster and make better decisions as you build out your RAG system.
You'll learn from
Stefan Krawcyk
Co-creator of Hamilton & Burr, CEO & Co-Founder DAGWorks Inc.
Previously at
