Phase 1: Retrieval & Knowledge Systems · 30 hours · Python (pipeline + API) · TypeScript (chat UI)

Capstone 08 — Production RAG Chatbot for a Regulated Vertical

Harvey, Glean, Mendable, and LlamaCloud all run the same production shape in 2026.

Hiring signal: Can build capstone 08 end to end

Introduction

Ingest with docling or Unstructured and ColPali for visuals. Hybrid search. Re-rank with bge-reranker-v2-gemma. Synthesize with Claude Sonnet 4.7 using prompt caching at 60-80% hit rate. Guard with Llama Guard 4 and NeMo Guardrails. Watch with Langfuse and Phoenix. Grade with RAGAS on a 200-question golden set. Build one in a regulated domain (legal, clinical, insurance), and the capstone is passing the golden set, the red team, and the drift dashboard.

Phases exercised: P5 · P7 · P11 · P12 · P17 · P18

Type: Capstone Languages: Python (pipeline + API), TypeScript (chat UI) Prerequisites: Phase 5 (NLP), Phase 7 (transformers), Phase 11 (LLM engineering), Phase 12 (multimodal), Phase 17 (infrastructure), Phase 18 (safety) Time: 30 hours

Objective

Learning objectives

Unlock the full lesson

You've read the first 2 sections. The rest of this lesson covers The Problem, The Concept, Build, Check Yourself, Key Terms & Next — plus a hands-on lab, quiz, and project artifact.

Create a free account to unlock Phase 0 and Phase 1 of every course — no credit card.