Phase 3: Voice, Video, Safety & Tutoring · 30 hours · Python (backend · learner model) · TypeScript (web app)

Capstone 17 — Personal AI Tutor (Adaptive, Multimodal, with Memory)

Khanmigo (Khan Academy), Duolingo Max, Google LearnLM / Gemini for Education, Quizlet Q-Chat, and Synthesis Tutor all shipped adaptive multimodal tutoring at scale in 2026.

Hiring signal: Can build capstone 17 end to end

Introduction

The common shape is a Socratic policy (never just dump the answer), a learner model that updates after every interaction (Bayesian knowledge tracing style), voice + text + photo-math input, curriculum graph retrieval, spaced-repetition scheduling, and hard safety filters for age-appropriate content. The capstone is to ship a subject-specific tutor (K-12 algebra or intro Python), run a two-week efficacy study with 10 learners, and pass a content-safety audit.

Phases exercised: P5 · P6 · P11 · P12 · P14 · P17 · P18

Type: Capstone Languages: Python (backend, learner model), TypeScript (web app), SQL (curriculum graph via Postgres + Neo4j) Prerequisites: Phase 5 (NLP), Phase 6 (speech), Phase 11 (LLM engineering), Phase 12 (multimodal), Phase 14 (agents), Phase 17 (infrastructure), Phase 18 (safety) Time: 30 hours

Objective

Learning objectives

Unlock the full lesson

You've read the first 2 sections. The rest of this lesson covers The Problem, The Concept, Build, Check Yourself, Key Terms & Next — plus a hands-on lab, quiz, and project artifact.

Create a free account to unlock Phase 0 and Phase 1 of every course — no credit card.