AI Security & Red Teaming
Secure, red-team, and defend production AI systems
10 phases. 55 lessons. 55 labs. 4 projects. The OWASP LLM Top 10, prompt injection and jailbreaking, adversarial ML, RAG and agent security, guardrails, red teaming with Garak and PyRIT, AI governance and compliance, and production security architecture. You build the threat models, detectors, guardrails, and red team reports that AI security teams actually ship.
- Lessons: —
- Labs: —
- Projects: —
- Level: Beginner
Curriculum
- Security Fundamentals for AI — Threat modeling (STRIDE/PASTA for AI), MITRE ATLAS, the 6-layer AI attack surface, AppSec vs AI security, trust boundaries & blast radius
- OWASP Top 10 for LLM Applications — LLM01 Prompt Injection, LLM02 Insecure Output Handling, LLM03 Training Data Poisoning, LLM04 Model DoS, LLM05 Supply Chain, LLM06 Sensitive Info Disclosure, LLM07 Insecure Plugin/Tool Design, LLM08 Excessive Agency, LLM09 Overreliance, LLM10 Model Theft
- Prompt Injection & Jailbreaking — Direct injection, jailbreak techniques (DAN, roleplay, encoding bypasses), Crescendo, TAP, PAIR, indirect injection & XPIA, EchoLeak, multi-agent injection, assume-breach defense architecture, building a multi-layer detector
- Adversarial Machine Learning — Evasion attacks (FGSM, PGD, Carlini & Wagner), poisoning attacks (label flipping, backdoors, clean-label), model inversion, membership inference, model extraction, ART/CleverHans/Foolbox
- RAG & Agent Security — Document poisoning, vector/embedding attacks, retrieval manipulation, multi-tenant isolation, agent privilege escalation, tool poisoning, multi-agent & planner manipulation, MCP security, computer-use safety
- Guardrails & Defensive Controls — Guardrail architecture patterns, NeMo Guardrails & Colang, Guardrails AI, Lakera Guard, AWS Bedrock Guardrails, Azure Prompt Shields, Llama Guard, custom PII/topic pipelines, Promptfoo regression testing
- AI Red Teaming Methodology & Tools — Microsoft AI Red Team methodology, engagement lifecycle, Garak vulnerability scanning, PyRIT multi-turn orchestration, Promptfoo/Inspect AI/HarmBench, red team report writing, continuous red teaming in CI/CD
- AI Governance, Compliance & Risk — NIST AI RMF (Govern/Map/Measure/Manage), EU AI Act risk tiers & GPAI obligations, ISO/IEC 42001, SOC 2 for AI, bias audits & fairness metrics, SHAP/LIME explainability, AI incident response & regulatory reporting
- Production AI Security Architecture — Multi-layer security architecture (network to audit layer), observability with LangSmith/Langfuse/Phoenix, CI/CD security gates, supply chain security & SBOM for ML, AI incident response playbooks
- Career, Portfolio & Capstone Demo — Building an AI security portfolio, resume & LinkedIn for AI security roles, interview prep (system design, live red teaming, code review), certifications (CAISP, AAISM), community (OWASP LLM, MITRE ATLAS, AI Village), staying current & capstone demo
Skills You Will Learn
- OWASP LLM Top 10
- Prompt Injection Defense
- Red Teaming
- Guardrails
- MITRE ATLAS
- AI Compliance
Related Courses
Browse all courses · View pricing · DeVenture Academy