Phase 7: AI Evaluation & Observability · 50 min · Python · NeMo Guardrails · GuardrailsAI

Guardrail Regression Testing

Prompt changes break guardrails. Test them in CI.

What you will learn

Build guardrail test suites: adversarial inputs, jailbreak attempts, PII leakage tests, topic restrictions
Run guardrail regression tests in CI on every prompt/model/tool change
Test NeMo Guardrails: Colang config testing, rail behavior verification, performance benchmarking
Use GuardrailsAI validators: toxic language, jailbreak detection, PII, topic restriction
Alert on guardrail failures: blocking deployments, notifying on-call, incident escalation

Objective

What you'll learn

This lesson takes approximately 50 min. By the end, you will be able to:

Build guardrail test suites: adversarial inputs, jailbreak attempts, PII leakage tests, topic restrictions
Run guardrail regression tests in CI on every prompt/model/tool change
Test NeMo Guardrails: Colang config testing, rail behavior verification, performance benchmarking
Use GuardrailsAI validators: toxic language, jailbreak detection, PII, topic restriction
Alert on guardrail failures: blocking deployments, notifying on-call, incident escalation

The Problem

You update a system prompt. The guardrails that were working — preventing sensitive information disclosure, harmful content, or scope violations — suddenly break. Guardrail regression testing runs your guardrail test suite on every prompt change, in CI, before deployment. This lesson covers guardrail test design, CI integration, and maintaining guardrail reliability.

Unlock the full lesson

You've read the first 2 sections. The rest of this lesson covers The Concept, Build, Key Terms & Next — plus a hands-on lab, quiz, and project artifact.

Create a free account — the opening phases of 29 of 35 courses are free, no credit card.