Glossary › Evaluation

Regression Testing

Re-running evaluation suite after model or prompt changes to detect quality degradation. Automated in CI/CD. Blocks deployment if score drops below threshold.

Where this is taught

• Guardrail Regression Testing with Promptfoo — Phase 5: Guardrails & Defensive Controls
• Guardrail Regression Testing — Phase 7: AI Evaluation & Observability
• Harness Regression Testing — Phase 4: Harness Engineering
• Promptfoo, Inspect AI & HarmBench — Phase 6: AI Red Teaming Methodology & Tools
• Evaluating LLM Systems: Benchmarks & LLM-as-Judge — Phase 8: Evaluation, Safety & Observability
• ServiceNow & Enterprise Platform Integration — Phase 5: Enterprise Integration & Authentication

Related terms

Golden Set

More in Evaluation

LLM-as-Judge · Golden Set · A/B Testing · BLEU Score

Learn this by building

DeVenture Academy teaches AI engineering through projects, with hands-on labs you run on your own machine using real tools.

Create a free account — the opening phases of 29 of 35 courses are free, no credit card. Or see Pro pricing.

All courses · Pricing · About · FAQ · Glossary