Glossary › Evaluation

Golden Set

Curated set of test cases with known correct answers used for regression testing. Should cover edge cases, common cases, and adversarial inputs. Updated as new failure modes are discovered.

Where this is taught

• Incident Response Playbook — Phase 7: Production Observability & Incident Response
• Guardrail Regression Testing with Promptfoo — Phase 5: Guardrails & Defensive Controls
• Offline vs Online Evaluation — Phase 5: Evaluation & Quality for AI Products

Related terms

Regression Testing

More in Evaluation

LLM-as-Judge · Regression Testing · A/B Testing · BLEU Score

Learn this by building

DeVenture Academy teaches AI engineering through projects — every lesson is paired with a hands-on lab you run on your own machine with real tools.

Create a free account — the opening phases of 24 of 30 courses are free, no credit card. Or see Pro pricing.

All courses · Pricing · About · FAQ · Glossary