Phase 4: Mutation Testing & Behavioral Verification · 50 min · mutmut · cosmic-ray · pytest

Interpreting Mutation Scores

A 60% mutation score means 40% of your code's behavior is unverified. Triage every survivor.

Hiring signal: Engineers who can triage surviving mutants (kill vs equivalent vs timeout) demonstrate the analytical skills needed to improve test suites systematically.

What you will learn

Interpret mutation scores: what 60%, 80%, and 100% actually mean
Classify surviving mutants as killable, equivalent, or timeout
Apply the triage workflow: for each surviving mutant, decide kill/equivalent/timeout
Write tests that kill surviving mutants to improve the mutation score

The Problem

You ran mutation testing and got a score of 60%. Is that good? Bad? What does it actually mean? And what do you do with the 40% of mutants that survived? This lesson covers mutation score interpretation and the triage workflow for surviving mutants.

Mutation Score Benchmarks

Score	Rating	What it means	Action
90-100%	Excellent	Tests catch almost all behavioral changes	Maintain level
80-89%	Good	Tests catch most changes, minor gaps	Fix remaining gaps
60-79%	Fair	Significant behavioral paths unverified	Systematic improvement needed
40-59%	Poor	Most behavioral changes undetected	Major test suite overhaul
<40%	Critical	Tests barely verify anything	Rewrite test suite

The 80% threshold
The industry standard threshold for mutation score is 80%. Below 80%, the test suite has too many gaps -- more than 20% of behavioral changes go undetected. For AI-generated code, some teams enforce 90% because AI code has more subtle behavioral bugs. The 80% threshold is enforced in CI: if mutation score drops below 80%, the build fails. This prevents test suite regression -- new code can't be merged if it introduces surviving mutants.

Unlock the full lesson

You've read the first 2 sections. The rest of this lesson covers The Triage Workflow, Build It — plus a hands-on lab, quiz, and project artifact.

Create a free account to unlock Phase 0 and Phase 1 of every course — no credit card.