medlab / family
Test Effectiveness
Cases in the observatory's Test Effectiveness family.
cases3
-
2026-10-24
Cutting between words preserves a sentence's meaning
now fails loudly Regression tests require the full selected context and its governing modal to survive cloze construction.
InvariantsTest EffectivenessRuntime InvariantsMutation Testing
-
2026-10-07
A placeholder written for a reader was a broken link the site's own checker followed
now fails loudly a build gate fails when generated text carries a literal <...> placeholder inside an http(s) URL, so a placeholder cannot ship as a 404-ing link on the site's own domain
StructuralTest EffectivenessPre-Promotion Invariant GatesSnapshot Tests
-
2026-09-19
Hardcoding a "recent" date into a test fixture keeps it recent
now fails loudly the telemetry collector accepts SUBLAYER_NOW to freeze its clock, and the test pins it to the fixtures' own day, so the window is deterministic and cannot age out
BehavioralTest EffectivenessExample-Based TestsPre-Promotion Invariant Gates