Claude Code First, specification version 0.1.0. The plain-language guide
Version 0.1.0. Level 3. Best evidence grade R3/S3.
VG-4 A roll call of the tests
A test gate SHOULD compare the tests its runner discovered with the tests that reported a result, and report any difference as could not run.
| Field | Value |
|---|---|
| Keyword | SHOULD |
| Level | 3 |
| Checked | by judgement |
| Findings | F302 |
| Harness facts | none |
| Threat | internal: the remedy was invented in one project and not recorded failing |
| Status | active |
Rationale: winwright measured a dying test host still printing a pass, "measured here at 352 of 374, a green covering twenty-two tests that" [winwright@861b82e:.github/workflows/ci.yml#L42] never ran, and answered with a roll call of what discovery listed against what the results file recorded (F302, R3/S3). The failure the finding grades would admit a MUST, but the roll call is one project's remedy among several, and no source records it catching a real run, so the rule carries SHOULD. It is the concrete form of VG-3 for a test suite.