PRISM · Release v1
Claims and evidence
For each check, the red bar is the share of launches that claim it without linking an artefact, and the blue bar the share that publicly evidence it with an artefact linked. Both share one denominator: all 300 included launches.
- H1 (a majority of launches claim at least one check without linking an artefact, so they do not publicly evidence it) is not supported: 96 of 300 launches (32%), one-sided exact binomial, Holm-adjusted p = 1.000; with the recall bound, 85 of 300, Holm-adjusted p = 1.000.
- 62 of 300 launches claim The intended use and boundaries are explicit without linking an artefact (21%); 169 of 300 publicly evidence it (56%).
- 27 of 300 launches claim The relevant operating-cost boundary is known well enough for the decision without linking an artefact (9%); 104 of 300 publicly evidence it (35%).
Table view
| Row | Launches | Share | 95% CI |
|---|---|---|---|
| The artefact or action can be reproduced or inspected. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| The artefact or action can be reproduced or inspected. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| Important supplied context, assumptions, and inferences are visible. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Important supplied context, assumptions, and inferences are visible. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| The intended use and boundaries are explicit. (claimed, no artefact linked) | 62 of 300 | 21% | 16–26% |
| The intended use and boundaries are explicit. (publicly evidenced) | 169 of 300 | 56% | 51–62% |
| Acceptance criteria are explicit and testable enough for the use. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Acceptance criteria are explicit and testable enough for the use. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| Evidence shows the acceptance criteria were met. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Evidence shows the acceptance criteria were met. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| Relevant failure modes and fallback behaviour were evaluated. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Relevant failure modes and fallback behaviour were evaluated. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| Known limitations and out-of-scope conditions are stated. (claimed, no artefact linked) | <10 | ||
| Known limitations and out-of-scope conditions are stated. (publicly evidenced) | 162 of 300 | 54% | 48–60% |
| The Deliverable gate for the intended use has passed. (claimed, no artefact linked) (agreement not estimable: fewer than ten gold passes) | <10 | ||
| The Deliverable gate for the intended use has passed. (publicly evidenced) (agreement not estimable: fewer than ten gold passes) | <10 | ||
| Operational ownership is explicit. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Operational ownership is explicit. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| The assurance mechanism is defined for the important failure modes. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| The assurance mechanism is defined for the important failure modes. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| Fallback or escalation is defined. (claimed, no artefact linked) | <10 | ||
| Fallback or escalation is defined. (publicly evidenced) | 44 of 300 | 15% | 11–19% |
| Recovery or rollback has been tested where failure consequence warrants it. (claimed, no artefact linked) (agreement not estimable: fewer than ten gold passes) | <10 | ||
| Recovery or rollback has been tested where failure consequence warrants it. (publicly evidenced) (agreement not estimable: fewer than ten gold passes) | <10 | ||
| Support, maintenance, debugging, and change responsibility are defined. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Support, maintenance, debugging, and change responsibility are defined. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| The relevant operating-cost boundary is known well enough for the decision. (claimed, no artefact linked) | 27 of 300 | 9% | 6–13% |
| The relevant operating-cost boundary is known well enough for the decision. (publicly evidenced) | 104 of 300 | 35% | 30–40% |
| The outcome measure is defined. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| The outcome measure is defined. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| A comparable baseline or counterfactual is defined. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| A comparable baseline or counterfactual is defined. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| The outcome was measured after the intervention. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| The outcome was measured after the intervention. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| Before/after measurements use the same relevant definition. (claimed, no artefact linked) (agreement not estimable: fewer than ten gold passes) | <10 | ||
| Before/after measurements use the same relevant definition. (publicly evidenced) (agreement not estimable: fewer than ten gold passes) | <10 | ||
| Material confounds, uncertainty, or attribution limits are named. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Material confounds, uncertainty, or attribution limits are named. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| Outcome evidence relevant to the decision is available. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Outcome evidence relevant to the decision is available. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| The full relevant cost boundary is accounted for. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| The full relevant cost boundary is accounted for. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| Material risks and trade-offs are assessed. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Material risks and trade-offs are assessed. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| Reasonable alternatives or the status quo are compared. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| Reasonable alternatives or the status quo are compared. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||
| The rule for scale, renew, expand, or stop is explicit. (claimed, no artefact linked) | withheld: withheld under the pre-registered shortfall rule | ||
| The rule for scale, renew, expand, or stop is explicit. (publicly evidenced) | withheld: withheld under the pre-registered shortfall rule | ||