PRISM · Release v1

Evidence by check

Each bar is the share of all 300 included launches that publicly evidence the check with an artefact linked. Launches with no public evidence found stay in every denominator.

Figure 2. Checks for the decision: Keep exploringshare of included launches that publicly evidence the check (confirmed pass)
Figure 2. Checks for the decision: Keep exploringThe artefact or action can be reproduced or inspected.: withheld: withheld under the pre-registered shortfall rule. Important supplied context, assumptions, and inferences are visible.: withheld: withheld under the pre-registered shortfall rule0%25%50%75%100%The artefact or action can be reproduced or inspected.The artefact or action can be reproduced or inspected.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleImportant supplied context, assumptions, and inferences are visible.Important supplied context, assumptions, and inferences are visible.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall rule
Table view
Figure 2. Checks for the decision: Keep exploring
RowLaunchesShare95% CI
The artefact or action can be reproduced or inspected.withheld: withheld under the pre-registered shortfall rule
Important supplied context, assumptions, and inferences are visible.withheld: withheld under the pre-registered shortfall rule
Figure 3. Checks for the decision: Permit reliance for the named useshare of included launches that publicly evidence the check (confirmed pass)
Figure 3. Checks for the decision: Permit reliance for the named useThe intended use and boundaries are explicit.: 169 of 300 (56%, 95% CI 51–62%). Acceptance criteria are explicit and testable enough for the use.: withheld: withheld under the pre-registered shortfall rule. Evidence shows the acceptance criteria were met.: withheld: withheld under the pre-registered shortfall rule. Relevant failure modes and fallback behaviour were evaluated.: withheld: withheld under the pre-registered shortfall rule. Known limitations and out-of-scope conditions are stated.: 162 of 300 (54%, 95% CI 48–60%)0%25%50%75%100%The intended use and boundaries are explicit.The intended use and boundaries are explicit.: 169 of 300 (56%, 95% CI 51–62%)56%169 of 300 · CI 51–62%Acceptance criteria are explicit and testable enough for the use.Acceptance criteria are explicit and testable enough for the use.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleEvidence shows the acceptance criteria were met.Evidence shows the acceptance criteria were met.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleRelevant failure modes and fallback behaviour were evaluated.Relevant failure modes and fallback behaviour were evaluated.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleKnown limitations and out-of-scope conditions are stated.Known limitations and out-of-scope conditions are stated.: 162 of 300 (54%, 95% CI 48–60%)54%162 of 300 · CI 48–60%
Table view
Figure 3. Checks for the decision: Permit reliance for the named use
RowLaunchesShare95% CI
The intended use and boundaries are explicit.169 of 30056%51–62%
Acceptance criteria are explicit and testable enough for the use.withheld: withheld under the pre-registered shortfall rule
Evidence shows the acceptance criteria were met.withheld: withheld under the pre-registered shortfall rule
Relevant failure modes and fallback behaviour were evaluated.withheld: withheld under the pre-registered shortfall rule
Known limitations and out-of-scope conditions are stated.162 of 30054%48–60%
Figure 4. Checks for the decision: Sell, operate, support, or staff repeatedlyshare of included launches that publicly evidence the check (confirmed pass)
Figure 4. Checks for the decision: Sell, operate, support, or staff repeatedlyThe Deliverable gate for the intended use has passed.: <10. Operational ownership is explicit.: withheld: withheld under the pre-registered shortfall rule. The assurance mechanism is defined for the important failure modes.: withheld: withheld under the pre-registered shortfall rule. Fallback or escalation is defined.: 44 of 300 (15%, 95% CI 11–19%). Recovery or rollback has been tested where failure consequence warrants it.: <10. Support, maintenance, debugging, and change responsibility are defined.: withheld: withheld under the pre-registered shortfall rule. The relevant operating-cost boundary is known well enough for the decision.: 104 of 300 (35%, 95% CI 30–40%)0%25%50%75%100%The Deliverable gate for the intended use has passed.The Deliverable gate for the intended use has passed.: Fewer than 10 launches; suppressed by disclosure control<10Operational ownership is explicit.Operational ownership is explicit.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleThe assurance mechanism is defined for the important failure modes.The assurance mechanism is defined for the important failure modes.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleFallback or escalation is defined.Fallback or escalation is defined.: 44 of 300 (15%, 95% CI 11–19%)15%44 of 300 · CI 11–19%Recovery or rollback has been tested where failure consequence warrants it.Recovery or rollback has been tested where failure consequence warrants it.: Fewer than 10 launches; suppressed by disclosure control<10Support, maintenance, debugging, and change responsibility are defined.Support, maintenance, debugging, and change responsibility are defined.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleThe relevant operating-cost boundary is known well enough for the decision.The relevant operating-cost boundary is known well enough for the decision.: 104 of 300 (35%, 95% CI 30–40%)35%104 of 300 · CI 30–40%
Table view
Figure 4. Checks for the decision: Sell, operate, support, or staff repeatedly
RowLaunchesShare95% CI
The Deliverable gate for the intended use has passed. (agreement not estimable: fewer than ten gold passes)<10
Operational ownership is explicit.withheld: withheld under the pre-registered shortfall rule
The assurance mechanism is defined for the important failure modes.withheld: withheld under the pre-registered shortfall rule
Fallback or escalation is defined.44 of 30015%11–19%
Recovery or rollback has been tested where failure consequence warrants it. (agreement not estimable: fewer than ten gold passes)<10
Support, maintenance, debugging, and change responsibility are defined.withheld: withheld under the pre-registered shortfall rule
The relevant operating-cost boundary is known well enough for the decision.104 of 30035%30–40%
Figure 5. Checks for the decision: Determine whether the initiative changed the resultshare of included launches that publicly evidence the check (confirmed pass)
Figure 5. Checks for the decision: Determine whether the initiative changed the resultThe outcome measure is defined.: withheld: withheld under the pre-registered shortfall rule. A comparable baseline or counterfactual is defined.: withheld: withheld under the pre-registered shortfall rule. The outcome was measured after the intervention.: withheld: withheld under the pre-registered shortfall rule. Before/after measurements use the same relevant definition.: <10. Material confounds, uncertainty, or attribution limits are named.: withheld: withheld under the pre-registered shortfall rule0%25%50%75%100%The outcome measure is defined.The outcome measure is defined.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleA comparable baseline or counterfactual is defined.A comparable baseline or counterfactual is defined.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleThe outcome was measured after the intervention.The outcome was measured after the intervention.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleBefore/after measurements use the same relevant definition.Before/after measurements use the same relevant definition.: Fewer than 10 launches; suppressed by disclosure control<10Material confounds, uncertainty, or attribution limits are named.Material confounds, uncertainty, or attribution limits are named.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall rule
Table view
Figure 5. Checks for the decision: Determine whether the initiative changed the result
RowLaunchesShare95% CI
The outcome measure is defined.withheld: withheld under the pre-registered shortfall rule
A comparable baseline or counterfactual is defined.withheld: withheld under the pre-registered shortfall rule
The outcome was measured after the intervention.withheld: withheld under the pre-registered shortfall rule
Before/after measurements use the same relevant definition. (agreement not estimable: fewer than ten gold passes)<10
Material confounds, uncertainty, or attribution limits are named.withheld: withheld under the pre-registered shortfall rule
Figure 6. Checks for the decision: Scale, renew, expand, or stopshare of included launches that publicly evidence the check (confirmed pass)
Figure 6. Checks for the decision: Scale, renew, expand, or stopOutcome evidence relevant to the decision is available.: withheld: withheld under the pre-registered shortfall rule. The full relevant cost boundary is accounted for.: withheld: withheld under the pre-registered shortfall rule. Material risks and trade-offs are assessed.: withheld: withheld under the pre-registered shortfall rule. Reasonable alternatives or the status quo are compared.: withheld: withheld under the pre-registered shortfall rule. The rule for scale, renew, expand, or stop is explicit.: withheld: withheld under the pre-registered shortfall rule0%25%50%75%100%Outcome evidence relevant to the decision is available.Outcome evidence relevant to the decision is available.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleThe full relevant cost boundary is accounted for.The full relevant cost boundary is accounted for.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleMaterial risks and trade-offs are assessed.Material risks and trade-offs are assessed.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleReasonable alternatives or the status quo are compared.Reasonable alternatives or the status quo are compared.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall ruleThe rule for scale, renew, expand, or stop is explicit.The rule for scale, renew, expand, or stop is explicit.: withheld: withheld under the pre-registered shortfall rulewithheld: withheld under the pre-registered shortfall rule
Table view
Figure 6. Checks for the decision: Scale, renew, expand, or stop
RowLaunchesShare95% CI
Outcome evidence relevant to the decision is available.withheld: withheld under the pre-registered shortfall rule
The full relevant cost boundary is accounted for.withheld: withheld under the pre-registered shortfall rule
Material risks and trade-offs are assessed.withheld: withheld under the pre-registered shortfall rule
Reasonable alternatives or the status quo are compared.withheld: withheld under the pre-registered shortfall rule
The rule for scale, renew, expand, or stop is explicit.withheld: withheld under the pre-registered shortfall rule