Security, as an experimental science.

A typed scenario contract can preserve a defined security property across constrained changes.

A deployable configuration can still remove the attack path or invalidate the grader.

Generate controlled variants with independent benign and vulnerability witnesses.

Valid-run fraction, missed semantic defects and total authoring/repair time.

Independent state evidence can distinguish model statements from actual tool effects.

A model can refuse in its answer after already performing an unauthorized action.

Compare output grading, existing state-aware evaluation and the proposed contract evaluator.

Precision, recall, inconclusive rate and legitimate task completion.

Separate fixture replay from equivalent state reconstruction and statistical repetition.

Provider changes and asynchronous scheduling prevent universal determinism.

Repeat pinned and live-model conditions while changing one dependency at a time.

State equivalence, verdict agreement, outcome distributions and reproduction time.

Evidence obligations can prevent missing observations from becoming false passes.

Events can be lost, delayed, duplicated or forged by a compromised target.

Inject evidence faults and ablate sensors against independent resource witnesses.

False-pass rate, erroneous graph edges, evidence loss and detection delay.