Skip to content

Align adjudication instructions with the registered canonical-persistence policy #219

Open

Description

@realmarcin

The new evidence-adjudication prompt in PR #214 tells the adjudicator to save/read back a final canonical draft and then the remaining cases. The retained finalization contract validates final drafts with canonical_persistence_checked=False and counts only the two initial reviewers' 20 canonical pairs. The new instructions therefore require work that the prospective acceptance path does not account for.

Evidence: scripts/adhoc/scientific_invocation_20261117.py around line 645; scripts/adhoc/finalize_m5_calibration_20261116.py around lines 139–157 and its initial-pair accounting; retained round03 adjudicator instructions. Found during a separate read-only readiness review before a new scientific round.

Proposed repair: preserve the registered 20 initial canonical-pair denominator and explicitly require sealed, proof-validated final drafts/matrix under the original scientific manifest. Align the new phase prompt and plan to that draft-only final adjudication contract. The adjudicator's fresh environment must still pass its own canonical production save/readback canary. Do not claim final drafts are saved canonical pairs or modify historical outcomes. Add a focused regression for the generated phase instructions.

Acceptance: one consistent prospective persistence policy in generated instructions, documentation and finalizer; original 20-pair accounting unchanged; a negative instruction regression; focused tests and independent re-review. No scientific launch until remaining package/evidence readiness gates pass.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions