Skip to content

Operator Task Verifier Evaluation v1

Source schema: doc/schemas/operator-task-verifier-evaluation.v1.schema.json

The host's judgment of one verifier result for one run: the exact verifier and result digests, each declared check as reported, and any check missing or unexpected. A run is verified only when every declared check is reported exactly once and passes; a failing check makes it verification-failed; a missing or unexpected check, a result outside the contracts, a timeout or a detected mutation refuses success with its code.

Governing Basis

Project Lineage

Fields

Field Required Shape Description
schema yes const: operator-task-verifier-evaluation.v1
schema/v yes const: 1
run/ref yes unspecified
verifier/ref yes unspecified
verifier/digest yes ref: operator-task-common.v1.schema.json#/$defs/digest
result/ref no ref: operator-task-common.v1.schema.json#/$defs/ref
result/digest no ref: operator-task-common.v1.schema.json#/$defs/digest
checks yes array
passed yes boolean
refusal/code no ref: operator-task-common.v1.schema.json#/$defs/refusalCode

Definitions

Definition Shape Description
check object

Conditional Rules

Rule 1

When:

{
  "required": [
    "refusal/code"
  ]
}

Then:

{
  "properties": {
    "passed": {
      "const": false
    }
  }
}

Rule 2

Constraint:

{
  "dependentRequired": {
    "result/ref": [
      "result/digest"
    ],
    "result/digest": [
      "result/ref"
    ]
  }
}

Field Semantics

schema

  • Required: yes
  • Shape: const: operator-task-verifier-evaluation.v1

schema/v

  • Required: yes
  • Shape: const: 1

run/ref

  • Required: yes
  • Shape: unspecified

verifier/ref

  • Required: yes
  • Shape: unspecified

verifier/digest

  • Required: yes
  • Shape: ref: operator-task-common.v1.schema.json#/$defs/digest

result/ref

  • Required: no
  • Shape: ref: operator-task-common.v1.schema.json#/$defs/ref

result/digest

  • Required: no
  • Shape: ref: operator-task-common.v1.schema.json#/$defs/digest

checks

  • Required: yes
  • Shape: array

passed

  • Required: yes
  • Shape: boolean

refusal/code

  • Required: no
  • Shape: ref: operator-task-common.v1.schema.json#/$defs/refusalCode

Definition Semantics

$defs.check

  • Shape: object