Skip to main content
PATCH
Patch the name, assertion, and/or source of a workflow eval. Every field is optional in the request body — fields you omit are left untouched. Setting assertion: null is rejected explicitly (use Delete Workflow Eval if you want to remove the eval entirely). Updating source rebinds where the inputs come from:
  • { type: "manual", handle_inputs: ... } — switch to hand-written inputs.
  • { type: "run_step", run_id: ..., step_id: ... } — re-capture inputs from a different workflow run / step.
The response is the full updated WorkflowEval.

Authorizations

Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

eval_id
string
required

Body

application/json

Body for updating a workflow eval. Only the supplied fields (name, assertion, source) are changed.

name
string | null
assertion
AssertionSpec · object | null

Block-eval assertion against one declared output handle.

target is the only supported shape: an output handle id and an optional relative path inside that handle's payload.

source
ManualWorkflowEvalSource · object

Response

Successful Response

A saved workflow eval: a target block, an input source, and the assertion evaluated against its output.

id
string
required
workflow_id
string
required
target
WorkflowEvalBlockTarget · object
required

Public workflow-eval target.

The storage layer remains block-scoped today, but the API shape names the tested entity explicitly so workflow-level targets can be added later.

source
ManualWorkflowEvalSource · object
required
name
string | null
assertion
AssertionSpec · object | null

Block-eval assertion against one declared output handle.

target is the only supported shape: an output handle id and an optional relative path inside that handle's payload.

assertion_schema_dep
AssertionSchemaDep · object | null

Single-rule schema dependency for Level 2 drift detection.

assertion_drift_status
enum<string> | null
Available options:
valid,
drifted,
broken
schema_drift
enum<string>
default:unknown
Available options:
none,
partial,
drifted,
unknown
schema_drift_detail
string | null
freshness
ArtifactFreshness · object
drift
ArtifactDrift · object
validation_status
string
default:valid
validation_issues
any[]
latest_run_summary
LatestBlockEvalRunSummary · object | null

Summary of the most recent block-eval run.

Execution status and verdict outcome are exposed as separate fields. The summary is written on terminal-state transitions, so in practice status is one of completed | error | cancelled and outcome is populated when status == "completed".

latest_passing_run_summary
LatestBlockEvalRunSummary · object | null

Summary of the most recent block-eval run.

Execution status and verdict outcome are exposed as separate fields. The summary is written on terminal-state transitions, so in practice status is one of completed | error | cancelled and outcome is populated when status == "completed".

latest_failing_run_summary
LatestBlockEvalRunSummary · object | null

Summary of the most recent block-eval run.

Execution status and verdict outcome are exposed as separate fields. The summary is written on terminal-state transitions, so in practice status is one of completed | error | cancelled and outcome is populated when status == "completed".

created_at
string<date-time>

When the workflow eval was created

updated_at
string<date-time>

When the workflow eval was last updated