Skip to main content
PATCH
/
v1
/
workflows
/
evals
/
{eval_id}
from retab import Retab

client = Retab()

# Rename only.
workflow_eval = client.workflows.evals.update(
    eval_id="wfnodeeval_hsLEQiM61ez9Piv147MWk",
    name="Q1 invoice — vendor name check",
)

# Replace the assertion.
workflow_eval = client.workflows.evals.update(
    eval_id="wfnodeeval_hsLEQiM61ez9Piv147MWk",
    assertion={
        "target": {"output_handle_id": "output-json-0", "path": "vendor.name"},
        "condition": {"kind": "matches_regex", "pattern": r"^Acme.*"},
    },
)

# Re-capture inputs from a different run.
workflow_eval = client.workflows.evals.update(
    eval_id="wfnodeeval_hsLEQiM61ez9Piv147MWk",
    source={
        "type": "run_step",
        "run_id": "wfrun_new789",
        "step_id": "block_extract_invoice",
    },
)

{
  "id": "wfnodeeval_hsLEQiM61ez9Piv147MWk",
  "workflow_id": "wf_abc123xyz",
  "target": { "type": "block", "block_id": "block_extract_invoice" },
  "source": { "type": "manual", "handle_inputs": { "...": "..." } },
  "name": "Q1 invoice — vendor name check",
  "assertion": { "...": "the new assertion" },
  "schema_drift": "none",
  "validation_status": "valid",
  "latest_run_summary": null,
  "created_at": "2026-04-08T14:22:26Z",
  "updated_at": "2026-05-01T14:35:00Z"
}
Patch the name, assertion, and/or source of a workflow eval. Every field is optional in the request body — fields you omit are left untouched. Setting assertion: null is rejected explicitly (use Delete Workflow Eval if you want to remove the eval entirely). Updating source rebinds where the inputs come from:
  • { type: "manual", handle_inputs: ... } — switch to hand-written inputs.
  • { type: "run_step", run_id: ..., step_id: ... } — re-capture inputs from a different workflow run / step.
The response is the full updated WorkflowEval. 
from retab import Retab

client = Retab()

# Rename only.
workflow_eval = client.workflows.evals.update(
    eval_id="wfnodeeval_hsLEQiM61ez9Piv147MWk",
    name="Q1 invoice — vendor name check",
)

# Replace the assertion.
workflow_eval = client.workflows.evals.update(
    eval_id="wfnodeeval_hsLEQiM61ez9Piv147MWk",
    assertion={
        "target": {"output_handle_id": "output-json-0", "path": "vendor.name"},
        "condition": {"kind": "matches_regex", "pattern": r"^Acme.*"},
    },
)

# Re-capture inputs from a different run.
workflow_eval = client.workflows.evals.update(
    eval_id="wfnodeeval_hsLEQiM61ez9Piv147MWk",
    source={
        "type": "run_step",
        "run_id": "wfrun_new789",
        "step_id": "block_extract_invoice",
    },
)

{
  "id": "wfnodeeval_hsLEQiM61ez9Piv147MWk",
  "workflow_id": "wf_abc123xyz",
  "target": { "type": "block", "block_id": "block_extract_invoice" },
  "source": { "type": "manual", "handle_inputs": { "...": "..." } },
  "name": "Q1 invoice — vendor name check",
  "assertion": { "...": "the new assertion" },
  "schema_drift": "none",
  "validation_status": "valid",
  "latest_run_summary": null,
  "created_at": "2026-04-08T14:22:26Z",
  "updated_at": "2026-05-01T14:35:00Z"
}

Authorizations

​
Authorization
string
header
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

​
eval_id
string
required

Body

application/json

Body for updating a workflow eval. Only the supplied fields (name, assertion, source) are changed.

​
name
string | null
​
assertion
AssertionSpec · object

Block-eval assertion against one declared output handle.

target is the only supported shape: an output handle id and an optional relative path inside that handle's payload.

​
source
ManualWorkflowEvalSource · object

Response

Successful Response

A saved workflow eval: a target block, an input source, and the assertion evaluated against its output.

​
id
string
required
​
workflow_id
string
required
​
target
WorkflowEvalBlockTarget · object
required

Public workflow-eval target.

The storage layer remains block-scoped today, but the API shape names the tested entity explicitly so workflow-level targets can be added later.

​
source
ManualWorkflowEvalSource · object
required
​
name
string | null
​
assertion
AssertionSpec · object

Block-eval assertion against one declared output handle.

target is the only supported shape: an output handle id and an optional relative path inside that handle's payload.

​
assertion_schema_dep
AssertionSchemaDep · object

Single-rule schema dependency for Level 2 drift detection.

​
assertion_drift_status
enum<string> | null
Available options:
valid,
drifted,
broken
​
schema_drift
enum<string>
default:unknown
Available options:
none,
partial,
drifted,
unknown
​
schema_drift_detail
string | null
​
freshness
ArtifactFreshness · object
​
drift
ArtifactDrift · object
​
validation_status
string
default:valid
​
validation_issues
any[]
​
latest_run_summary
LatestBlockEvalRunSummary · object

Summary of the most recent block-eval run.

Execution status and verdict outcome are exposed as separate fields. The summary is written on terminal-state transitions, so in practice status is one of completed | error | cancelled and outcome is populated when status == "completed".

​
latest_passing_run_summary
LatestBlockEvalRunSummary · object

Summary of the most recent block-eval run.

Execution status and verdict outcome are exposed as separate fields. The summary is written on terminal-state transitions, so in practice status is one of completed | error | cancelled and outcome is populated when status == "completed".

​
latest_failing_run_summary
LatestBlockEvalRunSummary · object

Summary of the most recent block-eval run.

Execution status and verdict outcome are exposed as separate fields. The summary is written on terminal-state transitions, so in practice status is one of completed | error | cancelled and outcome is populated when status == "completed".

​
created_at
string<date-time>

When the workflow eval was created

​
updated_at
string<date-time>

When the workflow eval was last updated