Add outcome verification gates to agent workflows
Require evidence before an agent announces success, advances to dependent work, replays an uncertain action, requests approval, or closes the user’s task.
A gate turns evidence into workflow control
An outcome verification gate blocks a state transition until the agent can support it with evidence appropriate to the action’s risk.
Many workflows verify only that a tool returned or a browser action ran. That is not enough when the external system may commit after a timeout, when a provider acknowledges before final processing, or when a page shows a transient success state. The workflow needs a separate decision about the user-visible outcome.
Gates make that decision explicit. A notification gate prevents “done” messages before verification. A dependency gate stops later steps from consuming an uncertain result. A replay gate requires confirmed absence before another side-effecting attempt. An approval gate ensures the proposal still matches current inputs. A closure gate requires a final receipt and resolved critical effects.
The mechanism should not be one universal assertion. Each action class needs a semantic postcondition, intent fingerprint, evidence hierarchy, consistency window, and policy. Low-risk draft work can advance on supporting evidence; a payment, publish, or booking may require an authoritative provider record or human review.
The goal is not to slow every workflow. It is to place deliberate friction at transitions where an unsupported assumption could become a duplicate action, misleading notification, or corrupted dependent task.
Gate taxonomy
Advance gate
Blocks dependent work until the previous step’s semantic outcome is verified and fresh enough for the next decision.
Notification gate
Prevents success or failure messaging until user-visible state is classified with evidence.
Replay gate
Requires confirmed absence, original effect identity, valid authorization, and risk policy before repeating an action.
Closure gate
Requires critical effects resolved, final state verified, receipt written, and unresolved caveats recorded.
Map consequential transitions
List every point where the workflow advances, notifies, replays, asks for approval, compensates, or closes. Prioritize transitions following external side effects or consuming time-sensitive observations.
Define the required outcome
Describe the user-visible state independent of the implementation. “One appointment exists for the approved time” is stronger than “booking tool returned success.” Record the material intent fields that distinguish the result.
Choose evidence and consistency rules
Rank provider records, stable resource state, events, history, assertions, screenshots, and model interpretation. Define pending states, polling windows, freshness, authority for presence and absence, and what counts as contradiction.
Implement a typed gate result
Return complete, absent, failed, pending, unknown, contradictory, or review required with evidence references. Do not reduce every outcome to a boolean. Include gate version, observation time, policy profile, and recommended next transitions.
Connect transitions explicitly
Define which states authorize each edge. Complete may advance. Absent may permit replay. Pending may schedule another observation. Unknown and contradictory should pause. Review required should create a human decision without mutating evidence.
Test failure between action and confirmation
Interrupt the worker after the external action but before the result is stored. Delay provider events, change the interface, expire authorization, and introduce contradictory evidence. Verify that the gate prevents unsafe transitions.
Measure and refine
Track gate latency, pending duration, unknown rate, false absence, false completion, replay prevention, manual review, user delay, and later reversals. Version definitions and disable autonomy when evidence quality drifts.
Gate state model
Verified
The required outcome exists with evidence strong enough for the action’s policy. Authorized transitions can proceed.
Pending
The target accepted work or may still be converging. Schedule bounded observation without replay or final messaging.
Absent
An authoritative source proves the effect and pending work are absent. Replay may proceed only after separate identity and authorization checks.
Unknown or contradictory
Evidence is insufficient or disagrees. Pause, gather more evidence, or route to human review. Do not guess.
Implementation rules
Keep gates pure where possible
Observation should not create the effect it is verifying. Separate read probes from action tools and mark unavoidable side effects explicitly.
Store evidence, not only verdicts
A later operator must see the sources, observations, freshness, and policy that produced the result. Append new evidence rather than rewriting history.
Version the contract
Postconditions, evidence hierarchy, consistency windows, and transition rules change. Pin the gate version to each run and migrate paused work deliberately.
Separate gate and approval
Verification proves state; approval authorizes action. A verified changed outcome may still require fresh user consent before the workflow continues.
Use risk profiles
Apply stronger evidence, longer consistency windows, dual approval, or manual review to irreversible and costly actions without burdening safe draft work.
Worked examples
Messaging workflow
The send call times out. A notification gate blocks a duplicate failure notice, while the replay gate queries provider delivery using the original operation identity.
effect=outbound_message_01
state=unknown -> delivered
transition=skip replay, closeBrowser booking
The page closes after submission. An advance gate searches bookings and pending holds using the intent fingerprint. Unknown state pauses dependent calendar updates.
effect=appointment_request
state=pending -> verified
transition=advanceWebsite release
Deploy polling fails. A closure gate checks intended commit, deployment record, revision status, and live health before the agent reports completion.
effect=release_commit_a91c
state=verified
transition=notify, closePut gates at the workflow boundary
A gate should be visible in the workflow model, not hidden inside a tool wrapper that silently retries or changes state.
The action step emits an effect expectation before execution. The gate consumes observations and returns a typed state. The workflow engine owns transitions, timers, checkpointing, and human tasks. Notification policy decides what the user should hear. Each layer records its decision through linked identities.
This separation makes recovery explainable. Operators can see whether a run is waiting on target consistency, blocked by contradictory evidence, awaiting approval, or paused because the gate definition drifted. It also prevents a tool adapter from both deciding and executing its own replay.
For long-running work, store the gate result at a durable checkpoint but re-evaluate freshness before dependent actions. A verified price, availability, authentication state, or browser resource may expire while the agent waits for approval.
Applied personal-agent workflows
Text-message assistant
Notification gates keep internal retries quiet and send delay, approval, or final receipts only when evidence changes the user’s state.
Computer-use cache
Advance gates check observation freshness and invalidate cached absence after actions or external changes, preventing stale evidence from authorizing replay.
Website-building agent
Publish, notification, and closure gates verify commit, deployment, revision, and live health before dependent launch work or completion claims.
Launch checklist
Consequential workflow transitions are inventoried.
Each gate names a semantic user-visible outcome.
Material intent fields are fingerprinted.
Evidence sources are graded by authority.
Presence, absence, pending, and unknown are distinct.
Consistency windows and freshness are explicit.
Gate observations avoid creating new effects.
Evidence and verdicts are stored durably.
Transition rules are explicit and versioned.
Replay also checks identity and authorization.
Changed outcomes require fresh approval.
High-impact ambiguity routes to review.
Failure injection covers lost confirmation.
Gate quality and final outcomes are monitored.
What not to gate
Not every computation needs a durable external-outcome gate.
Pure transformations, repeatable local calculations, and low-risk draft generation can usually use ordinary assertions and retries. Adding heavy reconciliation to every node increases latency, storage, and operational complexity without reducing meaningful risk.
Place gates where unsupported state would cross a boundary: a user notification, an irreversible action, dependent work that assumes an external result, approval of changed parameters, or final closure. Use lightweight checks for lower-risk transitions and stronger evidence for costly, public, or regulated effects.
The right metric is not the number of gates. It is the percentage of consequential transitions protected by evidence appropriate to their risk, and the reduction in duplicate, abandoned, or falsely reported outcomes.
Frequently asked questions
Is a verification gate just an assertion?
It is an assertion plus durable evidence, typed uncertainty, consistency handling, risk policy, and explicit workflow transitions. It must support recovery after process or session loss.
Should a failed gate automatically retry the action?
No. A failed or unknown verification does not prove the effect is absent. Replay requires confirmed absence, the original logical effect identity, valid inputs, and appropriate authorization.
Can a model evaluate a gate?
A model can interpret complex text or visual evidence. Preserve the source and model output separately, apply deterministic checks when possible, and require review for high-impact ambiguity.
How long should a gate wait?
Use a bounded consistency window based on the target and action. Pending work can schedule observations. After the window, unresolved effects remain unknown or move to review rather than becoming absent automatically.
How do gates interact with human approval?
Verification establishes current state. Approval authorizes a proposed action. A gate can trigger approval, but changed inputs, expired scope, or a new proposal require a new durable decision.
What metrics matter?
Protected transition coverage, gate latency, pending and unknown duration, false absence, false completion, unsafe transitions blocked, replay prevention, manual review, user delay, and later outcome reversals.
Primary references
Make evidence the key to the next state.
Super connects personal-agent workflows to messaging, computer use, and website operations where verified outcomes should control what happens next.
Explore Super