Skip to main content

Selecting Reliability Controls

Classify the Failure Before Changing the Workflow​

The controls are not interchangeable. A transient generation miss needs a different response from a missing constraint or a contaminated plan. Retrying an invalid assumption produces repeated guesses; adding context to an overloaded workflow adds more load; continuing past an unresolved high-risk decision turns it into state.

Failure classWhat it looks likePull this lever
Missing or noisy contextThe agent cannot reliably identify the relevant facts, constraints, APIs, or code pathsRetrieval and grounding
Poor work shapeThe run has too many dependent decisions, mixes discovery with execution, or keeps re-deciding scopeShaping the work
Noisy generationThe target is clear, but any single attempt may vary in quality or miss a detailSampling and selection
Propagation riskA wrong intermediate decision would contaminate later work or trigger an expensive side effectHuman checkpoints

These four levers change different variables in the system. Retrieval and grounding raise the quality available to each step. Shaping the work changes step difficulty and dependency shape. Sampling and selection improve a bounded noisy transformation when judgment is reliable. Human checkpoints keep unresolved state from crossing a high-risk boundary.

Reliability levers

Four controls target four failure modes

Four independent reliability controlsEach lever changes a different variable in the system.Context qualityRaises baseline step reliabilityby loading the right facts.OrchestrationChanges step hardness anddependency shape.SamplingRuns independent attempts, thenuses a judge to select.HITL checkpointsStops bad state from carryinginto the next phase.R ↑N / depsR_eff ↑S ↓combine deliberately
Diagnose first, then combine controls deliberately. No single lever covers missing facts, poor work shape, generation variance, and propagation risk.

Production workflows rarely pull one lever in isolation. A spec supplies context and a review boundary, validation judges retries and verifies execution, sub-agents change orchestration and isolate context, and context compaction manages what carries over between runs. Match each control to a failure mode — more context, decomposition, retries, or review are not universally safer.