Production Agents 2026
11 min read5 primary sources
Evaluate the whole agent system: verify final state, inspect traces, control the environment, repeat trials, and turn real failures into regression tests.
Tag
#Evaluation
Everything tagged "Evaluation": 5 pieces across articles and the journal.
Articles
Production Agents 2026
11 min read4 primary sources
Task horizon, uninterrupted runtime, and parallel agent-hours are different clocks. Learn how to read agent autonomy research without overstating it.
12 min read
Running a coding agent unattended is tempting and mostly a trap. The thing that makes it safe isn't a better prompt. It's an external, deterministic gate the model cannot talk its way past. Here is the principle, a working pipeline that embodies it, and the failure modes that matter.
4 min read
Fetching the right documents is necessary but not sufficient. Grounding (answers that are actually entailed by the retrieved evidence) is a separate property you have to design for and measure. Here is how I think about the gap, and the evaluation that closes it.
Journal
- note
An eval harness before the feature
Rule I keep relearning: build the evaluation before the feature, not after. It feels slower. You sit down to add a capability and instead spend the first hour assembling twenty lab…