AI, three at a time · read · watch · listen

Entity

Verifier-bottleneck

3 reads

felixrieseberg.com 2026-10-17-1

How to be more ambitious: A tutorial for humans with models

Rieseberg's tutorial reads as ambition advice, but every example that worked rested on a verifier. The crash-free app workflow needed crash-report access, version-to-commit mapping, and Windows, macOS and Linux machines to reproduce bugs, and his fourth prompt question asks what other than you or the model shows the result is right. He dates the outside-judge rule to October 2026, which makes it a workaround with an expiry, and the VAGEN paper is one attempt to build the real thing.

arXiv 2026-10-17-2

Agentic Reward Modeling: Verifying GUI Agent via Progressive Trajectory-Grounded Interaction

VAGEN treats verification as an agent job: read the trajectory first, then probe state only where evidence is thin. On OSWorld-Verified with a Sonnet actor, the same model checks tasks at 83.1% success in 17.4 steps versus 55.9% in 28.5 steps when it does them, and it hits 94.6 F1 against ProRe's 90.4. That is the validator Rieseberg says ambition depends on, and it works because it can touch the environment. The Postgres delay is what a verifier this effective does to a release schedule.

The Register 2026-10-17-3

Postgres 19 delayed after AI reviewers find more bugs than humans can fix

Postgres 19 GA slipped from late September or early October to about November 19, 2026, and 8 to 10 features went back to PG20, because LLM-assisted review found more than the beta window could absorb. Eisentraut's example is about 40 reports averaging a three-line fix, each still carrying triage, patch, review, commit and backpatch overhead. PG20 was expected to be bug-fix-only and now inherits the leftovers, so a verifier like VAGEN pays off only if remediation capacity grows to match.