On Free, the Visual check spirals: a flash-lite browser subagent misses its targets and the judge keeps sending more #338
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
What happens
Run 159 (Stocks, Free, subagents on): the Visual check ran 27 min and wrote no report before it was stopped. All 167 Free requests were answered, so the router was fine.
textbox "Stock search",ref=e26or[ref=e38]instead ofe26, and 8 of its 21 clicks failed, as did nearly every type./v1/modelswithout a key: a 401 every 15 s.Fix
lookfor screenshots, even when subagents are on.ref=e26and[ref=e38]ase26.Done when
A Free run's Visual check, with subagents on, drives the browser from the judge and writes its report. A sim covers the holder and the ref targets.
Shipped in #339 (deployed with
e22494f) and archived asfree-judge-holds-the-browser.Verified by replaying run 159's Visual check (attempt 1) on the laptop with
tools/replay.sh(#340):lookonlyref=clicksThe scripted replay of the same turns had the 7
browsersubagent calls refused. The router probe's 401s were already gone on production (0 in 30 min after the deploy).