A Free run's Visual check can't look when subagents are off, though the run has vision and the look tool #333
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
What happens
Run 157 (Free) had a vision tier (Gemini 3.5 and 3.1 Flash-Lite), training allowed, and the
looktool (#217). Its Visual check still never saw the app, and the run stopped at the gate "Nobody looked, round 1": "this Free run has no model that reads screenshots".free.profile.browser_holdergives the browser to thebrowsersubagent, which needs subagents on, or to the Visual check only when the judge tier's own models read images. Run 157 had Max subagents 0, since Free reads the flat copy of the run settings, and a judge tier without images. So the holder was empty, the run started without the Playwright server, and the Visual check was toldNO_BROWSER_NOTEand did not try. The rule predateslook, which lets any agent see a screenshot file through the vision tier.Fix
browsersubagent cannot: Playwright tools for the screenshots,lookto see them. The judge tier needs no images.Done when
A Free run with a vision tier and subagents off has its Visual check take screenshots and
lookat them, and opens no "Nobody looked" gate. A Free run with no vision tier says why. A simulated run covers both.Fixed in PR #334, closed on its simulated run, by the operator's rule.
free-look-no-subagentsis free-look with Max subagents 0 and a judge tier that reads no images, run 157's settings. Before the fix it stopped at the "Nobody looked" gate, as run 157 did. After it, the Visual check takes its screenshot, sees it withlook("FAKE VISION … image arrived as an image part of a user message"), and the run merges. The existing no-vision scenarios still open their gate when the run truly has no vision tier.