A Free run's Visual check can't look when subagents are off, though the run has vision and the look tool #333

Closed
opened 2026-10-30 10:08:42 -04:00 by cmoriarty · 1 comment
Owner

What happens
Run 157 (Free) had a vision tier (Gemini 3.5 and 3.1 Flash-Lite), training allowed, and the look tool (#217). Its Visual check still never saw the app, and the run stopped at the gate "Nobody looked, round 1": "this Free run has no model that reads screenshots".

free.profile.browser_holder gives the browser to the browser subagent, which needs subagents on, or to the Visual check only when the judge tier's own models read images. Run 157 had Max subagents 0, since Free reads the flat copy of the run settings, and a judge tier without images. So the holder was empty, the run started without the Playwright server, and the Visual check was told NO_BROWSER_NOTE and did not try. The rule predates look, which lets any agent see a screenshot file through the vision tier.

Fix

  • With a vision tier, the Visual check holds the browser whenever the browser subagent cannot: Playwright tools for the screenshots, look to see them. The judge tier needs no images.
  • The gate and the note name the real reason ("subagents are off for this run", or "no vision model for this run"), and how to fix it.

Done when
A Free run with a vision tier and subagents off has its Visual check take screenshots and look at them, and opens no "Nobody looked" gate. A Free run with no vision tier says why. A simulated run covers both.

**What happens** Run 157 (Free) had a vision tier (Gemini 3.5 and 3.1 Flash-Lite), training allowed, and the `look` tool (#217). Its Visual check still never saw the app, and the run stopped at the gate "Nobody looked, round 1": "this Free run has no model that reads screenshots". `free.profile.browser_holder` gives the browser to the `browser` subagent, which needs subagents on, or to the Visual check only when the judge tier's own models read images. Run 157 had Max subagents 0, since Free reads the flat copy of the run settings, and a judge tier without images. So the holder was empty, the run started without the Playwright server, and the Visual check was told `NO_BROWSER_NOTE` and did not try. The rule predates `look`, which lets any agent see a screenshot file through the vision tier. **Fix** - With a vision tier, the Visual check holds the browser whenever the `browser` subagent cannot: Playwright tools for the screenshots, `look` to see them. The judge tier needs no images. - The gate and the note name the real reason ("subagents are off for this run", or "no vision model for this run"), and how to fix it. **Done when** A Free run with a vision tier and subagents off has its Visual check take screenshots and `look` at them, and opens no "Nobody looked" gate. A Free run with no vision tier says why. A simulated run covers both.
Author
Owner

Fixed in PR #334, closed on its simulated run, by the operator's rule. free-look-no-subagents is free-look with Max subagents 0 and a judge tier that reads no images, run 157's settings. Before the fix it stopped at the "Nobody looked" gate, as run 157 did. After it, the Visual check takes its screenshot, sees it with look ("FAKE VISION … image arrived as an image part of a user message"), and the run merges. The existing no-vision scenarios still open their gate when the run truly has no vision tier.

**Fixed in PR #334, closed on its simulated run, by the operator's rule.** `free-look-no-subagents` is free-look with Max subagents 0 and a judge tier that reads no images, run 157's settings. Before the fix it stopped at the "Nobody looked" gate, as run 157 did. After it, the Visual check takes its screenshot, sees it with `look` ("FAKE VISION … image arrived as an image part of a user message"), and the run merges. The existing no-vision scenarios still open their gate when the run truly has no vision tier.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#333
No description provided.