The primary may drive the browser itself; a model holds browser tools on a per-model flag, not by role #399

Closed
opened 2026-11-05 12:45:44 -05:00 by cmoriarty · 2 comments
Owner

What happens
The Playwright tools are denied on every agent but one: browser, or the judge and build only in a run without it. A primary that wants to look at its own page on a backend with subagents must delegate; it cannot take one look itself. The deny comes from the first browser-subagent change (#17), not from a measured failure of the primary. In a Free run browser is struck from the roster altogether (#338) because it ran on the vision tier, Gemini Flash-Lite, which failed 8 of 21 clicks in run 159. So no Free run has a browser subagent, and #381 cannot be shown on a Free replay.

Fix

  • Allow the Playwright tools on build and judge in every run, alongside browser.
  • Gate every holder on the model, not the role: a per-model browser flag in the Free config (next to images), meaning the model reads screenshots and drives reliably. browser_holder returns browser when a tier carries it, and the subagent runs on that tier, not the vision tier. A primary whose model has no such flag gets no browser tools.
  • The brief keeps pushing delegation: browser by default, for the sake of context (run 172's forks started at 139-179k); drive it yourself only when you have a reason. It also says not to drive the browser while a background check runs, as it already says not to edit what the check is looking at.

Done when
On a backend with subagents an apply step can open its page with its own Playwright tools, and the brief still names browser as the default. A Free run with a browser-flagged tier has a browser subagent and a Free replay of run 172's apply shows a background browser call (closes #381). A Free run without one behaves as today.

Related: #381, #338, #283, #139.

**What happens** The Playwright tools are denied on every agent but one: `browser`, or the judge and `build` only in a run without it. A primary that wants to look at its own page on a backend with subagents must delegate; it cannot take one look itself. The deny comes from the first browser-subagent change (#17), not from a measured failure of the primary. In a Free run `browser` is struck from the roster altogether (#338) because it ran on the vision tier, Gemini Flash-Lite, which failed 8 of 21 clicks in run 159. So no Free run has a `browser` subagent, and #381 cannot be shown on a Free replay. **Fix** - Allow the Playwright tools on `build` and `judge` in every run, alongside `browser`. - Gate every holder on the model, not the role: a per-model `browser` flag in the Free config (next to `images`), meaning the model reads screenshots and drives reliably. `browser_holder` returns `browser` when a tier carries it, and the subagent runs on that tier, not the vision tier. A primary whose model has no such flag gets no browser tools. - The brief keeps pushing delegation: `browser` by default, for the sake of context (run 172's forks started at 139-179k); drive it yourself only when you have a reason. It also says not to drive the browser while a background check runs, as it already says not to edit what the check is looking at. **Done when** On a backend with subagents an apply step can open its page with its own Playwright tools, and the brief still names `browser` as the default. A Free run with a browser-flagged tier has a `browser` subagent and a Free replay of run 172's apply shows a background browser call (closes #381). A Free run without one behaves as today. _Related: #381, #338, #283, #139._
Author
Owner

In PR #400. Tests and the new sim free-browser-on-judge-tier pass; ./tools/test.sh green in 26 s.

Free replay of run 172's apply (openspec-apply-all-6j6pg3-a1): succeeded in 11.1 min (17.4 before, with no subagent calls). One browser call, started in the background, served by the judge tier (Qwen3.8-27B, Qwen3.5-397B), never Flash-Lite; PASS with a screenshot. 81 strong-tier requests on kilo/beam-free.

**In PR #400.** Tests and the new sim `free-browser-on-judge-tier` pass; `./tools/test.sh` green in 26 s. **Free replay of run 172's apply** (`openspec-apply-all-6j6pg3-a1`): succeeded in 11.1 min (17.4 before, with no subagent calls). One `browser` call, started in the background, served by the judge tier (Qwen3.8-27B, Qwen3.5-397B), never Flash-Lite; PASS with a screenshot. 81 strong-tier requests on kilo/beam-free.
Author
Owner

Shipped in PR #400, merged as 2b6f451b; change browser-by-model-not-role archived (b7cfe4d1).

  • build and judge hold the Playwright tools in every run with a browser server, beside browser; review and repair never.
  • A Free tier drives when every model in its chain is in BROWSER_DRIVERS (judge and strong chains, not Flash-Lite) and its screenshots can be seen; browser runs on the judge tier, else strong, never vision.
  • The building brief: browser by default, an own look with a reason, hands off the browser while a check runs.

Evidence: tests/agent/test_build_looks.py, tests/engine/test_browser_delegation.py, sim free-browser-on-judge-tier; Free replay of run 172's apply above (11.1 min, one background browser on the judge tier). Deploys with this push to main.

**Shipped** in PR #400, merged as 2b6f451b; change `browser-by-model-not-role` archived (b7cfe4d1). - `build` and `judge` hold the Playwright tools in every run with a browser server, beside `browser`; `review` and `repair` never. - A Free tier drives when every model in its chain is in `BROWSER_DRIVERS` (judge and strong chains, not Flash-Lite) and its screenshots can be seen; `browser` runs on the judge tier, else strong, never vision. - The building brief: `browser` by default, an own look with a reason, hands off the browser while a check runs. **Evidence:** `tests/agent/test_build_looks.py`, `tests/engine/test_browser_delegation.py`, sim `free-browser-on-judge-tier`; Free replay of run 172's apply above (11.1 min, one background `browser` on the judge tier). Deploys with this push to main.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#399
No description provided.