The judge should compare the look with the brief #253

Closed
opened 2026-10-27 15:30:58 -04:00 by cmoriarty · 1 comment
Owner

What happens
The judge's only browser check is "readable page, no page errors". The planned pinball game looked like placeholder art and passed every time.

What we want

  • A judge criterion that compares a screenshot with what the brief asks for: look, theme, polish.
  • Failing it sends the run back for a fix, like any other criterion.

Done when
A plain, unstyled page fails the judge when the brief asks for high-quality graphics.

Related: #252.

From the Braid vs Claude Code pinball test, 2026-10-27 (runs 110–120).

**What happens** The judge's only browser check is "readable page, no page errors". The planned pinball game looked like placeholder art and passed every time. **What we want** - A judge criterion that compares a screenshot with what the brief asks for: look, theme, polish. - Failing it sends the run back for a fix, like any other criterion. **Done when** A plain, unstyled page fails the judge when the brief asks for high-quality graphics. Related: #252. _From the Braid vs Claude Code pinball test, 2026-10-27 (runs 110–120)._
Author
Owner

What shipped

  • A change's judge now gets the run's brief and a criterion comparing the look with what the brief asks for (graphics, theme, polish), whatever the specs say. A plain, unstyled page fails it when the brief asks for more.

No unit test: docs/testing.md rules out tests of a prompt's wording; the simulated runs build the prompt end to end.

Shipped in 5598ddf (OpenSpec change checks-that-match-the-brief, archived).

**What shipped** - A change's judge now gets the run's brief and a criterion comparing the look with what the brief asks for (graphics, theme, polish), whatever the specs say. A plain, unstyled page fails it when the brief asks for more. No unit test: docs/testing.md rules out tests of a prompt's wording; the simulated runs build the prompt end to end. _Shipped in 5598ddf (OpenSpec change `checks-that-match-the-brief`, archived)._
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#253
No description provided.