Play the app end to end before calling it done #254

Closed
opened 2026-10-27 15:30:58 -04:00 by cmoriarty · 1 comment
Owner

What happens
In run 120's game, once the ball drains, the plunger won't launch it again, so a game can't go on. A minute of play finds it. The judge never did: its synthetic key presses can't hold a key, and in 4 of 9 planned runs it said it never saw the ball launch.

What we want

  • For an interactive app, play one whole session through the app's own state hook (like window.__game), not the keyboard.
  • For a game: start, launch, lose the ball, launch again, game over.
  • Ask agents to build that hook into interactive apps.

Done when
A bug like run 120's plunger fails the judge.

From the Braid vs Claude Code pinball test, 2026-10-27 (runs 110–120).

**What happens** In run 120's game, once the ball drains, the plunger won't launch it again, so a game can't go on. A minute of play finds it. The judge never did: its synthetic key presses can't hold a key, and in 4 of 9 planned runs it said it never saw the ball launch. **What we want** - For an interactive app, play one whole session through the app's own state hook (like `window.__game`), not the keyboard. - For a game: start, launch, lose the ball, launch again, game over. - Ask agents to build that hook into interactive apps. **Done when** A bug like run 120's plunger fails the judge. _From the Braid vs Claude Code pinball test, 2026-10-27 (runs 110–120)._
Author
Owner

What shipped

  • The apply briefs ask an interactive web app to expose window.__app (state() and the actions a person takes).
  • The judge plays one whole session through it by script: for a game, launch, lose the ball, launch the next, game over. A criterion fails when the app cannot go on.

The judge's report already fails on any failed criterion.

Shipped in 5598ddf (OpenSpec change checks-that-match-the-brief, archived).

**What shipped** - The apply briefs ask an interactive web app to expose `window.__app` (`state()` and the actions a person takes). - The judge plays one whole session through it by script: for a game, launch, lose the ball, launch the next, game over. A criterion fails when the app cannot go on. The judge's report already fails on any failed criterion. _Shipped in 5598ddf (OpenSpec change `checks-that-match-the-brief`, archived)._
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#254
No description provided.