A stuck fix round changes approach, the Visual check's gaps fail the round, sims play Zen, and the self-check's lost osfd is fixed (#360 #268 #204 #205 #347) #362

Merged
cmoriarty merged 3 commits from claude/batch-free-fixloop into main 2026-11-03 04:41:34 -05:00
Owner

What changed

  • #360: a fix round whose round failed the same way as the one before it is told its last fix didn't change the failure, and to try a different approach. Sim: fix-stuck-tries-another.
  • #268: only a scenario about appearance is left to the Visual check, and one the check doesn't judge now fails the round. Run 152 left 16 scenarios with no test and no check.
  • #204 / #205: the sims now have a fake OpenCode Zen, so free-zen-busy-passed-over proves a refused session's move passes over a busy Zen model. Before this, a sim that moved to Zen reached the real service.
  • #347: the self-check's lost osfd. osfd was never killed: Stack.stop slept on the runner's one event loop, froze everyone's polling for 8 s, and uvicorn's 5 s keep-alive closed the connection the next poll went out on. Kills now run on a thread, and the polling client keeps no idle connection.

Evidence

  • ./tools/test.sh passes, as do all 77 sims.
  • Self-check: 30 of 30 pass, at 35 s each. Before the fix, 2 of 15 failed, at 53 s each.
  • free-zen-busy-passed-over fails with both the busy check and the cooling order disabled.
  • Free replay of a stuck agent.fix.r2: the agent received the new words and fixed the state itself, where round 1 had only written a note.

Not done

  • free-hold-between-steps is not written: a scenario can't reach that hold without the fake ledger spending quota on a served request.
  • #268's done-when still needs a planned project of several changes on a real model.

🤖 Generated with Claude Code

## What changed - **#360:** a fix round whose round failed the same way as the one before it is told its last fix didn't change the failure, and to try a different approach. Sim: `fix-stuck-tries-another`. - **#268:** only a scenario about appearance is left to the Visual check, and one the check doesn't judge now fails the round. Run 152 left 16 scenarios with no test and no check. - **#204 / #205:** the sims now have a fake OpenCode Zen, so `free-zen-busy-passed-over` proves a refused session's move passes over a busy Zen model. Before this, a sim that moved to Zen reached the real service. - **#347:** the self-check's lost osfd. osfd was never killed: `Stack.stop` slept on the runner's one event loop, froze everyone's polling for 8 s, and uvicorn's 5 s keep-alive closed the connection the next poll went out on. Kills now run on a thread, and the polling client keeps no idle connection. ## Evidence - `./tools/test.sh` passes, as do all 77 sims. - Self-check: 30 of 30 pass, at 35 s each. Before the fix, 2 of 15 failed, at 53 s each. - `free-zen-busy-passed-over` fails with both the busy check and the cooling order disabled. - Free replay of a stuck `agent.fix.r2`: the agent received the new words and fixed the state itself, where round 1 had only written a note. ## Not done - `free-hold-between-steps` is not written: a scenario can't reach that hold without the fake ledger spending quota on a served request. - #268's done-when still needs a planned project of several changes on a real model. 🤖 Generated with [Claude Code](https://claude.com/claude-code)
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Traced in the image: osfd was never killed. Stack.stop slept on the runner's one event loop for 8 s,
uvicorn closed the idle connection at 5 s, and the next poll was sent as it closed. The kills go on
a thread, and the polling client keeps no idle connection. 30 of 30 self-checks pass (2 of 15 failed
before), at 35 s each against 53 s.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid!362
No description provided.