Free: Kilo's refusals count, Hetzner and OVH add capacity, spec-test steps keep to tests (#367 #368 #369) #371

Merged
cmoriarty merged 3 commits from claude/batch-free-capacity into main 2026-11-03 14:54:44 -05:00
Owner

Three fixes from run 170. The Inference page redesign (#370) follows in its own PR.

#368: a spec-test step that edits code no longer fails the run. The engine puts the code back at the failure and retries, telling the agent what it restored. A plain retry could skip the step with the edit left in. The brief now says not to change code in order to test it. Run 170's step, replayed on Free: succeeded in 1.6 min, 22 requests, no errors, no code changed.

#367: Kilo's refusals count as quota. It refused at 100 requests, below any count Braid could keep, and run 170 met its breaker 142 times. Now each refusal spends it for 10 minutes and teaches no limit. KILO_API_KEY raises the limit to 300: 110 of 110 served through the router. A wait no quota explains no longer says quota is spent.

#369: more free capacity.

  • Hetzner's Qwen3.8-27B joins, with zero retention. It goes behind Kilo, because the replay measured it at 86 s a request against Kilo's 4.4 s.
  • OVH's Qwen3.8-27B and Qwen3.6-27B, and Inception's mercury-3, join too.
  • The catalog is corrected against each provider's own page.
  • A chain the router refuses is now logged.

Checked: ./tools/test.sh passes, and every sim passes.

🤖 Generated with Claude Code

Three fixes from run 170. The Inference page redesign (#370) follows in its own PR. **#368: a spec-test step that edits code no longer fails the run.** The engine puts the code back at the failure and retries, telling the agent what it restored. A plain retry could skip the step with the edit left in. The brief now says not to change code in order to test it. Run 170's step, replayed on Free: succeeded in 1.6 min, 22 requests, no errors, no code changed. **#367: Kilo's refusals count as quota.** It refused at 100 requests, below any count Braid could keep, and run 170 met its breaker 142 times. Now each refusal spends it for 10 minutes and teaches no limit. `KILO_API_KEY` raises the limit to 300: 110 of 110 served through the router. A wait no quota explains no longer says quota is spent. **#369: more free capacity.** - Hetzner's Qwen3.8-27B joins, with zero retention. It goes behind Kilo, because the replay measured it at 86 s a request against Kilo's 4.4 s. - OVH's Qwen3.8-27B and Qwen3.6-27B, and Inception's mercury-3, join too. - The catalog is corrected against each provider's own page. - A chain the router refuses is now logged. **Checked:** `./tools/test.sh` passes, and every sim passes. 🤖 Generated with [Claude Code](https://claude.com/claude-code)
Run 170's first spec-test step edited code to test it, failed tests-only, and failed the run. A plain
retry isn't safe: a retried step's condition can skip it with the edit left in place. So the engine
restores the files that aren't tests at the failure, retries, and tells the agent what it put back
and why. The brief now says not to change code in order to test it, an added export included.

A replay keeps the image's browser cache, since a project on another Playwright failed its
dependency step on root's browsers. Run 170's step, replayed on Free: succeeded in 1.6 min, 22
requests, no errors, no code changed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
#367: Kilo's refusals read as quota, spending it for ten minutes with no limit learned: it refused
below any count Braid could keep, and run 170 met its breaker 142 times. KILO_API_KEY raises its
100 requests to 300. A wait no quota explains no longer says quota is spent.

#369: the sweep of free plans. Hetzner's Qwen3.8-27B joins, zero retention, behind Kilo: 86 s a
request against Kilo's 4.4 s, so a step on it wrote nothing in 31 minutes where Kilo finished in 1.6.
It carries a step while Kilo's count is out, and leads for a private repository, which can't use
Kilo. OVH's Qwen3.8-27B and Qwen3.6-27B, Inception's mercury-3, and the catalog corrected. A chain
the router refuses is now logged, which is how a sim's missing model showed itself.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
chore(openspec): archive spec-tests-keep-to-tests, free-refusals-count and free-capacity-hetzner
All checks were successful
test / suite (pull_request) Successful in 36s
1d7f925cb1
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Sign in to join this conversation.
No reviewers
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid!371
No description provided.