A task is charged what the record says a task costs, model by model (#533) #577
Loading…
Reference in a new issue
No description provided.
Delete branch "claude/estimate-533"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Closes the estimate half of braid#533: a task is charged what the record says a task costs, model by model. The owner chose the estimate alone on 2026-11-20; nothing acts on the verdict yet (the split step is in no pipeline and no brief carries the estimate), so a run plans and runs as before. What changes is what
budget.json, the proposal gate's Size check and the pull request's estimate line say.Why. The estimate charged every task 1,200 tokens. The ledger's 35 apply attempts grew 23,177 tokens a task beyond the estimate's other terms (median), so every group read as fitting one step, the 11 that were compacted included.
What changes (
openspec/changes/estimate-per-task-533):(peak - other terms) / tasks, shrunk toward 1,200 like the centre, held to 1,200 to 60,000.osf.budget.estimated) names the group'sn_tasksand the step'smodel(vLLM qwen3.8-27b, orFree <tier>). Records from before give their task count as their tasks term over 1,200, and their model from their run's settings copy.budget.jsonnames the term and the model.Production's ledger, run through the new code read-only (all 35 records on vLLM qwen3.8-27b):
With other terms of 37,000, a group of up to 4 tasks fits, 5 is flagged and 6 or more reads "split". Estimated again, 8 of the 11 compacted attempts read "split", and 2 of the 24 that were not. This figure is in-sample: the next standard run is the check that is not.
Tests (
tests/engine/test_estimate_per_task.py, all small):budget.jsonthroughOSF_CALIBRATION_JSON; four attempts keep the bootstrap;vLLM qwen3.8-27b, and an older record of its run counts under that model.On main they fail (the code is not there).
./tools/test.shpassed in 54 s (backend 924, UI 212, browser 64);./tools/sim.sh --smoke7 of 7; a keptthorough-request-changessim recordedn_tasksand the model on its apply attempt, and itsbudget.jsonnamed the per-task term.Merging deploys osfd.
🤖 Generated with Claude Code