Free profile: what is left after #164 (a run that finishes, checks not yet recorded) #205
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Follow-up to #164, #186 and #195, archived in
5a953a0. The Free profile is live (productionc1228b4) and its refusal handling is proven on runs 76-78. What remains:Make a Free run finish
wip/202-beam-reasoning).From #164's tasks, not yet done (see the archived
free-profile/tasks.mdnotes)osfd doctor, osfd's env and mounts holding no key, and the reach checks.From #195
malformed_function_call(Gemini's finish reason) counted against the model, likeinvalid_output.From #186: 10.4, the timing of a review lens's and the judge's compactions (runs 73/74 measured the apply's).
Looked at with the Free batch of 2026-10-30 (#325, #326, #327). Still open here:
free-hold-between-steps,free-vision-spent-mid-browser) need the fake router to play quota running out between steps, and a screenshot read. That is harness work.malformed_function_call: no production event records how Gemini's finish reason arrives, so there is nothing yet to count. The nearest case seen is #327, beam-free's spilled paths, now repaired in the guards.osfd doctorand the reach checks. I'll do it after the batch deploys.Where it stands, 2026-10-30.
Done:
free-reasoning-required).osfd doctoron production (c959528) reads 0 failed. Every Free check is ok: the router answers at the pinned 0.1.103, the admin key authenticates, a secret reference is refused, and all five tiers have models, vision being Gemini 3.5 and 3.1 Flash-Lite. One warning: the sandbox is off (#201, #203).Left:
free-hold-between-stepsandfree-vision-spent-mid-browser, which need the fake router to play quota running out between steps, and a screenshot read.malformed_function_call, never yet seen on production, and a 10-minute cut seen live.Progress from PR 362. Staying open for what is left.
Done or replaced
free-zen-busy-passed-over, closed.free-vision-spent-mid-browser: replaced by #338's work.tools/replay.sh free, where opencode goes through the real router.Not written:
free-hold-between-steps. The hold a scenario reaches is a day-long demand hold, which it can't sit out. Testing it needs the fake ledger to spend quota on a served request.Still open
malformed_function_callcounted against the model.free-no-vision, unchecked in this pass.Closing: a Free run finishes and what this tracked has shipped.
free-no-visionsim exists (sim/free-no-vision-passed.yaml). 11.2 and 11.3 were replaced by braid#338's work andtools/replay.sh free.Dropped, unless a run shows a need:
malformed_function_callcounted against the model. It has never been seen on production, and nothing in the code reads it.free-hold-between-stepssim, the live 10-minute cut, and braid#186's 10.4 timings.The archived change
free-runs-finishcloses with this.