Free profile: explore, the judge and the code review run on models that don't reason (run 89) #218
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
What happened
On run 89 (Free profile), the explore step and the judge ran on
gemini/gemini-3.5-flash-lite, which reports no reasoning tokens:src/game/screens.ts. The proposal then recorded these as settled.gemini/gemini-3.8-flash, which ran out of its 20 free requests a day partway through. The step finished on a mix of Flash-Lite andkilo/reflection/beam-free, and after 22 minutes it found nothing to fix.Proposal, design, apply and the spec tests ran on
kilo/reflection/beam-free, which does reason (thousands of reasoning tokens a step), and those parts of the run held up best.Suggested fixes
The review lenses' side of this is on #198.
Shipped in
f2b4f10(changejudge-and-reader-need-models-that-reason, commit3bb6112). Gemini 3.5 and 3.1 Flash-Lite are out of the judge and reader tiers (strong, fast and vision keep them); a tier with nothing left that has quota waits for the earliest reset. A model with fewer than 10 requests left in a counted window goes behind the tier's others when a chain is put, never out. Note: a Free run with a Gemini key alone is now refused at start, since the reader tier needs Kilo's beam, OVHcloud's Qwen or another key (real runs have Kilo and OVH, which need no key). Simulated runfree-judge-skips-flash-lite;free-review-looks-againnow reads again on North Mini Code.