Inference page on backends that report no load; Anthropic's slot count; the Free quota figure without minute and hour limits #199
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Follow-up to #194 (the top bar on the Free profile). The proposal for #194 (
free-top-bar) kept to the operator's three cells, and these came up while writing it:max_concurrent_upstreamon the Anthropic profile, whose limits are rates. Give it the same "no slot total" rule (capacity_source: none).reader tier 99% left today, and put the refill time back in the cell. Minute and hour limits still hold steps, which the cell shows asPaused until ….Each is small. 1 and 3 are bugs; 2 and 4 are choices for the operator.
Point 1 (rows a backend can't feed) is now part of #289, the Inference page redesign per backend.
Checked on production after #301 (
5355515), with run 144 on Free. Two of the three points work; point 2 doesn't, so this stays open./api/slotsand its history reportcapacity: null,capacity_source: none, where they read six before.FREE QUOTA all tiers 100% left today. During the run, beam-free had used 7 of its 200 requests that hour, and every tier still read 100% left: hour and minute limits no longer count.servingcarries a name too (kilo/beam-free), so "on Free" must come from the profile, not fromserving.name.Point 2 confirmed on production (
6f440e5, PR #310); closing.With Free in use, the Inference page draws a row per running step naming its model (run 145:
agent.implement … kilo/beam-free Running commands 4m 22s), where after #301 it drew none. Points 3 and 4 were confirmed with run 144, and point 1 moved to #289.Not seen live: the
waiting for free quotawording for a step held on spent quota, since no step was held.ui/src/lib/free.test.tscovers it.