The Free Inference page is too much text, and hides what's running and what's left #370

Closed
opened 2026-11-03 13:37:12 -05:00 by cmoriarty · 2 comments
Owner

What happens
The Inference page on Free is mostly plain text, so a person has to read it to learn anything. It doesn't say which model is running. Tier rows spell every model out as a sentence. The model table's one clear figure is "Left", a percentage that says neither how much is left nor of what, and nothing says which providers have an API key.

Fix

  • At the top: the model serving now, with its stats and the steps it's serving.
  • Free quota: one row per tier, collapsed by default, showing how many models are ready. Expanding it shows the tier's models in order.
  • The model table: each model's capacity and current use, requests and tokens, as a bar per limit with the numbers beside it, plus when it resets and whether its provider has a key.
  • Little free text: explanations go in info bubbles.

Done when

  • A browser test: the page names the serving model and its stats, and a tier expands to its models.
  • The numbers are the ledger's own, read per limit, and the owner has seen the page.
**What happens** The Inference page on Free is mostly plain text, so a person has to read it to learn anything. It doesn't say which model is running. Tier rows spell every model out as a sentence. The model table's one clear figure is "Left", a percentage that says neither how much is left nor of what, and nothing says which providers have an API key. **Fix** - At the top: the model serving now, with its stats and the steps it's serving. - Free quota: one row per tier, collapsed by default, showing how many models are ready. Expanding it shows the tier's models in order. - The model table: each model's capacity and current use, requests and tokens, as a bar per limit with the numbers beside it, plus when it resets and whether its provider has a key. - Little free text: explanations go in info bubbles. **Done when** - A browser test: the page names the serving model and its stats, and a tier expands to its models. - The numbers are the ledger's own, read per limit, and the owner has seen the page.
Author
Owner

Shipped in PR 372, live on production at d53f9e9. The owner reviewed it, asked for eight changes, and approved the result.

From the top of the page:

  • Now serving: the models that last answered a run's steps, whether Braid has their keys, what the run has done as a whole, and its steps. With nothing running, it names the last model and when.
  • Charts: moved up under that, each only if it has data in the chosen window.
  • Free quota: a row per tier, collapsed, with a dot per model and how many are ready. Each opens to its chain.
  • Models: a grid of used/limit over a bar for each limit, the last hour in columns, and the key, with the words in the headers.

Evidence:

  • A browser journey on a test server running the real Free service, plus unit tests of the figures. ./tools/test.sh passes, and every Free sim.
  • On production's own data at d53f9e9: 19 models, every key state correct, tiers collapsed, charts hidden with nothing in the last hour, no page errors, and the table fits with all seven limit columns. Now serving hasn't yet been seen with a real run on production; the full Free run will show it.

The top bar's quota cell is still the old wording: that's #364.

**Shipped in [PR 372](https://forgejo.underthere.xyz/cmoriarty/braid/pulls/372), live on production at d53f9e9.** The owner reviewed it, asked for eight changes, and approved the result. From the top of the page: - **Now serving:** the models that last answered a run's steps, whether Braid has their keys, what the run has done as a whole, and its steps. With nothing running, it names the last model and when. - **Charts:** moved up under that, each only if it has data in the chosen window. - **Free quota:** a row per tier, collapsed, with a dot per model and how many are ready. Each opens to its chain. - **Models:** a grid of `used/limit` over a bar for each limit, the last hour in columns, and the key, with the words in the headers. **Evidence:** - A browser journey on a test server running the real Free service, plus unit tests of the figures. `./tools/test.sh` passes, and every Free sim. - On production's own data at d53f9e9: 19 models, every key state correct, tiers collapsed, charts hidden with nothing in the last hour, no page errors, and the table fits with all seven limit columns. Now serving hasn't yet been seen with a real run on production; the full Free run will show it. The top bar's quota cell is still the old wording: that's #364.
Author
Owner

Now serving seen on production with a real run, run 171: beam-free with its key set, the run's steps, time, requests, tokens and models, and the running step under them. The charts appear below it now that there's data, with no page errors, and the table still fits at 1440 px.

Now serving seen on production with a real run, run 171: `beam-free` with its key set, the run's steps, time, requests, tokens and models, and the running step under them. The charts appear below it now that there's data, with no page errors, and the table still fits at 1440 px.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#370
No description provided.