The top bar's backend cells are global: give each run its own backend state, keep Braid's services at the top #324

Closed
opened 2026-10-30 02:11:30 -04:00 by cmoriarty · 1 comment
Owner

What happens
The top bar's INFERENCE · STATUS · SLOTS cells describe one global backend. Since #305 and #313 each run has its own backend, so they no longer describe anything. On 2026-10-30, with a Free run beside the vLLM Breakout project, the bar read INFERENCE multiple, Running, and SLOTS 1/6 with two slots lit. The Inference page has the same limit: it draws the profile in use, so a Free run's row beside a vLLM project names no model.

Fix (the operator's direction)

  • Backend state belongs to each run: its backend, model, slot use, quota and health, on its run bar and its rows on Home (#321 groups those by repository).
  • The top bar keeps only what is global: Braid's own services and dependencies (osfd, the forge, each configured backend's reachability, the router), not one backend's slots.
  • The Inference page shows each backend that is in use, with its own runs' rows under it.

Done when
With runs on two backends, each run shows its own backend's state; the top bar shows Braid's services only; and the Inference page lists both backends with their runs. A browser spec covers it.

**What happens** The top bar's INFERENCE · STATUS · SLOTS cells describe one global backend. Since #305 and #313 each run has its own backend, so they no longer describe anything. On 2026-10-30, with a Free run beside the vLLM Breakout project, the bar read `INFERENCE multiple`, `Running`, and `SLOTS 1/6` with two slots lit. The Inference page has the same limit: it draws the profile in use, so a Free run's row beside a vLLM project names no model. **Fix (the operator's direction)** - **Backend state belongs to each run:** its backend, model, slot use, quota and health, on its run bar and its rows on Home (#321 groups those by repository). - **The top bar keeps only what is global:** Braid's own services and dependencies (osfd, the forge, each configured backend's reachability, the router), not one backend's slots. - **The Inference page** shows each backend that is in use, with its own runs' rows under it. **Done when** With runs on two backends, each run shows its own backend's state; the top bar shows Braid's services only; and the Inference page lists both backends with their runs. A browser spec covers it.
Author
Owner

Done in batch B, merged as #355 (91f4b85f), and live on production: Braid reports commit c00c62f, which includes it. It was checked with the repo's tests and sims before the merge. A live check on vLLM is still to come: trogdor is off the network. Closed at the owner's request.

Done in batch B, merged as #355 (`91f4b85f`), and live on production: Braid reports commit `c00c62f`, which includes it. It was checked with the repo's tests and sims before the merge. A live check on vLLM is still to come: trogdor is off the network. Closed at the owner's request.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#324
No description provided.