The Inference page names a model on every row, not only on Free #309

Closed
opened 2026-10-29 15:32:32 -04:00 by cmoriarty · 1 comment
Owner

What happens
#199's stepServedWords shows vLLM/qwen3.8-27b beside every running step on the vLLM profile: off Free, a step's serving has a provider too.

Fix
Return nothing when the step's backend is a saved profile (serving.name set), as the spec says.

Done when
On vLLM the rows show no model; on Free each names the model that last answered it.

Seen on production after PR #301.

**What happens** #199's `stepServedWords` shows `vLLM/qwen3.8-27b` beside every running step on the vLLM profile: off Free, a step's `serving` has a provider too. **Fix** Return nothing when the step's backend is a saved profile (`serving.name` set), as the spec says. **Done when** On vLLM the rows show no model; on Free each names the model that last answered it. _Seen on production after PR #301._
Author
Owner

Confirmed on production (6f440e5, PR #310); closing.

  • Free in use, run 145's agent.implement: the Inference page draws a row per running step, and the row names the model serving it: agent.implement · On the Links page… kilo/beam-free Running commands 4m 22s.
  • vLLM in use, run 146's plan.write.auto: the slot row reads plan.write.auto · A Breakout game for the browser, built with Vite Thinking 4m 32s, with no model, since the backend serves one.
**Confirmed on production (6f440e5, PR #310); closing.** - **Free in use**, run 145's `agent.implement`: the Inference page draws a row per running step, and the row names the model serving it: `agent.implement · On the Links page… kilo/beam-free Running commands 4m 22s`. - **vLLM in use**, run 146's `plan.write.auto`: the slot row reads `plan.write.auto · A Breakout game for the browser, built with Vite Thinking 4m 32s`, with no model, since the backend serves one.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#309
No description provided.