One model the Free router does not know silences its whole chain #582

Closed
opened 2026-11-21 11:10:48 -05:00 by cmoriarty · 1 comment
Owner

What happens

When the Free router does not know one model of a run's chain, it refuses the whole chain: 400 "target model not found: ". Every request of that tier then answers 404, and no model serves. The missing model is never taken out: a model is marked gone only when a request to it answers 404, and this one never gets a request. Found in a Free replay on 2026-11-20, where hetzner/Qwen3.8-27B silenced five chains (braid#581).

Fix

On that refusal, mark the model gone, as a served 404 does, and register the chain again without it.

Done when a chain with one model the router does not know registers with the rest, and the model is not sent again.

**What happens** When the Free router does not know one model of a run's chain, it refuses the whole chain: 400 "target model not found: <ref>". Every request of that tier then answers 404, and no model serves. The missing model is never taken out: a model is marked gone only when a request to it answers 404, and this one never gets a request. Found in a Free replay on 2026-11-20, where `hetzner/Qwen3.8-27B` silenced five chains (braid#581). **Fix** On that refusal, mark the model gone, as a served 404 does, and register the chain again without it. **Done when** a chain with one model the router does not know registers with the rest, and the model is not sent again.
Author
Owner

Shipped in #583 (merged as c9c5e63, live on production), and archived in #584.

A model the router refuses a chain for, not knowing it, is now marked gone, as a served 404 makes a model, and the chain is registered again without it. A test with gomodel's own refusal fails before the change and passes after. Production's Free profile is not in use, so no live run has met it yet.

Shipped in #583 (merged as `c9c5e63`, live on production), and archived in #584. A model the router refuses a chain for, not knowing it, is now marked gone, as a served 404 makes a model, and the chain is registered again without it. A test with gomodel's own refusal fails before the change and passes after. Production's Free profile is not in use, so no live run has met it yet.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#582
No description provided.