A busy moment at OpenRouter taught Braid a limit of 1 a minute, for good #373

Closed
opened 2026-11-03 15:10:09 -05:00 by cmoriarty · 1 comment
Owner

What happens
A busy moment at OpenRouter taught Braid a limit of 1 request a minute, for all of OpenRouter, for good. The new Inference page shows it as 0/1* on both its models.

About 15 days ago north-mini-code:free answered: 429 "High demand for cohere/north-mini-code:free on OpenRouter - limited to 15 requests per minute. Please retry shortly." Braid had counted one request that minute, so it learned that count as the account's limit. A learned limit only ever goes down, and it's kept across restarts. OpenRouter is a fallback in the judge tier, so this has cost little so far.

Fix

  • Don't learn from a refusal about the provider's load. Read "high demand" as a short wait, as Kilo's refusals are now.
  • A learned limit should expire, so one bad reading can't last for ever.
  • Clear the openrouter minute limit that production has learned.

Done when
A test: that refusal's words teach no limit and spend the model briefly. Production's OpenRouter rows read their published limits again.

**What happens** A busy moment at OpenRouter taught Braid a limit of 1 request a minute, for all of OpenRouter, for good. The new Inference page shows it as `0/1*` on both its models. About 15 days ago `north-mini-code:free` answered: 429 "High demand for cohere/north-mini-code:free on OpenRouter - limited to 15 requests per minute. Please retry shortly." Braid had counted one request that minute, so it learned that count as the account's limit. A learned limit only ever goes down, and it's kept across restarts. OpenRouter is a fallback in the judge tier, so this has cost little so far. **Fix** - Don't learn from a refusal about the provider's load. Read "high demand" as a short wait, as Kilo's refusals are now. - A learned limit should expire, so one bad reading can't last for ever. - Clear the `openrouter` minute limit that production has learned. **Done when** A test: that refusal's words teach no limit and spend the model briefly. Production's OpenRouter rows read their published limits again.
Author
Owner

Shipped in PR #390, production ddd4b6b.

  • A refusal about the provider's load spends that model for two minutes and teaches nothing.
  • A learned count lasts a week. One saved with no time is dropped on load, which cleared production's.

Evidence: tests/free/test_load_refusals.py (failed first), using the words from production's log. On production after the deploy, OpenRouter's rows read 20 a minute and 50 a day, not learned, and no model has a learned limit.

**Shipped** in PR #390, production ddd4b6b. - A refusal about the provider's load spends that model for two minutes and teaches nothing. - A learned count lasts a week. One saved with no time is dropped on load, which cleared production's. **Evidence:** `tests/free/test_load_refusals.py` (failed first), using the words from production's log. On production after the deploy, OpenRouter's rows read 20 a minute and 50 a day, not learned, and no model has a learned limit.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#373
No description provided.