A malformed tool call the server refuses fails the whole step (fastllm) #211

Closed
opened 2026-10-18 15:46:59 -04:00 by cmoriarty · 0 comments
Owner

Run 79 (Aurora Links, fastllm kind), 2026-10-18: openspec.apply[all] failed at 15 of 27 tasks on one session error:

provider.invalid-request: Invalid tool call: malformed_tool_block at index None (Tool 'read' contains malformed parameter markup)

fastllm 78fcbab (ftllm/openai_server/fastllm_completion.py, about line 3839) ends the stream with an invalid_tool_call error when the model's Qwen XML tool block does not parse. vLLM hands the text back instead. opencode does not retry the error and ends the turn, and Braid then judged the attempt. The retry started over in a fresh session, losing the context the session had built up. fastllm's log shows one such error in 8 hours.

Fix: on a backend other than Free, when the step's own session errors with an unparseable tool call, re-prompt the same session to make the call again, up to 3 times per attempt. Past that, the attempt ends as before.

Run 79 (Aurora Links, fastllm kind), 2026-10-18: `openspec.apply[all]` failed at 15 of 27 tasks on one session error: `provider.invalid-request: Invalid tool call: malformed_tool_block at index None (Tool 'read' contains malformed parameter markup)` fastllm 78fcbab (`ftllm/openai_server/fastllm_completion.py`, about line 3839) ends the stream with an `invalid_tool_call` error when the model's Qwen XML tool block does not parse. vLLM hands the text back instead. opencode does not retry the error and ends the turn, and Braid then judged the attempt. The retry started over in a fresh session, losing the context the session had built up. fastllm's log shows one such error in 8 hours. Fix: on a backend other than Free, when the step's own session errors with an unparseable tool call, re-prompt the same session to make the call again, up to 3 times per attempt. Past that, the attempt ends as before.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#211
No description provided.