Simulated run e2e-lane-inferred fails: its fix round changes no code #296

Closed
opened 2026-10-28 21:54:49 -04:00 by cmoriarty · 1 comment
Owner

What happens
The simulated run e2e-lane-inferred fails on main as well as on branches: agent.fix fails its third attempt with "the code has not changed since round 1's check, and .osf/fix/r1/repair.md does not say why". Every full ./tools/sim.sh reads 67 of 68, so a real regression in another scenario can hide behind it.

Fix
Make the scenario's scripted fix round change the code, or write a ## No change note, so it plays what the fix loop now asks for. If the loop is wrong instead, fix the loop.

Done when
./tools/sim.sh passes every scenario.

**What happens** The simulated run `e2e-lane-inferred` fails on main as well as on branches: `agent.fix` fails its third attempt with "the code has not changed since round 1's check, and `.osf/fix/r1/repair.md` does not say why". Every full `./tools/sim.sh` reads 67 of 68, so a real regression in another scenario can hide behind it. **Fix** Make the scenario's scripted fix round change the code, or write a `## No change` note, so it plays what the fix loop now asks for. If the loop is wrong instead, fix the loop. **Done when** `./tools/sim.sh` passes every scenario.
Author
Owner

Fixed in #301 (5355515), archived in #302.

The loop was right: the fixture repository's README quoted npx playwright test while describing its stand-in, and since Braid run #99 a documented Playwright command wins over the last one used. So the lane ran npx playwright test with no network and failed, and the fix round had nothing to change. The README now names only node e2e-run.js. ./tools/sim.sh passes all 69 scenarios.

Fixed in #301 (5355515), archived in #302. The loop was right: the fixture repository's README quoted `npx playwright test` while describing its stand-in, and since Braid run #99 a documented Playwright command wins over the last one used. So the lane ran `npx playwright test` with no network and failed, and the fix round had nothing to change. The README now names only `node e2e-run.js`. `./tools/sim.sh` passes all 69 scenarios.
Sign in to join this conversation.
No labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set

Reference
cmoriarty/braid#296
No description provided.