Replace the test suite: every test in about a minute, no flakes (#241) #242
Loading…
Reference in a new issue
No description provided.
Delete branch "test/rebuild-suite"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Closes #241. OpenSpec change:
openspec/changes/rebuild-the-test-suite/(proposal, design, specs, tasks). The standard:docs/testing.md.Before: 4,234 pytest + ~957 vitest + ~403 Playwright tests and a 5,640-line fixture backend; 23 minutes on CI (run 184), intermittent timing failures (runs 173, 178).
After: 118 backend tests, 40 vitest, 13 browser journeys.
tools/test.shruns all of them in ~15 s on the laptop, and 34 to 40 s with every core busy (yes×8). Three clean runs and three runs under load all passed, and the browser suite passed 65/65 repeated five times under load.OSF_TEST_BUDGET_S),timeout-minutes: 4.tests/conftest.pymakes subprocess, non-loopback sockets andtime.sleepraise. Medium tests (real git) are marked. Per-test limits are 1 s and 3 s.create_appon a fresh SQLite store, a fake scheduler and an OS-chosen port per worker, with runs seeded through the real event log (tests/support/e2e_server.py). Web-first assertions only,retries: 0.tests/test_repo.pyfails on a tag that names nothing.sim/andtools/sim.sh; the image self-check readssim/.Bug found by the new tests: a retried
POST /api/runswith the same client id started a second run (_prior_seqmatchedrun_id IS NULL). Fixed.After merge: make
testa required check onmain.