Replace the test suite: every test in under 3 minutes on CI, and none flaky #241
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
The suite grew to ~5,600 tests (4,234 pytest, ~957 vitest, ~403 Playwright) plus a 5,640-line fixture backend (
ui/dev/fakeosfd.py). CI run 184 took 23 minutes (backend 235 s, browser specs 733 s, smoke sims ~5 min) and runs fail intermittently on timing (runs 173, 178).Replace it whole rather than audit it:
Shipped in #242 (archived in #243).
tools/test.sh. 118 backend tests, 40 vitest, 13 browser journeys. ~15 s on the laptop, 34-40 s with every core busy; CI job 41-57 s including setup (budget 180 s, enforced).tests/conftest.py); medium tests (real git) are marked; 1 s / 3 s limits; no retries anywhere.create_appwith a seeded store and a fake scheduler on an OS-chosen port per worker.tests/test_repo.py.docs/testing.md, and the rules are inopenspec/config.yaml.sim/+tools/sim.sh(not part of the suite); the deploy self-check uses them and passed.test / suite (pull_request)is now a required check onmain.POST /api/runswith the same client id started a second run.