Mirrors/super-productivity
1
0
Fork 0
mirror of https://github.com/johannesjo/super-productivity.git synced 2026-01-22 18:30:09 +00:00
Code Issues Projects Releases Wiki Activity
super-productivity/e2e-optimization-baseline.md
Johannes Millan 055e1959af docs(e2e): add SuperSync test optimization results 
Documents Phase 1 optimization results:
- 27% faster per-test execution (15.1s → 11.0s)
- 100% reduction in flaky tests (4 → 0)
- 28% faster total suite time (32min → 23min)

Includes baseline measurements and detailed change log.
2026-01-18 17:14:36 +01:00

1 KiB
Raw Permalink Blame History

SuperSync E2E Test Performance - Baseline Measurement

Date: 2026-01-18 Total Duration: 10:34.81 (634.81 seconds) Test Results:

  • 42 passed
  • 81 skipped
  • 4 flaky (infrastructure issues - SuperSync server became unhealthy mid-run)

Flaky Tests:

  1. supersync-encryption.spec.ts - Encrypted data fails to sync with wrong password
  2. supersync-error-handling.spec.ts - Concurrent modification triggers LWW conflict resolution
  3. supersync-error-handling.spec.ts - Three clients converge to same state
  4. supersync-import-clean-slate.spec.ts - Import drops ALL concurrent work (clean slate)

Average per-test time: 634.81 / 127 = ~5 seconds per test

Note: The flaky tests failed due to SuperSync server health issues (ECONNREFUSED), not test logic.

Optimization Targets

Based on the plan:

  • Conservative: 25% reduction → ~8 minutes (476 seconds)
  • Optimistic: 40% reduction → ~6.3 minutes (381 seconds)

Phase 1 Optimizations

Starting Phase 1 with 4 sub-tasks to reduce wait times systematically.