Test Execution Summary — November 2025¶

This report captures the latest full run of the Melodex Spotify Playlist Export test suites at the time of the case-study scope freeze.

Scope freeze commit: 2fdb518
Execution date: 2025-11-20
Runner(s): Local (Windows 10/11, Node 20) and GitHub Actions (Ubuntu LTS)
Browsers: Cypress (Chrome, Electron); Manual spot check in Firefox
Repo: https://github.com/michadereus/Melodex

1) Environment & Preconditions¶

Local¶

OS: Windows 10/11 x64
Node: v20.x
NPM: 10.x
Firefox: 142+, Electron: 37.6.0
Network: Stable broadband

CI¶

Provider: GitHub Actions
Image: ubuntu-latest
Node setup: actions/setup-node@vX
Artifacts: Cypress videos & screenshots, Vitest coverage HTML

Data/Accounts¶

Test user(s): ephemeral Cognito/Google QA accounts
Seed: ranked items present for export scenarios

Config flags¶

MAPPING_MODE=stub (CI default; test overrides for Integration)
__E2E_REQUIRE_AUTH__=true
Mobile viewport E2E enabled for E2E-008-Mobile

2) Commands Used¶

# install (monorepo)
npm -C melodex-back-end ci
npm -C melodex-front-end ci

# run full test suites
npx vitest run unit-ui
npx vitest run integration
npx cypress run --spec "tests/cypress/e2e/**/*.cy.ts"

# generate full-project LCOV
npx vitest run --coverage.enabled --coverage.reporter=lcov

# filter LCOV to changed-files
node scripts/lcov-filter.mjs coverage/lcov.info .changed-files.txt coverage/changed-lcov.info

# filter LCOV to feature-scope
node scripts/lcov-filter.mjs coverage/lcov.info .feature-scope.txt coverage/feature-lcov.info

# calculate coverage (lines / branches / functions) in text-summary format
node scripts/calc-coverage.mjs coverage/lcov.info
node scripts/calc-coverage.mjs coverage/changed-lcov.info
node scripts/calc-coverage.mjs coverage/feature-lcov.info

# generate HTML reports from filtered LCOV (requires lcov/genhtml installed)
genhtml coverage/changed-lcov.info -o coverage/changed-lcov-report
genhtml coverage/feature-lcov.info -o coverage/feature-lcov-report

3) Results Summary¶

Suite	Passed	Failed	Skipped	Duration
Unit/UI (Vitest)	`101`	`0`	`0`	`16.8s`
Integration (Vitest)	`40`	`0`	`0`	`5.94s`
E2E (Cypress)	`11`	`0`	`0`	`19.52s`
Total	`152`	`0`	`0`	`42.26s`

Execution Footprint¶

Suite	Spec files executed
Unit/UI (Vitest)	`27`
Integration (Vitest)	`15`
E2E (Cypress)	`10`

4) Coverage Summary¶

We track coverage at three levels. Overall coverage is informational; gates are enforced on changed files and on the feature scope. Note: Coverage is collected only from Vitest. Cypress E2E does not contribute coverage.

4.1 Overall Coverage¶

Vitest — informational
Scope: all lines instrumented by Vitest across the project

Metric	Percentage	Value
Lines	`51.46%`	`1865/3624`
Branches	`73.4%`	`345/470`
Functions	`70%`	`56/80`
Statements	`51.46%`	`1865/3624`

4.2 Changed-Files Coverage¶

Calculated against files modified since baseline a0dad94.
Target: ≥ 80% Lines & Branches on changed files.
Scope: changed-files scope files

Metric	Percentage	Value
Lines	`51.26%`	`1591/3104`
Branches	`75.28%`	`335/445`
Functions	`72.06%`	`49/68`

4.3 Feature-Scope Coverage¶

Target: ≥ 75% Lines & Branches within feature scope.
Scope: feature scope files

Metric	Percentage	Value
Lines	`62.73%`	`1540/2455`
Branches	`75.4%`	`328/435`
Functions	`74.14%`	`43/58`

5) Suite Breakdown (by requirement)¶

Snapshot of pass/fail by area. Full mapping is in the Traceability Appendix.

US-01 — Authenticate¶

UT: UT-001-Auth, UT-008-Auth — passed
IT: IT-001-Auth, IT-002-Auth, IT-010-Auth — passed
E2E: E2E-003-Auth — passed

US-02 — Export (Inline)¶

UT: UT-003, UT-004, UT-009, UT-010, UT-011 — passed
UI: UI-010, UI-011 — passed
IT: IT-003, IT-004, IT-006, IT-012, IT-013 — passed
E2E: E2E-001, E2E-002, E2E-008 — passed

US-03 — Review/Remove¶

UI: UI-002, UI-003, UI-010, UI-012, UI-013 — passed
IT: IT-005 — passed

US-04 — Name/Description¶

UT: UT-006 — passed
UI: UI-004, UI-014 — passed
IT: IT-006 — passed

US-05 — Progress & Errors¶

UI: UI-005 — passed
IT: IT-007 — passed
E2E: E2E-004 — passed

US-06 — Error handling¶

UT: UT-005, UT-007 — passed
UI: UI-006 — passed
IT: IT-008, IT-011 — passed
E2E: E2E-005, E2E-009 — passed

US-07 — Confirmation¶

UI: UI-007, UI-008 — passed
IT/E2E: IT-009, E2E-006 — passed

US-08 — Revoke access¶

UT: UT-002 — passed
IT: IT-010 — passed
E2E: E2E-007 — passed

TS-01/02/03 — Tech milestones¶

Covered by UT/IT/E2E above (mapping rules; progress/error envelope; per-track pipeline & 429 policy) — all green.

6) Evidence & Artifacts¶

Coverage report HTMLs
Logs at scope freeze:
- Vitest run
- Cypress run

7) Notable Defects Closed During Scope¶

DEF-001 — Verification code error (Auth): fixed; see PR #2; validated by SMK-00/01 and IT-001.
DEF-002 — Deezer preview expiry (Rankings): mitigated; see PR #3; tracked as risk R-05 with follow-up in Post-AC Polish.
DEF-003 — Background fetch before Apply: suppressed; see PR #4; verified in baseline + exploratory notes.
DEF-004 — Post-Spotify consent returns to /rankings without auto-opening Export: fixed; see PR #33; validated by IT-Auth OAuth resume + new E2E resume test.
DEF-005 — Export consistently fails with 502 on /api/playlist/export: fixed; see PR #32; validated by full IT export suite + E2E-001/004/007/009.
DEF-006 — Spotify OAuth session reused across Melodex account switch: fixed; see PR #34; validated by UT/IT/Auth tests + E2E-003/007.

8) Risks & Residual Items¶

R-05 — Deezer preview URL expiry: reduced but not eliminated; Post-AC ticket scheduled for ranked-audio rendering improvement.
Mobile perf variance: no regressions detected; monitor in future runs.
Rate-limit policy: validated under test loads; keep an eye on real-world Retry-After variance.

9) Quality Gates¶

All suites green (UT/UI/IT/E2E) — met
Changed-files coverage ≥ 80% (Lines & Branches) — not met
- Lines: 51.26% (1591/3104) — not met
- Branches: 75.28% (335/445) — met
Feature-scope coverage ≥ 75% (Lines & Branches) — not met
- Lines: 62.73% (1540/2455) — not met
- Branches: 75.4% (328/435) — met
No open Sev-1/Sev-2 defects — met
Contract tests (IT-007, IT-013) stable — met

Gate Waiver — Coverage¶

Decision: Proceed with merge despite lines coverage below threshold.

Rationale:
- This test campaign targeted a single feature set (Spotify export flow), not the entire app.
- High-impact paths are covered via E2E and integration (happy path, 429 policy, per-track errors, revoke).
- Branch coverage within both scopes are above target.

Compensating controls:
- Contract tests (IT-007/IT-013) enforce the API envelope & error policy.
- Cypress E2E asserts critical UX behaviors before release.