test_runner: tracking issue for code coverage stabilization
Dieses Issue hat noch niemand übernommen.
- Vorherrschende Sprache
- JavaScript
- Sterne
- 122k
- Forks
- 37.3k
- Ø Merge
- 4 T. 2 Std.
- Gemergte PRs (30 T.)
- 283
Beschreibung
This issue tracks the remaining work to move node:test code coverage out of experimental.
The previous tracker, #53924 (previous stabilization tracker), was closed after narrowing the formal remaining item to replacing or aliasing --experimental-test-coverage with --test-coverage. There are still open issues and PRs that look relevant to stabilization, so it would be useful to have an umbrella issue again.
Scope
This is about test runner coverage enabled with:
node --test --experimental-test-coverage
This is not intended to track every NODE_V8_COVERAGE issue, only the ones that materially affect confidence in node:test coverage.
Proposed stabilization checklist
Likely blockers
- Add or alias a stable
--test-coverageenable flag- historical context: #53924 — previous stabilization tracker
- Fix coverage correctness for
isolation=none- issue: #60023 — coverage with
isolation=nonedoes not work correctly - PR: #63079
- issue: #60023 — coverage with
- Fix major sourcemap correctness bugs
- #54753 — false missing coverage for TypeScript
import type - #55054 — sourcemap coverage can fail for remapped files
- #54753 — false missing coverage for TypeScript
- Confirm CLI and
run()API coverage behavior are aligned for common cases- related: #60023 —
isolation=none/ API coverage mismatch - related PR: #63079
- related: #60023 —
- Re-enable the skipped isolation coverage test in core
test/parallel/test-runner-coverage.js
Strong candidates to resolve before stabilization
- Review performance of built-in coverage
- #55103 — built-in coverage is reported as significantly slower than existing tooling
- Finalize default include/exclude behavior
- issue: #63397 — default test exclusion does not match dotfiles
- PR: #63401
- Make reporter behavior consistent where coverage is involved
- #60884 — dot reporter does not surface coverage output/failures clearly
- #61586 — ignored lines and lcov branch data are inconsistent
- PR: #63443
Likely follow-up work unless parity is required first
- Decide whether statement coverage is required before stabilization
- issue: #54530 — add statement coverage support
- PR: #62340
- Decide whether untouched files matched by include globs should report as 0%
- #58887 — support reporting untested matched files as 0% covered
- Decide whether excluding empty lines should be supported
- #60996 — add an option to exclude empty lines from coverage
Open issues most directly related to test coverage
Correctness / stabilization
- #60023 — Test runner with
isolation=nonedoes not work with coverage - #54753 —
--experimental-test-coveragefalsely reports missing coverage where TS source isimport type - #55054 — Could not report code coverage for file in sourcemap
- #55103 — Slow performances when running tests with
--experimental-test-coverage
Reporting / exclusion / polish
- #61586 —
node:coverageignore comments exclude DA but leave BRDA in lcov output - #63397 — default
--test-coverage-excludebehavior does not apply to dotfiles - #60884 — dot reporter should print coverage failures/output
- #58887 — report 0% coverage for untested files matched by include globs
- #60996 — add option to exclude empty lines from coverage report
Coverage model / parity
- #54530 — support statement coverage
Open PRs to watch
- #63079 — test_runner: support coverage with isolation:'none' via run() API
- #63401 — test_runner: match dotfiles in default coverage exclude
- #62340 — test_runner: add statement coverage support
- #63443 — test_runner: print coverage report with dot reporter
Lower-level issues worth watching
These are broader than node:test, but may still matter if they show up in test runner coverage behavior:
- #53652 — incorrect uncovered block around some
switch/ case patterns - #41387 — inconsistent coverage information when loaders are used
- #46378 —
NODE_V8_COVERAGEbehaves inconsistently with workers - #35212 — coverage may not be saved on SIGINT/SIGTERM
- #44364 —
NODE_V8_COVERAGEcan run OOM when many scripts are compiled - #35783 — V8 coverage API next steps
Proposed exit criteria
Coverage can likely move out of experimental when:
--test-coverageexists as the stable entry point.isolation=nonecoverage correctness is fixed.- The major sourcemap correctness bugs are resolved.
- CLI and
run()API behavior match for common coverage use cases. - The remaining open issues are triaged into:
- blocker for stabilization
- follow-up semver-minor work
- unrelated to stabilization
Note
This issue is meant to restore a single place to track stabilization work now that #53924 is closed, not to block future semver-minor improvements after stabilization.
Disclaimer: I used AI to compile this list, then edited by hand.
Beitragsleitfaden
Erste Schritte
- Lies das ganze Issue und danach den Beitragsleitfaden des Projekts.
- Schreib ins Issue, dass du es übernimmst — das erspart doppelte Arbeit.
- Forke das Repository und arbeite in einem Branch.
- Öffne einen Pull Request, der die Issue-Nummer nennt.
Rechercherichtung
Beginne mit der vorgeschlagenen Checkliste zur Stabilisierung und führe den Coverage-Befehl node --test --experimental-test-coverage aus. Der benannte Einstiegspunkt für die verbleibenden Kern-Testarbeiten ist test/parallel/test-runner-coverage.js; der Abschluss hängt davon ab, die aufgeführten Probleme zu triagieren und die mehrteiligen Abschlusskriterien zu erfüllen, statt nur eine isolierte Änderung vorzunehmen.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Bewertung
- Tech-Stack
- javascript, nodejs
- Bereich
- cli, testing-qa
- Issue-Typ
- Feature
- Schwierigkeit
- 5/5
- Geschätzter Aufwand
- Über eine Woche
- Aktivitätsstatus
- Ruhig
- Klarheit
- Muss geklärt werden
- Anfängerfreundlichkeit
- 25/100