frostney / frostney/GocciaScript

Shard test files across machines and merge results

Open
#1,042 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

internal new feature
Dominant language
Pascal
Stars
20
Forks
3
Avg merge
3d 4h
Merged PRs (30d)
45

Description

Summary

Add deterministic cross-machine test-file sharding plus a merge step for shard results and coverage.

Why

--jobs parallelizes files inside one process, but large CI suites also need to divide work across independent machines without changing which tests run or losing one combined result.

Current behavior

The runner expands an ordered file list and can execute files with local workers. It has no shard identity/count, portable shard manifest, or command that combines independent test and coverage outputs.

Expected behavior

  • Accept a validated one-based shard index and total shard count.
  • Partition the resolved test-file set deterministically, independently of host count and local --jobs.
  • Record enough manifest metadata to detect incompatible or missing shard outputs.
  • Merge normalized test results and line/branch coverage without double-counting.
  • Derive the combined exit status from all shard results and report incomplete merges clearly.
  • Handle empty shards and shard counts larger than the file count predictably.

Scope notes

  • Local --jobs remains available within each shard and is not replaced.
  • This issue owns deterministic partitioning and artifact merge semantics, not a cloud scheduler or distributed worker coordinator.
  • Worker-process pools, intra-file concurrency, and retry/repeat policies are separate concerns.
  • The CI-reporting and coverage-threshold result models should be reusable inputs rather than parallel formats.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing the runner's ordered file-list expansion and local --jobs execution, then inspect the reusable CI-reporting and coverage-threshold result models. Define deterministic shard manifests, normalized result and coverage merging, and clear incomplete-merge status handling; verify behavior for empty shards and shard counts larger than the file count.

Written by the indexing model from the issue text.

Assessment

Domain
ci-cd, testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.