buildkite / buildkite/test-engine-client

Support for parallelization by test suite

Open
#154 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
30
Forks
16
Avg merge
3d 5h
Merged PRs (30d)
15

Description

Right now it seems like test-splitter is designed to run a lot of tests for a single test suite. It would be nice if it could support the idea of parallelizing across test suites. This feedback is directed at future support for non-rspec test suites.

For example in our javascript monorepo pipeline right now we have many (100+) test suites which we dynamically look up and run. Our pipeline looks something like this right now:

```yaml
- label: 'Test Suites Batch %n'
parallelism: 6
command:
- run-unit-tests.js
```

Where `run-unit-tests.js` will find a list of all test suites to run and deterministically run a random subset of those suites based on its batch # out of the total batches. In our particular example, running a suite looks like running a command `nx run {suite}:test`.

Maybe the main difference in this proposed approach vs. the current approach is to alter the assumption that `test-splitter` would be operating on a per-file basis? Another way to look at this is running groups of tests independent of the underlying individual files.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.