apache / apache/uniffle

[Umbrella] Slow integration tests

Open
#604 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
454
Forks
172
Avg merge
5d 17h
Merged PRs (30d)
5

Description

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

### Search before asking

- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues) and found no similar issues.

### Describe the proposal

Some integration tests are taking too long to execute, maybe we can improve them by tweaking configuration, reduce the sleep time, or reduce the workload.

### Task list

- [ ] Time elapsed: 249.674 s - in org.apache.uniffle.test.LargeSorterTest
- [ ] Time elapsed: 239.197 s - in org.apache.uniffle.test.WordCountTest
- [ ] Time elapsed: 235.059 s - in org.apache.uniffle.test.SecondarySortTest
- [ ] Time elapsed: 174.062 s - in org.apache.uniffle.test.RepartitionWithMemoryRssTest
- [ ] Time elapsed: 74.901 s - in org.apache.uniffle.test.ShuffleWithRssClientTest
- [ ] Time elapsed: 66.122 s - in org.apache.uniffle.test.RepartitionWithLocalFileRssTest
- [ ] Time elapsed: 48.638 s - in org.apache.uniffle.test.QuorumTest
- [ ] Time elapsed: 38.97 s - in org.apache.uniffle.test.AQESkewedJoinTest

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

Start by running the listed integration tests and measuring their current elapsed times, beginning with LargeSorterTest, WordCountTest, and SecondarySortTest. Inspect the configuration, sleep times, and workloads in those tests; done means preserving their coverage and behavior while reducing execution time.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
performance, testing
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.