[Umbrella] Slow integration tests
- Dominant language
- Java
- Stars
- 454
- Forks
- 172
- Avg merge
- 5d 17h
- Merged PRs (30d)
- 5
Description
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues) and found no similar issues.
### Describe the proposal
Some integration tests are taking too long to execute, maybe we can improve them by tweaking configuration, reduce the sleep time, or reduce the workload.
### Task list
- [ ] Time elapsed: 249.674 s - in org.apache.uniffle.test.LargeSorterTest
- [ ] Time elapsed: 239.197 s - in org.apache.uniffle.test.WordCountTest
- [ ] Time elapsed: 235.059 s - in org.apache.uniffle.test.SecondarySortTest
- [ ] Time elapsed: 174.062 s - in org.apache.uniffle.test.RepartitionWithMemoryRssTest
- [ ] Time elapsed: 74.901 s - in org.apache.uniffle.test.ShuffleWithRssClientTest
- [ ] Time elapsed: 66.122 s - in org.apache.uniffle.test.RepartitionWithLocalFileRssTest
- [ ] Time elapsed: 48.638 s - in org.apache.uniffle.test.QuorumTest
- [ ] Time elapsed: 38.97 s - in org.apache.uniffle.test.AQESkewedJoinTest
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
Contributor guide
Research direction
Start by running the listed integration tests and measuring their current elapsed times, beginning with LargeSorterTest, WordCountTest, and SecondarySortTest. Inspect the configuration, sleep times, and workloads in those tests; done means preserving their coverage and behavior while reducing execution time.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- performance, testing
- Issue type
- Refactor
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100