[FEA] Reduce C++ test runtime
Nobody has claimed this yet.
- Dominant language
- Cuda
- Stars
- 854
- Forks
- 236
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 62
Description
I opened #602 to reduce CAGRA test runtime. The CI jobs currently spend over an hour for that single test (see PR for details).
We should do the same kinds of work to break tests into multiple executables and reduce the parameter sets for these test suites:
NEIGHBORS_TEST(1486 seconds)NEIGHBORS_DYNAMIC_BATCHING_TEST(950 seconds)NEIGHBORS_ANN_IVF_PQ_TEST(835 seconds)NEIGHBORS_ANN_VAMANA_TEST(505 seconds)NEIGHBORS_ANN_NN_DESCENT_TEST(438 seconds)NEIGHBORS_ANN_IVF_FLAT_TEST(380 seconds)
(source for runtimes)
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with issue #602 and the CI runtime report linked in this issue, then inspect the six named test suites: NEIGHBORS_TEST, NEIGHBORS_DYNAMIC_BATCHING_TEST, NEIGHBORS_ANN_IVF_PQ_TEST, NEIGHBORS_ANN_VAMANA_TEST, NEIGHBORS_ANN_NN_DESCENT_TEST, and NEIGHBORS_ANN_IVF_FLAT_TEST. Done means splitting the suites into multiple executables, reducing their parameter sets, and confirming that their CI runtimes are substantially lower.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- performance, testing-qa
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100