Too few iterations
Open
medium
- Dominant language
- Python
- Stars
- 0
- Forks
- 19
- PR merge metrics
- No merged PRs in 30d
Description
Default `--iterations 5` gives a median from 5 samples. On the same commit, tasks like `retrieval_core` and `ordering_core` show 37–38% delta.
Contributor guide
Research direction
Start by locating the CLI entry point that defines the default `--iterations 5` value and reproduce the reported variation on `retrieval_core` and `ordering_core`. Determine the intended iteration count from the project’s existing behavior or guidance; done should include a documented, repeatable result showing that the default produces stable measurements.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- cli, performance
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 38/100