iiitl / iiitl/chuck

Too few iterations

Open
#1 7 comments 0 reactions 0 assignees View on GitHub
medium
Dominant language
Python
Stars
0
Forks
19
PR merge metrics
No merged PRs in 30d

Description

Default `--iterations 5` gives a median from 5 samples. On the same commit, tasks like `retrieval_core` and `ordering_core` show 37–38% delta.

Contributor guide

Open the contributing guide

Research direction

Start by locating the CLI entry point that defines the default `--iterations 5` value and reproduce the reported variation on `retrieval_core` and `ordering_core`. Determine the intended iteration count from the project’s existing behavior or guidance; done should include a documented, repeatable result showing that the default produces stable measurements.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli, performance
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.