Data cleaning should remove raters with low acceptance rates
Open
Nobody has claimed this yet.
- Dominant language
- HTML
- Stars
- 230
- Forks
- 61
- PR merge metrics
- No merged PRs in 30d
Description
A rater that has a very low acceptance rate (e.g., ~20%) should be discarded completely. Currently, we still use some of their HITS, but if they are failing so badly the rest of the HITS can't be trusted.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No file, test, or entry point is named. Locate the data-cleaning logic that evaluates rater acceptance rates, then determine how the low-rate cutoff should be defined from the project’s existing behavior and add coverage showing that such raters are excluded completely.
Written by the indexing model from the issue text.
Assessment
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100