Evaluation metric
Open
- Dominant language
- Python
- Stars
- 995
- Forks
- 203
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
How do we find out the variance or confidence intervals of the evaluation metric obtained?
eg. C^td(Confidence interval), IBS(CI) etc.
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no files, tests, or entry points. Start by locating the evaluation metric implementations and their tests, then clarify which metrics need variance or confidence intervals and what statistical method and output format are expected; done means the agreed metrics return validated interval results.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100