Guide: create overview of evaluation measures and which task type they can be used for
Nobody has claimed this yet.
- Dominant language
- PHP
- Stars
- 755
- Forks
- 128
- PR merge metrics
- No merged PRs in 30d
Description
We have info on all evaluation measures here:
https://www.openml.org/search?q=%2520measure_type%3Aevaluation_measure&type=measure
and on task types here:
https://www.openml.org/search?type=task_type
It would be nice to have an overview on which evaluation measures can be used for which task types. This should probably be defined somewhere already, we just need to transform it into something human readable. Where do I find that info?
I think we need this for the intro to ML for data owners (see draft).
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the linked OpenML listings for evaluation measures and task types, then investigate where their compatibility is already defined. Produce a human-readable overview mapping measures to applicable task types, suitable for the linked introductory ML draft.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- machine-learning
- Domain
- documentation, machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100