openml / openml/openml.org

Regression tasks plot flows with highest error

Open
#280 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
TypeScript
Stars
33
Forks
30
Avg merge
2d 21h
Merged PRs (30d)
6

Description

The analysis on tasks orders flows on the highest score (whichever measure). This makes sense for accuracy, precision, etc. But not for error measures. Regression tasks now order the flows based on which has the highest error.

Proposal: for certain evaluation measures, the ordering of flows should be reversed.

image
(task 2295)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the analysis plot entry point that orders flows by evaluation score, then identify how regression error measures are represented. Compare the current ordering with the screenshot and task 2295. Done means error measures order flows from lowest to highest error while accuracy-like measures retain their existing ordering, with coverage for both cases.

Written by the indexing model from the issue text.

Assessment

Tech stack
typescript
Domain
data-visualization
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.