openml / openml/OpenML

Some datasets have more nominal values listed than they really use

Open
#1,085 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
PHP
Stars
755
Forks
128
PR merge metrics
No merged PRs in 30d

Description

At least for the following datasets:

openml_dataset_152
openml_dataset_153
openml_dataset_186
openml_dataset_49
openml_dataset_51

I have found that they have more nominal values listed than they really use. This is especially a problem on target column, because it changes multi-class classification task to binary classification task.

For example dataset 51 has the following nominal values listed for its num column:

    "<50",
    ">50_1",
    ">50_2",
    ">50_3",
    ">50_4"

But if you check here you see that only 2 unique values are present for that column. Why are other nominal values even listed? Could you cleanup this?

Also, why this API call contains the number of unique values in the column, while this API call does not. It would not be necessary to list if the list of nominal values would be correct, but it is not.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Compare the nominal values for datasets 152, 153, 186, 49, and 51 between the linked features API and dataset pages, starting with the two API responses for dataset 51. Trace where these metadata values and unique-value counts are produced; done means unused nominal values are handled correctly and the two API representations are consistent.

Written by the indexing model from the issue text.

Assessment

Tech stack
php
Domain
data, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.