openml / openml/OpenML

[bug] list/task by tag does not give correct result

Open
#517 6 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug priority: highest
Dominant language
PHP
Stars
755
Forks
128
PR merge metrics
No merged PRs in 30d

Description

This call https://www.openml.org/api/v1/json/task/list/tag/OpenML100/

tells me that the following task.ids are tagged with "OpenML100":

      3      6     11     12     14     15     16     18     20     21     22     23     24     28     29     31     32     36     37     41     43     45
     49     53     58    219   2074   2079   3021   3022   3481   3485   3492   3493   3494   3510   3512   3543   3549   3560   3561   3573   3889   3891
   3896   3899   3902   3903   3904   3913   3917   3918   3946   3948   3954   7592   9914   9946   9950   9952   9954   9955   9956   9957   9960   9964
   9967   9968   9970   9971   9976   9977   9978   9979   9980   9981   9983   9985   9986  10093  10101  14964  14965  14966  14967  14968  14969  14970
  34536  34537  34539 125920 125921 125922 125923 146195 146606 146607

However, there seem to be two more tasks having the OpenML100 tag which are not listed by task/list: Just look at https://www.openml.org/t/34538 or https://www.openml.org/t/3567. Here I can see a "OpenML100" tag. Whats going on here?

Also related to this:
https://www.openml.org/api/v1/json/study/OpenML100/ and
https://www.openml.org/api/v1/json/task/list/tag/OpenML100/ give me two different lists of task.ids .

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by comparing the responses from /api/v1/json/task/list/tag/OpenML100/ and /api/v1/json/study/OpenML100/, then check the task pages for 34538 and 3567. Trace how these entry points select tagged tasks and identify why their task ID lists differ; done means the endpoints consistently account for all tasks displaying the OpenML100 tag.

Written by the indexing model from the issue text.

Assessment

Tech stack
php
Domain
api, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.