openml / openml/OpenML

Possible bug, function does not work as intended

Open
#1,051 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
PHP
Stars
755
Forks
128
PR merge metrics
No merged PRs in 30d

Description

I am calling the function detach_from_suite to remove a task (211981) from a benchmark suite (240) that was created by me. The server returns a status code of 200, however, the task is not removed from the benchmark suite and the size of the benchmark suite stays the same.

I used the REST API at the website and I got the same results and status code. The size of the benchmark suite does not seem to change. Not sure if I am doing something wrong, or there is a problem with the function. Probably this is not the right place for the issue, as it seems to be server sided, however, I am posting it here initially as it happened while using the connector.

https://github.com/openml/openml-python/blob/249abc901c34bc87c4b283e42e754308a5a2d629/openml/study/functions.py#L380

Code:

import openml


suite_id = 240
task_id = 211981
new_suite_size = openml.study.functions.detach_from_suite(suite_id, [task_id])
print(new_suite_size)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in openml/study/functions.py at the linked detach_from_suite implementation, then reproduce the request with suite 240 and task 211981 through both the connector and REST API. Done means determining whether the task is removed and the suite size changes, or documenting the server-side behavior if the connector is sending the expected request.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.