automl / automl/AutoFolio

AFCsvFacade.load_and_predict() returns the first item in the schedule

Open
#16 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
43
Forks
13
PR merge metrics
No merged PRs in 30d

Description

The facade API is really useful. However, when called to make a prediction it picks the first item in a schedule, i.e. the item with the shortest allocated budget. Is this intentional?

E.g. my problem sets the runtime limit to 3600 and in the AF logging output I get
`Selected Schedule [(algorithm, budget)]: [('algo_tree', 1), ('algo_mdd',3601)]`
But the output from `AFCsvFacade.load_and_predict()` just returns `algo_tree`. This is because the method [(src)](https://github.com/automl/AutoFolio/blob/f296f528b1b684d36837075b0e8160e3fa4124f7/autofolio/facade/af_csv_facade.py#L79) just returns `pred[0][0]`.

Is this correct / intended? If only 1 sec of budget is set to `algo_tree`, but 3601 to `algo_mdd`, but I can only use 1 choice, which should it be? Perhaps I'm misunderstanding.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in autofolio/facade/af_csv_facade.py at the load_and_predict() implementation around line 79, and inspect how its pred schedule is assembled and consumed. Determine the intended single-choice behavior when schedule budgets differ, then make the facade behavior and its documentation consistent with that decision.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.