AFCsvFacade.load_and_predict() returns the first item in the schedule
- Dominant language
- Python
- Stars
- 43
- Forks
- 13
- PR merge metrics
- No merged PRs in 30d
Description
The facade API is really useful. However, when called to make a prediction it picks the first item in a schedule, i.e. the item with the shortest allocated budget. Is this intentional?
E.g. my problem sets the runtime limit to 3600 and in the AF logging output I get
`Selected Schedule [(algorithm, budget)]: [('algo_tree', 1), ('algo_mdd',3601)]`
But the output from `AFCsvFacade.load_and_predict()` just returns `algo_tree`. This is because the method [(src)](https://github.com/automl/AutoFolio/blob/f296f528b1b684d36837075b0e8160e3fa4124f7/autofolio/facade/af_csv_facade.py#L79) just returns `pred[0][0]`.
Is this correct / intended? If only 1 sec of budget is set to `algo_tree`, but 3601 to `algo_mdd`, but I can only use 1 choice, which should it be? Perhaps I'm misunderstanding.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start in autofolio/facade/af_csv_facade.py at the load_and_predict() implementation around line 79, and inspect how its pred schedule is assembled and consumed. Determine the intended single-choice behavior when schedule budgets differ, then make the facade behavior and its documentation consistent with that decision.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100