AutoML() doesn't seem to use Ray's object store (for large datasets)
Open
- Dominant language
- Jupyter Notebook
- Stars
- 4.4k
- Forks
- 565
- Avg merge
- 5d 8m
- Merged PRs (30d)
- 17
Description
Hi there,
I have a large dataset (+100GB) that I have been trying to make FLAML (AutoML) work with, no success so far. Since FLAML uses Ray, shouldn't it take advantage of Ray's object store (object spill to disk)?
If not, any suggestions on how we should go about out-of-memory compute with FLAML?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.