microsoft / microsoft/FLAML

Flaml/Automl - How do I pass a huge lightgbm input '.bin' file directly to lightgbm for training via flaml/automl?

Open
#1,092 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
4.4k
Forks
565
Avg merge
5d 8m
Merged PRs (30d)
17

Description

Is there a way to pass a huge lightgbm input '.bin' file directly to lightgbm for training via flaml/automl?

The lightgbm c, cli allow me to specify directly the input file (like .bin or .csv) to use for training, it is optimize for memory.
In python it requires lgb,Dataset(data='foo.bin') as far as I know

How do I do this with flaml/automl?

```
import lightgbm as lgb

# Set up the parameters
params = {
'objective': 'multiclass',
'num_classes': num_classes,
# Add other parameters as needed
}

# Train the model with the .bin file
model = lgb.train(params, lgb.Dataset(data='path_to_file.bin'), num_boost_round=num_rounds)

```
Thanks for your help
w

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.