dmlc / dmlc/tl2cgen

Need a "tl2cgen-runtime" package to fit into AWS Lambda

Open
#46 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
55
Forks
11
PR merge metrics
No merged PRs in 30d

Description

Absolutely *love* treelite. Was able to fit an entire XGBoost model into a 5MB package for AWS Lambda.

But...there is no "tl2cgen-runtime" the way you had a "treelite-runtime". I had to make my own by "stubbing out" scipy and sklearn. Otherwise it imports literally hundreds of megs of libraries and so cannot fit into an AWS Lambda package.

It seems like it would only be a few hours of work to either lazy-load or make a "tl2cgen-runtime" so that I can use the model without needing all the heavyweight stuff that generates the model.

Thanks for all the work on this, it's an amazing accomplishment...

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.