Optimize inference with deep models
Open
longterm
objective
- Dominant language
- Jupyter Notebook
- Stars
- 524
- Forks
- 64
- Avg merge
- 4h 1m
- Merged PRs (30d)
- 3
Description
The current style of storing the models as private variables of a class in `__init__`, and reuse them in functions. This leads to trouble as the scheduler gets locked up frequently and also fails for moderately sized datasets.
The current hack is to read the model from disk every single time, but its inefficient and makes the program slow.
Dask's recommended strategy is to wrap the model in delayed and pass it to the function each time. Will need to try that and properly benchmark compute.
Contributor guide
Assessment
This issue has not been assessed yet.