huggingface / huggingface/accelerate
[Tutorial] Distributed inference in a notebook
Open
documentation
feature request
- Dominant language
- Python
- Stars
- 9.9k
- Forks
- 1.5k
- Avg merge
- 5d 2h
- Merged PRs (30d)
- 27
Description
As per a conversation with @muellerzr, it would be great to have a simple tutorial showing the best methods of performing inference with `notebook_launcher()`. It looks like the two methods are:
1. Saving the predictions out to a file
2. Appending them to a variable outside of the function passed to the launcher
Contributor guide
Assessment
This issue has not been assessed yet.