EnzymeAD / EnzymeAD/ReactantServer.jl
Document Command Buffer Memory
Open
documentation
- Dominant language
- Julia
- Stars
- 5
- Forks
- 2
- Avg merge
- 15m
- Merged PRs (30d)
- 10
Description
If you have alot of .mlir models, command buffer memory may become an issue. This requires memory outside of the BFC allocator, so if you reserve 0.9 for weights and scratch buffers, that only leaves 0.1 to store graphs. The good news is now that we load every single program on startup, you will always get an OoM if this is not large enough.
Contributor guide
Assessment
This issue has not been assessed yet.