EnzymeAD / EnzymeAD/ReactantServer.jl

Document Command Buffer Memory

Open
#44 0 comments 0 reactions 0 assignees View on GitHub
documentation
Dominant language
Julia
Stars
5
Forks
2
Avg merge
15m
Merged PRs (30d)
10

Description

If you have alot of .mlir models, command buffer memory may become an issue. This requires memory outside of the BFC allocator, so if you reserve 0.9 for weights and scratch buffers, that only leaves 0.1 to store graphs. The good news is now that we load every single program on startup, you will always get an OoM if this is not large enough.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.