microsoft / microsoft/onnxruntime
[Documentation] Estimating (or Checking) Allocated Memory
Open
api:Java
documentation
- Dominant language
- C++
- Stars
- 21.9k
- Forks
- 4.2k
- Avg merge
- 4d 11h
- Merged PRs (30d)
- 184
Description
### Describe the documentation issue
I'm wondering how one would check or estimate how much off-heap memory is allocated by the ONNX runtime. For context I'm running an ONNX model inside Java process and need to know how much off-heap memory is allocated for the ONNX model and inputs.
### Page / URL
_No response_
Contributor guide
Research direction
Start by reviewing the ONNX Runtime Java usage and the issue's question about off-heap memory for the model and inputs. Determine which existing documentation or entry point explains memory allocation, and define done as documenting a supported way to estimate or check that allocation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- documentation, machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 32/100