microsoft / microsoft/onnxruntime

[Documentation] Estimating (or Checking) Allocated Memory

Open
#27,169 4 comments 0 reactions 0 assignees View on GitHub
api:Java documentation
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the documentation issue

I'm wondering how one would check or estimate how much off-heap memory is allocated by the ONNX runtime. For context I'm running an ONNX model inside Java process and need to know how much off-heap memory is allocated for the ONNX model and inputs.

### Page / URL

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the ONNX Runtime Java usage and the issue's question about off-heap memory for the model and inputs. Determine which existing documentation or entry point explains memory allocation, and define done as documenting a supported way to estimate or check that allocation.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.