Multithreading safety
Open
- Dominant language
- C#
- Stars
- 1.9k
- Forks
- 228
- PR merge metrics
- No merged PRs in 30d
Description
Great library but please provide some information on multi threading safety.
In production use, models are normally wrapped into REST service which is inherently multithreaded. The Torch itself is safe to use for inference in that matter.
Not sure if your library keeping it this way. Major concern is introduction of scopes for memory management.
Stack of scopes seems to me existing on global level which can be a problem. Not sure what else.
Contributor guide
Assessment
This issue has not been assessed yet.