aws / aws/sagemaker-pytorch-inference-toolkit
add environment variable "OMP_NUM_THREADS"
- Dominant language
- Python
- Stars
- 143
- Forks
- 73
- PR merge metrics
- No merged PRs in 30d
Description
**Describe the feature you'd like**
A clear and concise description of the functionality you want.
add environment variable "OMP_NUM_THREADS" (default value :1) in CPU instances, and write this value into TorchServe config.properties.
**How would this feature be used? Please describe.**
A clear and concise description of the use case for this feature. Please provide an example, if possible.
[Here](https://github.com/pytorch/serve/issues/1642) is a related ticket in TorchServe side.
**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.
**Additional context**
Add any other context or screenshots about the feature request here.
Contributor guide
Research direction
Locate the CPU-instance configuration entry point and the code that writes TorchServe config.properties. Read the related TorchServe issue #1642 for expected behavior, then verify that OMP_NUM_THREADS defaults to 1 for CPU instances and that the selected value is written to config.properties.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend, cloud
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100