aws / aws/sagemaker-pytorch-inference-toolkit

add environment variable "OMP_NUM_THREADS"

Open
#123 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
143
Forks
73
PR merge metrics
No merged PRs in 30d

Description

**Describe the feature you'd like**
A clear and concise description of the functionality you want.
add environment variable "OMP_NUM_THREADS" (default value :1) in CPU instances, and write this value into TorchServe config.properties.

**How would this feature be used? Please describe.**
A clear and concise description of the use case for this feature. Please provide an example, if possible.
[Here](https://github.com/pytorch/serve/issues/1642) is a related ticket in TorchServe side.

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Research direction

Locate the CPU-instance configuration entry point and the code that writes TorchServe config.properties. Read the related TorchServe issue #1642 for expected behavior, then verify that OMP_NUM_THREADS defaults to 1 for CPU instances and that the selected value is written to config.properties.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
backend, cloud
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.