aws / aws/sagemaker-huggingface-inference-toolkit
More info on settings appearing in the logs?
Open
- Dominant language
- Python
- Stars
- 270
- Forks
- 60
- PR merge metrics
- No merged PRs in 30d
Description
I see in the HF-TF CPU endpoint image log logs the following:
```
Preload model: false
Prefer direct buffer: false
```
What is this? Some nice serving settings that we can tune? Is it explained in some doc?
Contributor guide
Research direction
The issue names only the HF-TF CPU endpoint image and the two log settings, not a source file, test, or documentation page. Start by locating where these log lines are emitted and checking the existing serving documentation. Done means explaining both settings and documenting whether users can tune them.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, tensorflow
- Domain
- documentation
- Issue type
- Documentation
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100