aws / aws/sagemaker-huggingface-inference-toolkit
Support for huggingface/peft
Open
- Dominant language
- Python
- Stars
- 270
- Forks
- 60
- PR merge metrics
- No merged PRs in 30d
Description
After looking through the code it currently seems to not be possible to lead adapter models produced by `peft`. It would be a great addition to HF DLCs.
Contributor guide
Research direction
The issue names no files, tests, or entry points; start by tracing the existing Hugging Face DLC model-loading path and reviewing how PEFT adapter models are represented. Done means PEFT-produced adapter models can be loaded successfully through the toolkit, with coverage for the supported loading behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- huggingface, python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100