MegEngine / MegEngine/InferLLM
大模型推理中这个推理引擎如何支持 lora,ptuning等私有语料训练插件后的新模型
Open
- Dominant language
- C++
- Stars
- 752
- Forks
- 94
- PR merge metrics
- No merged PRs in 30d
Description
如题:
大模型推理中这个推理引擎如何支持 lora,ptuning等私有语料训练插件后的新模型
有没有guide ?
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are named in the issue. Start by identifying the inference engine's model-loading path and existing documentation, then determine whether LoRA or PTuning models are already supported; done means a reproducible guide or a clearly scoped support gap.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- ai, machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 28/100