MegEngine / MegEngine/InferLLM

大模型推理中这个推理引擎如何支持 lora,ptuning等私有语料训练插件后的新模型

Open
#53 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
752
Forks
94
PR merge metrics
No merged PRs in 30d

Description

如题:
大模型推理中这个推理引擎如何支持 lora,ptuning等私有语料训练插件后的新模型

有没有guide ?

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or entry points are named in the issue. Start by identifying the inference engine's model-loading path and existing documentation, then determine whether LoRA or PTuning models are already supported; done means a reproducible guide or a clearly scoped support gap.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
ai, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.