Feature Request: Support for GBNF grammar and LoRA adapters in multi‑agent setups
Nobody has claimed this yet.
Assessment
- Difficulty
- 5/5
- Estimated time
- Over a week
- Newbie friendliness
- 35/100
Research direction
Start by reading examples/multi-agent.cpp and the ModelConfig, Model, and Agent APIs to understand how agents share model weights. Compare the requested per-agent GBNF grammar and optional LoRA configuration with the existing interfaces. Done means a documented design and implementation path that supports independent agent configuration without duplicating the base weights.
Written by the indexing model from the issue text.
Description
Hi.
First of all, thank you for this great library! The multi‑agent example (examples/multi-agent.cpp) is exactly the pattern I need: a single base model with multiple specialized agents sharing the same weights.
My use case wishes each agent to have its own GBNF grammar and optionally its own LoRA adapter while still sharing the base model weights to save memory.
ModelConfig only exposes n_ctx and temp. I could not find any load_lora() or set_grammar() methods on Model or Agent like 👇
// Example concept
ModelConfig math_config;
math_config.n_ctx = 10240;
math_config.grammar_file = "math.gbnf";
math_config.lora_file = "math_lora.bin";
auto math_model = Model::create_with_weights(shared_weights, math_config);
// Then pass math_model to the MathAgent
What do you think 🤗
- Dominant language
- C++
- Stars
- 207
- Forks
- 30
- Avg merge
- 1d 12h
- Merged PRs (30d)
- 5
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Similar issues
-
Website Doc Typo Open
Difficulty 1/5 Under an hour Newbie friendliness 92/100
-
Difficulty 1/5 1-3 hours Newbie friendliness 92/100
autowarefoundation/autoware_universe#13413 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
automated-analysis bug memory-safety
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 88/100