Multi-LLM support for Agent mode
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 438
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Description
I'm excited to see where this project goes!
One small comment/question while you're still laying down architecture... I noticed the config expects a single model definition (model, url, key). But in whatever the emigo equivalent of Agent mode is, won't you want to be calling into different LLMs for different purposes? It seems like there should be a set of LLMs that need to be defined.
In my own personal agents I've adopted the pattern of having a dictionary of "actions" (e.g."apply-code", "analyze") that map to LLM definitions (model, url, key). This mapping can be configured by the user. Then in the code you can make LLM requests customized by capability. Some tasks are fine under a free or small local model, whereas other tasks need something beefier. With models changing so quickly ideally this should be easy to experiment with (swapping out models).
Also, you really want to be able to configure multiple sets of LLMs. You might have one set that works well for coding and another set that works well for other kinds of writing. You might have a "local" preset that contains a set of models running locally, and a "gemini" preset that contains Gemini as the core intelligence with whatever pairs well with it for applying edits, searching your codebase, etc., And a super tricked out SOTA preset for tasks that you're willing to potentially pay an API premium to get right.
This also leads to the need for LLM specific prompt customization. You might instruct sonnet to apply edits in one way and QwQ another way.
Lots of ways you could model all that in elisp but good defaults, ease of swapping out and working with (switching between) model sets are key.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or entry points; begin by tracing the current single-model configuration and Agent mode architecture. The work is complete when users can configure action-specific models, switch between model sets or presets, and customize prompts for individual LLMs.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- emacs-lisp
- Domain
- ai
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100