mudler / mudler/LocalAI

MCP / Agent mode is not working when model file is shared

Open
#7,143 1 comment 1 reaction 1 assignee View on GitHub

Nobody has claimed this yet.

bug need-more-information roadmap unconfirmed
Dominant language
Go
Stars
49.2k
Forks
4.5k
Avg merge
1d 3m
Merged PRs (30d)
239

Description

LocalAI version:
v3.7.0

Describe the bug

If you configure model twice using same model file, and one configuration spec'ed for MCP / Agent mode, LocalAI fails to recognize that and MCP / Agent feature is not working.

To Reproduce

  1. Download model from gallery
  2. Copy configuration file for downloaded model
  3. Import model by pasting copied configuration file, adding MCP and Agent sections, and changing name (but not changing filename!)
  4. Try to chat with model configured for MCP / Agent mode (Chat view is not showing option to enable MCP)
  5. (optional) Verify logs in debug mode to see no MCP activity happens
  6. (optional) Verify configuration of MCP / Agent mode by downloading yet another model from gallery and editing it's original configuration file by pasting MCP and Agent sections.

Expected behavior
One of configurations works in Agent mode (uses MCP), another works in standard way.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.