spring-projects / spring-projects/spring-ai

Configuring the server for scalability

Open
#4,549 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

mcp performance
Dominant language
Java
Stars
9.5k
Forks
2.9k
Avg merge
1d 7h
Merged PRs (30d)
6

Description

Expected Behavior
Is it currently possible to tweak the underlying server? Or in other words I need to ensure that I can support 100 concurrent users of the MCP server.
Will this work out of box?

Current Behavior

It seems that the server starts at /mcp.
But it seems that besides configuration of that base endpoint it’s not possible to configure anything else?

For example a base /healthcheck endpoint at the root and tweaking some of the potentially default configurations to improve base scalability with some predictable latency.

Context
This is stemming from me finding performance issues when using Python so I’m now exploring the latest advancements of Spring AI and I’m wondering about some of these details that weren’t immediately obvious to me when reading the docs.

As always absolutely mega work and this is great

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names the /mcp endpoint and requests a root /healthcheck endpoint plus server scalability settings, but no files or tests. Start with the MCP server documentation and the existing endpoint configuration, then identify how concurrency and latency are currently controlled. Done should mean documented or implemented configuration that addresses 100 concurrent users and the requested health-check behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
api, backend, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.