spring-projects / spring-projects/spring-ai
Configuring the server for scalability
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 9.5k
- Forks
- 2.9k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 6
Description
Expected Behavior
Is it currently possible to tweak the underlying server? Or in other words I need to ensure that I can support 100 concurrent users of the MCP server.
Will this work out of box?
Current Behavior
It seems that the server starts at /mcp.
But it seems that besides configuration of that base endpoint it’s not possible to configure anything else?
For example a base /healthcheck endpoint at the root and tweaking some of the potentially default configurations to improve base scalability with some predictable latency.
Context
This is stemming from me finding performance issues when using Python so I’m now exploring the latest advancements of Spring AI and I’m wondering about some of these details that weren’t immediately obvious to me when reading the docs.
As always absolutely mega work and this is great
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names the /mcp endpoint and requests a root /healthcheck endpoint plus server scalability settings, but no files or tests. Start with the MCP server documentation and the existing endpoint configuration, then identify how concurrency and latency are currently controlled. Done should mean documented or implemented configuration that addresses 100 concurrent users and the requested health-check behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- api, backend, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100