microsoft / microsoft/markitdown
Error: convert_to_markdown response exceeds token limit – request for automatic chunking or splitting support
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 186k
- Forks
- 13.7k
- Avg merge
- 1d 4h
- Merged PRs (30d)
- 49
Description
When calling the MCP tool convert_to_markdown, I received the following error:
response (51164 tokens) exceeds maximum allowed tokens (25000). Please use pagination, filtering, or limit parameters to reduce the response size.
Is there a way to automatically split large responses into smaller chunks so that they can be handled within the allowed token limit? Ideally, the tool would support chunking or pagination for large outputs, making the process seamless for the user.
Requesting guidance or feature enhancement to enable automatic chunking or splitting for large responses when using this tool.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start at the convert_to_markdown MCP tool entry point and review how large responses are currently produced and limited. Define how automatic chunking or pagination should behave, then verify that a 51,164-token response is divided into parts accepted by the 25,000-token limit.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- tooling
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 32/100