ml-explore / ml-explore/mlx-examples
Add OpenAI API compatible server with tool_calls support
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 9k
- Forks
- 1.2k
- PR merge metrics
- No merged PRs in 30d
Description
Hello,
Thank you for creating this outstanding tool. I have a feature suggestion, if it's feasible, please consider it. I can give it a try as well.
It would be beneficial to integrate an OpenAI API-compatible server to enable AI application frameworks to support and execute MLX locally for development purposes. I specifically need tool_calls support. I have evaluated llama-cpp-python, which offers an OpenAI API-compatible server with tool_calls support. However, it is limited to compatibility with the meetkai/functionary model.
Please let me know wdyt!
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files, tests, or existing server entry point. Start by inspecting the Python examples for serving and API integration, then determine the compatibility and tool_calls requirements. Done means an OpenAI-compatible server can run MLX locally and support tool_calls for AI application frameworks.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, api, backend-api-design
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100