claimed-framework / claimed-framework/mlx_deprecated

Make MAX models work on kfserving and model mesh serve

Open
#132 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
220
Forks
54
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**
Currently, we only can access MAX models if we deployed them using Kubernetes deployment. Both kfserving and model mesh won't work for MAX because MAX models are mapped with non-configurable endpoints and needs complex pre/post-processing methods.

**Describe the solution you'd like**
A clear and concise description of what you want to happen.

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.