microsoft / microsoft/onnxruntime

[Feature Request] MPS provider

Open
#21,271 22 comments 28 reactions 0 assignees View on GitHub
ep:CoreML feature request
Dominant language
C++
Stars
21.9k
Forks
4.2k
Avg merge
4d 11h
Merged PRs (30d)
184

Description

### Describe the feature request

Currently there is no MPS (apple Metal Performance Shaders GPU) provider. There is CoreML provider but from testing I did on my MacBook with arm64 M3 and MPS It does not use it.
Is there any plan to support MPS as a different provider or within CoreML?
I think there is a lot of value in such support, as a lot of the development is done on MacBooks.

### Describe scenario use case

- Training small models on macos
- Testing new models on developer laptops before deploying

Contributor guide

Open the contributing guide

Research direction

Start by reviewing ONNX Runtime's existing CoreML provider and the provider architecture, then investigate Apple MPS and Metal requirements on arm64 macOS. Done would require a defined implementation scope for a separate MPS provider or CoreML integration, along with agreed validation for training and model testing.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp, macos
Domain
machine-learning, operating-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.