pytorch / pytorch/executorch

CoreML quantization is supported by PyTorch flows (PT2E).

Open
#9,617 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

triaged
Dominant language
Python
Stars
5k
Forks
1.2k
Avg merge
2d 10h
Merged PRs (30d)
581

Description

🚀 The feature, motivation and pitch

All ET CoreML delegate quantization should be supported by PT2E.

Support is missing for:

  1. int4 quantization (per tensor and per group)
  2. Palletization
Alternatives

No response

Additional context

No response

RFC (Optional)

No response

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the ExecuTorch CoreML delegate quantization implementation and its PT2E integration. Trace existing quantization support, then identify the paths and tests covering int4 per-tensor, int4 per-group, and palletization. Done means all three listed cases are supported by the PT2E CoreML flows.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.