pytorch / pytorch/executorch

Issues during CoreML GA model testing

Open
#11,542 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
5k
Forks
1.2k
Avg merge
2d 10h
Merged PRs (30d)
581

Description

🐛 Describe the bug

Repro steps:

Follow the repro steps here for exporting/running GA models.

Export issues:

  1. When take_over_mutable_buffer=True, smollm fails with "Buffer output getitem_1 does not point to a buffer that exist", see smollm_coreml_executorch_exception.txt.
  2. Model does not quantize using default iOS15, see yolos-quantize_coreml_executorch_exception.txt

Runtime issues, see run_logs.txt

  1. "[ETCoreMLModelManager.mm:566] [Core ML] Metadata is invalid or missing.
    [backend_delegate.mm:288] [Core ML] Model init failed Metadata is invalid or missing."

We see this issue in various models like whisper2, sam_vision_encoder, yolos2.

Performance issues:

  1. Quantized version of yolos yolos-quantize-ios17 is almost 2x slower than non-quantized version.
Versions

NA

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the repro steps in ga_testing.md and review run_logs.txt alongside the linked export exception files. Separate the mutable-buffer and quantization export failures from the Core ML metadata runtime failures and the YOLOS performance result. Done means the listed model tests no longer show those failures and the quantized YOLOS runtime result is investigated or corrected.

Written by the indexing model from the issue text.

Assessment

Tech stack
ios
Domain
machine-learning, mobile-dev, performance
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
22/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.