apple / apple/coremltools

The added pipeline after quantification cannot operate normally

Open
#2,485 3 comments 0 reactions 0 assignees View on GitHub
question
Dominant language
Python
Stars
5.4k
Forks
850
Avg merge
4d 5h
Merged PRs (30d)
10

Description

## ❓Question

After I trained the yolov8 model, I used coremltools==7.0 to convert it into an mlpackage model. Then, I quantified the model using the pruning in the official documentation. After quantification, I added nms operations to the model using the pipeline mechanism. I imported the model with nms added into xcode and input the predicted images. xcode crashed directly. By importing an nms model without adding quantization operations, xcode could predict the results normally

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the reported pipeline with a YOLOv8 model, coremltools 7.0, pruning-based quantization, and added NMS operations. Compare the quantized and non-quantized models when imported into Xcode, and consider the issue resolved when the quantized model with NMS no longer causes Xcode to crash.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.