The added pipeline after quantification cannot operate normally
- Dominant language
- Python
- Stars
- 5.4k
- Forks
- 850
- Avg merge
- 4d 5h
- Merged PRs (30d)
- 10
Description
## ❓Question
After I trained the yolov8 model, I used coremltools==7.0 to convert it into an mlpackage model. Then, I quantified the model using the pruning in the official documentation. After quantification, I added nms operations to the model using the pipeline mechanism. I imported the model with nms added into xcode and input the predicted images. xcode crashed directly. By importing an nms model without adding quantization operations, xcode could predict the results normally
Contributor guide
Research direction
Start by reproducing the reported pipeline with a YOLOv8 model, coremltools 7.0, pruning-based quantization, and added NMS operations. Compare the quantized and non-quantized models when imported into Xcode, and consider the issue resolved when the quantized model with NMS no longer causes Xcode to crash.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100