apple / apple/coremltools

Different behavior on iphone 12 and Macbook Pro of the same model on the same images

Open
#1,126 5 comments 0 reactions 0 assignees View on GitHub
awaiting response Core ML Framework question
Dominant language
Python
Stars
5.4k
Forks
850
Avg merge
4d 5h
Merged PRs (30d)
10

Description

## ❓Question
I have trained a custom object detector to detect a specific object of interest through turicreate and then converted my final model to coreML.

I observed that the model behaves differently when integrated in the iphone app and when tested on my laptop. In particular, both the turicreate model and the extracted coreML version of it seem to be more reliable when tested on my MacBook against the same coreML model as part of the iOS app when tested on exactly the same images.

The on-device copy of the coreML model gives more false positives than when tested locally on the same images.

Any thoughts or advise??

Thanks a lot in advance!!

Contributor guide

Open the contributing guide

Research direction

No files, tests, or entry points are named. Start by reproducing the discrepancy with the same Core ML model and images on the MacBook and iPhone app, recording the model inputs and outputs in each environment. Done means identifying a reproducible cause or narrowing the issue to a specific integration difference.

Written by the indexing model from the issue text.

Assessment

Tech stack
ios
Domain
machine-learning, mobile-dev
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.