Different behavior on iphone 12 and Macbook Pro of the same model on the same images
- Dominant language
- Python
- Stars
- 5.4k
- Forks
- 850
- Avg merge
- 4d 5h
- Merged PRs (30d)
- 10
Description
## ❓Question
I have trained a custom object detector to detect a specific object of interest through turicreate and then converted my final model to coreML.
I observed that the model behaves differently when integrated in the iphone app and when tested on my laptop. In particular, both the turicreate model and the extracted coreML version of it seem to be more reliable when tested on my MacBook against the same coreML model as part of the iOS app when tested on exactly the same images.
The on-device copy of the coreML model gives more false positives than when tested locally on the same images.
Any thoughts or advise??
Thanks a lot in advance!!
Contributor guide
Research direction
No files, tests, or entry points are named. Start by reproducing the discrepancy with the same Core ML model and images on the MacBook and iPhone app, recording the model inputs and outputs in each environment. Done means identifying a reproducible cause or narrowing the issue to a specific integration difference.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- ios
- Domain
- machine-learning, mobile-dev
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100