apple / apple/coremltools

YUV image input

Open
#2,469 1 comment 0 reactions 0 assignees View on GitHub
question
Dominant language
Python
Stars
5.4k
Forks
850
Avg merge
4d 5h
Merged PRs (30d)
10

Description

## ❓Question
Hi, I have videos in `yuv422p10le` format on which I have trained a PyTorch model. To reduce overhead I did not bother to convert from YUV to RGB I just convert the YUV values to `yuv444` and then to float and scale to interval 0.0-1.0, this works well.

Now I want to run this on live video on an iPhone with iOS18 and have a few questions about best practice and performance.
- Should I be using `coremltools.ImageType` for the input type? `color_layout` does not have an option for YUV
- I am guessing that video frames arrive in YUV format, is there any performance benefit of not casting to RGB?
- Should I just retrain my model on RGB images?

Thanks!

Contributor guide

Open the contributing guide

Research direction

The issue names no repository file, test, or entry point; begin by locating ImageType/color_layout handling and the iOS input path. Done would require a maintainer-supported answer or a clearly scoped implementation request covering YUV input and its performance tradeoffs.

Written by the indexing model from the issue text.

Assessment

Tech stack
ios, python, pytorch
Domain
machine-learning, mobile
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.