meta-pytorch / meta-pytorch/torchcodec
Handle videos with streams having different frame dimensions for different timestamps
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.2k
- Forks
- 125
- Avg merge
- 22h 47m
- Merged PRs (30d)
- 54
Description
I have seen videos that have AVFrames in a single stream have different dimensions.
Example: the first AVFrame of the stream could have size 100x100 but the second one could have size 200x200
We should at the minimum detect this condition and report it to the user.
Or handle it gracefully somehow. For non-batch functions we could return the size of the actual frame.
For batch functions that return a stacked tensor we could just fail or return a resized frame
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files or tests are named. Start by locating the non-batch and batch video-decoding entry points, then reproduce a stream whose AVFrames have different dimensions; done should include a defined report or graceful behavior for individual frames and stacked-tensor batch results.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- backend-api-design
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100