Fast way to load optical flow video
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 5.8k
- Forks
- 678
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 27
Description
Hi,
We have ground-truth optical flow fields that we want to pass as metadata together with our mp4 videos ( see also closed issue #1941 ).
Initially I get the optical flow as openEXR files (with two float channels) , and would be glad to know if I can somehow load it fast as video or other way.
I was thinking of the VideoReader but not sure whether it can do it?
I also thought about converting the OF files to color images and then to a video,
can I do that without losing too much flow precision and be able to recover the flow on the GPU?
I thought of:
Normalize flow to [-1,1] => convert to HSV => store the normalization in some known saturation pixels => convert to RGB => mp4.
Any suggestions/alternatives are highly appreciated.
Thanks.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the VideoReader entry point mentioned in the issue and the closed issue #1941 for prior context. The issue does not name implementation files or tests; completion would require an agreed approach for loading optical-flow fields alongside MP4 video while preserving usable flow precision on the GPU.
Written by the indexing model from the issue text.
Assessment
- Domain
- computer-vision
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100