[Question] Clarification on video preprocessing for evaluation — HEVC selector, unsupported codecs, and MV+residual vs bitcost
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 1.6k
- Forks
- 174
- PR merge metrics
- No merged PRs in 30d
Description
Hi, I'm trying to reproduce the results in Table 4 and have a few questions about the evaluation pipeline:
-
HEVC selector in Table 4: Does "HEVC selector" mean all videos are first re-encoded to HEVC, and then the codec primitives (MV + residual) are extracted from the HEVC bitstream? Or does it mean the selector only works on videos already in HEVC format, with other formats falling back to frames mode?
-
Unsupported codecs in benchmarks: Some standard benchmarks contain videos in formats not natively supported by HEVC/H.264 pipelines (e.g., VP6F in NExTQA, MPEG-4 in MVBench). How were these handled during evaluation? Were they transcoded to HEVC, or evaluated with a different backend?
-
MV+residual vs bitcost: The paper describes the importance map as "MV magnitude + residual energy", but the codebase uses bitcost. Which method was used for the Table 4 numbers? If bitcost was used, could you clarify the relationship between the two?
Thanks!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing the evaluation pipeline used for Table 4 and the code path that selects HEVC, frames, MV+residual, or bitcost. No file, test, or entry point is named in the issue; completion requires clarification of transcoding and unsupported-codec handling, plus which importance-map method produced the reported numbers.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- computer-vision
- Issue type
- Documentation
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100