ByteDance-Seed / ByteDance-Seed/m3-agent

Evidence timestamp

Open
#19 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.4k
Forks
117
PR merge metrics
No merged PRs in 30d

Description

Hi, thank you for this work!

Is the "timestamp" field in the JSON for M3-bench-robot the timestamp at which evidence occurs for answering the question, or when the question is supposed to be asked?

Why are the timestamps equal to the video duration for a lot of the questions? e.g. for living_room_06 questions, all timestamps are 16:10 which is the video duration and not when the evidence occurs. Is there an annotation for when the query evidence ocurred?

Contributor guide

No contributing guide indexed for this repository

Research direction

Inspect the M3-bench-robot JSON entries for living_room_06 and compare their timestamp values with the video duration and available question or evidence fields. Confirm whether the timestamp denotes evidence time or query time, then document the intended meaning or correct the affected annotations so the timestamps identify the evidence event.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.