google-deepmind / google-deepmind/seeing_without_pixels

Evaluation setup for the activity classification task

Open
#5 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
14
Forks
3
PR merge metrics
No merged PRs in 30d

Description

Hi, thank you very much for the excellent work and for open sourcing your project!

I'm trying to reproduce some of your results, particularly the activity classification accuracies and I was wondering how is one sample defined in that downstream task.

In other words, is it:
1) fixed-duration crop from the whole take associated with the take's global activity label or
2) sample associated with atomic action description with certain context window around it associated with the label of the take to which it belongs?

If it is the first option, how do you select that crop? Is scenario_cls.csv used for this task or?

I would appreciate any guidance. Thanks a lot!

Contributor guide

Open the contributing guide

Research direction

Start by tracing the activity-classification evaluation setup and inspect how scenario_cls.csv is used. Determine whether samples are fixed-duration crops or action-centered windows, how crops are selected, and which label is assigned. Done means the sampling and labeling procedure is documented clearly enough to reproduce the reported accuracies.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.