brain-score / brain-score/vision

model_helpers: fail early for empty stimulus set

Open
#376 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
193
Forks
105
Avg merge
10h 48m
Merged PRs (30d)
10

Description

when given an empty stimulus set, the activations extraction eventually runs in an error where the layer activations are `None` (because there are no stimuli). The code should fail much earlier than this and immediately indicate that it cannot deal with no stimuli.

Contributor guide

No contributing guide indexed for this repository

Research direction

Locate the model_helpers code responsible for extracting activations and trace how an empty stimulus set reaches the point where layer activations are None. Confirm the earliest appropriate validation point and verify that empty input now produces an immediate, clear failure before activation extraction proceeds.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.