brain-score / brain-score/brain-score.web

no samples shown for language benchmarks

Open
#177 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
JavaScript
Stars
3
Forks
7
Avg merge
7m
Merged PRs (30d)
1

Description

for vision models, we show sample images from the benchmark. Can we do the same with language stimuli?
At the very least, we should get rid of the `sample` placeholders (see e.g. http://www.brain-score.org/model/language/1651):
![image](https://github.com/brain-score/brain-score.web/assets/5308236/e235bbbd-d197-4ae3-bfdc-9a7bba3c6552)

Contributor guide

No contributing guide indexed for this repository

Research direction

Open the linked language benchmark page and compare it with the existing vision benchmark sample display. Trace the corresponding benchmark-page rendering flow, then make language stimuli appear as samples or remove the `sample` placeholders. Done means language benchmark pages no longer show empty placeholders and display samples when available.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
frontend
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.