brain-score / brain-score/brain-score.web

engineering benchmarks not showing up on website after successful run

Open
#154 2 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
JavaScript
Stars
3
Forks
7
Avg merge
7m
Merged PRs (30d)
1

Description

Hi all,

@mschrimpf started the engineering benchmarks for a few of my models and it looks like they ran successfully, but they aren't showing up on the website. for instance, it looks like the evals are at the bottom of this log file: http://braintree.mit.edu:8080/job/run_benchmarks/3835/console

But on the website the benchmarks are missing:
image

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the successful engineering benchmark output at the linked run_benchmarks/3835 console log, then compare those results with the benchmarks shown on the website. Trace where the website obtains engineering benchmark data. Done means successful runs such as those in the log appear on the website.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript
Domain
web-dev
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.