brain-score / brain-score/brain-score.web
engineering benchmarks not showing up on website after successful run
- Dominant language
- JavaScript
- Stars
- 3
- Forks
- 7
- Avg merge
- 7m
- Merged PRs (30d)
- 1
Description
Hi all,
@mschrimpf started the engineering benchmarks for a few of my models and it looks like they ran successfully, but they aren't showing up on the website. for instance, it looks like the evals are at the bottom of this log file: http://braintree.mit.edu:8080/job/run_benchmarks/3835/console
But on the website the benchmarks are missing:

Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the successful engineering benchmark output at the linked run_benchmarks/3835 console log, then compare those results with the benchmarks shown on the website. Trace where the website obtains engineering benchmark data. Done means successful runs such as those in the log appear on the website.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript
- Domain
- web-dev
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100