brain-score / brain-score/vision

provide log file to submitters

Open
#213 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
193
Forks
105
Avg merge
10h 48m
Merged PRs (30d)
10

Description

Right now we only tell people their submission is faulty but not in what way -- we should really provide the log file, maybe with some system internals masked. @jjpr-mit what do you think should not be made public from the log file?
Ideally we could also format the logs similar to how travis does it, i.e. expandable logs per command. Maybe there is a jenkins plugin for this? In that case, sending the log file would probably get rid of the structure, but perhaps we could display it in jenkins with a token or on the website?

Contributor guide

No contributing guide indexed for this repository

Research direction

No files or tests are named; start by tracing how submissions are validated and how Jenkins logs are produced and exposed to submitters. Define which system internals must be masked, then confirm that submitters can view safely formatted logs, with expandable command sections if supported.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
devops
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.