Update disclaimer text referencing version 0.5
Nobody has claimed this yet.
Assessment
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Newbie friendliness
- 58/100
- Issue type
- Documentation
- Clarity
- Clearly specified
- Activity status
- Stale
- Domain
- documentation
Research direction
Start by searching for the quoted version 0.5 disclaimer in docs/add-a-sut.md, src/modelbench/templates/content/general.toml, and src/modelbench/templates/content_mlc/general.toml. Update every listed occurrence so job logs no longer show the old copy, then verify the exact text is absent from those files.
Written by the indexing model from the issue text.
Description
The old copy is still present in some places.
Version 0.5 of this benchmark is a proof of concept only. Results are not intended to indicate actual levels of AI system safety.
- docs/add-a-sut.md
- src/modelbench/templates/content/general.toml
- src/modelbench/templates/content_mlc/general.toml
This language shows up in job logs, for example.
- Dominant language
- Python
- Stars
- 134
- Forks
- 36
- Avg merge
- 1d 11h
- Merged PRs (30d)
- 17
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
More from mlcommons/modelbench
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
mlcommons/modelbench#1659 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
mlcommons/modelbench#1656 ·
-
Difficulty 2/5 Half a day Newbie friendliness 84/100
mlcommons/modelbench#1629 ·
-
Difficulty 4/5 3-5 days Newbie friendliness 45/100
mlcommons/modelbench#1660 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
mlcommons/modelbench#1658 ·
All issues in mlcommons/modelbench
Similar issues
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
bancolombia/sentinel#23 ·
-
test md OpenCI
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
-
integration:quickjs org:external priority:backlog topic:code-interpreter topic:middleware type:feature
Difficulty 2/5 1-3 hours Newbie friendliness 74/100
langchain-ai/deepagents#6450 ·
-
bug client
Difficulty 2/5 1-3 hours Newbie friendliness 88/100
-
Difficulty 2/5 1-3 hours Newbie friendliness 74/100