Inaccessible Leaderboard with Screenreader
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 39.5k
- Forks
- 4.8k
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
I'm a blind user, and I can't access leaderboard.lmsys.org with a screen reader.
I tried accessing the website with many screen readers including Jaws, NVDA, Narrator on Windows, and VoiceOver on Mac.
All of them see only one row, and some of them have browser freezing issues.
Alternative solution might be to publish the raw ranking data in json/csv format.
I know you guys published raw data for battles, but maybe just publishing the ranking with benchmark scores would be great.
If publishing the data synchronized with the website in real time is not possible, could you consider maybe at least publishing once a day? That would be helpful.
Thanks so much!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by inspecting leaderboard.lmsys.org with a screen reader and compare its behavior across the readers named in the report. Review how the existing raw battle data is published; done means either an accessible leaderboard or a documented JSON/CSV ranking alternative with an agreed update cadence.
Written by the indexing model from the issue text.
Assessment
- Domain
- accessibility, web-dev
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100