huggingface / huggingface/agents-course
Many "cheating" solutions on the leaderboard
- Dominant language
- MDX
- Stars
- 32.6k
- Forks
- 2.3k
- PR merge metrics
- No merged PRs in 30d
Description
Hi,
First of all, thanks for the great course! I personally enjoyed the final assignment, and I am still making some improvements. I was curious to explore how others did it, but if you check the top scores on the student leaderboard, it looks like many are using a "fake" retriever agent that just connect to a Supabase db to map the question to an expected answer...
This is sad! Just want to bring this to your attention, it may not be too hard to block these...
Here is an example: https://huggingface.co/spaces/baixianger/RobotPai/blob/main/agent.py
Cheers,
Thomas
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.