huggingface / huggingface/context-course
Correct answer order in Quizes of Unit 2 is fixed
- Dominant language
- Python
- Stars
- 90
- Forks
- 20
- PR merge metrics
- No merged PRs in 30d
Description
Location: https://huggingface.co/learn/context-course
In both Quizzes of Unit 2 correct answer was always the first. I had this issue with AI generation and I would suggest explicit direction do diversify based on statistics.
For me the solution was adding explicit Quality Assurance script, at the end of the process.
Notes:
- I didn't observe this issue in Unit 1, but I am not certain it does not exist. If I observe the same in the next Units I will inform.
- I cannot tell if the same issue exists in other Learning paths
If the issue is random this ticket can close. The only reason I opened it is because I have seen the same issue in being very consistent (generation of 50+ questions) so there might be something here to improve.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start at the Unit 2 quizzes in the linked Context Course and compare the answer positions across generated questions. Check whether the repeated first-choice pattern is systematic or random, and consider the reported Quality Assurance script as the reference for verification. Done means confirming the behavior and addressing it if it is reproducible.
Written by the indexing model from the issue text.
Assessment
- Domain
- content
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 45/100