huggingface / huggingface/context-course

Correct answer order in Quizes of Unit 2 is fixed

Open
#18 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
90
Forks
20
PR merge metrics
No merged PRs in 30d

Description

Location: https://huggingface.co/learn/context-course

In both Quizzes of Unit 2 correct answer was always the first. I had this issue with AI generation and I would suggest explicit direction do diversify based on statistics.

For me the solution was adding explicit Quality Assurance script, at the end of the process.

Notes:
- I didn't observe this issue in Unit 1, but I am not certain it does not exist. If I observe the same in the next Units I will inform.
- I cannot tell if the same issue exists in other Learning paths

If the issue is random this ticket can close. The only reason I opened it is because I have seen the same issue in being very consistent (generation of 50+ questions) so there might be something here to improve.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at the Unit 2 quizzes in the linked Context Course and compare the answer positions across generated questions. Check whether the repeated first-choice pattern is systematic or random, and consider the reported Quality Assurance script as the reference for verification. Done means confirming the behavior and addressing it if it is reproducible.

Written by the indexing model from the issue text.

Assessment

Domain
content
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.