huggingface / huggingface/llm-course

Suggestion: clarify “next word” vs “next token” in causal language modeling explanation

Open Beginner friendly
#1 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
20
Forks
8
PR merge metrics
No merged PRs in 30d

Description

I noticed a small wording detail in the LLM Course, Section 1 “Transformer Models”, Chapter 4 “How do Transformers work?”.

In the explanation of causal language modeling, the text says:

> “predicting the next word in a sentence having read the n previous words”

As an English learner and beginner in LLMs, I initially understood this literally as “word prediction”. Later I realized that modern Transformer language models actually operate on tokens rather than true linguistic words.

Maybe a slightly more technically precise wording could be something like:

> “predicting the next token given the previous n tokens”

or perhaps adding a short note mentioning that “word” is being used as a beginner-friendly simplification.

I think the current explanation is approachable for newcomers, but this small clarification might help learners better connect language modeling concepts with tokenization later in the course.

Contributor guide

No contributing guide indexed for this repository

Research direction

Search the course source for the exact sentence in Section 1, “Transformer Models,” Chapter 4, “How do Transformers work?”. Read the surrounding causal language modeling explanation, then revise the wording or add the suggested clarification about tokens while preserving its beginner-friendly tone. Check the rendered chapter to confirm the explanation is clear and accurate.

Written by the indexing model from the issue text.

Assessment

Domain
documentation, machine-learning
Issue type
Documentation
Difficulty
1/5
Estimated time
Under an hour
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
86/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.