huggingface / huggingface/course

Course doc error in Chapter 7, Fine tuning MLM

Open
#524 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
MDX
Stars
4.2k
Forks
1.4k
Avg merge
13m
Merged PRs (30d)
1

Description

There is an error in the Course doc in Chapter 7, Fine tuning MLM:

[Fine-tuning DistilBERT with 🤗 Accelerate](https://huggingface.co/course/chapter7/3?fw=pt#fine-tuning-distilbert-with-accelerate)

This:
``` python
eval_dataset = eval_dataset.rename_columns(
{
"masked_input_ids": "input_ids",
"masked_attention_mask": "attention_mask",
"masked_labels": "labels",
}
)
```

Should be changed to:

``` python
eval_dataset = eval_dataset.rename_columns(
{
"masked_input_ids": "input_ids",
"masked_token_type_ids": "token_type_ids",
"masked_attention_mask": "attention_mask",
"masked_labels": "labels",
}
)
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.