huggingface / huggingface/naacl_transfer_learning_tutorial

Label handling commit breaks the imdb finetuning script

未关闭
#3 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
725
派生
118
PR 合并指标
30 天内没有已合并 PR

描述

Thomas, thanks for sharing this code! I noticed that commit 8d9c2371fc37ba8958f174501a9afb91a7ef7a06 seems to have broken the default functioning of the classification finetuning scripts - in the previous version there seems to have been a key called `'labels'` associated with the imdb and trec dictionaries, but in `finetuning_train.py` [this line](https://github.com/huggingface/naacl_transfer_learning_tutorial/blob/69031641946979f0ce1a0961a6b50e290f3de434/utils.py#L127) still references the now deleted key.

I updated the line to just use `DATASETS_LABELS_URL['imdb']['test']` as intended, but then it seems that the S3 bucket doesn't have the IMDB test file.

See below:
```
file_path = "https://s3.amazonaws.com/datasets.huggingface.co/imdb/test.labels.txt"
label_file = cached_path(file_path)
with open(label_file, "r", encoding="utf-8") as f:
all_lines = f.readlines()
print(all_lines[:5])
```
Gives:
```
['\n', 'NoSuchKeyThe specified key does not exist.imdb/test.labels.txt3D9E7C511167A0FBRiidOcrHfFaqxW9tmUXRppE/G3lsYoCZcq+uaYDi2yPPoe8mv/Og6PMuUncwk+B53tGsvcCZMWk=']
```

Does the test file for IMDB still exist with this name? This doesn't seem to be an issue with TREC.

贡献指南

这个仓库没有索引到贡献指南

调研方向

从 finetuning_train.py 以及 utils.py 第 127 行附近引用的 DATASETS_LABELS_URL 定义开始,然后运行 IMDB 分类 finetuning 路径。检查为 imdb/test.labels.txt 配置的 S3 路径是否与可用的测试文件匹配,以及默认脚本是否能在没有已删除的 labels 键的情况下完成。IMDB 和 TREC 的标签处理都能使用当前数据集元数据正常工作,即表示完成。

由索引模型根据 Issue 内容生成。

评估

技术栈
aws, python
领域
data, machine-learning
Issue 类型
缺陷
难度
3/5
预计耗时
1-2 天
活跃度
停滞
描述清晰度
基本清楚
新手友好度
35/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。