huggingface / huggingface/datatrove
invalid warning message
Open
- Dominant language
- Python
- Stars
- 3.3k
- Forks
- 302
- Avg merge
- 2h 18m
- Merged PRs (30d)
- 2
Description
https://github.com/huggingface/datatrove/blob/b9fb72a21350fd9ed13a115a6d24ea5f58015ae7/src/datatrove/pipeline/readers/base.py#L49-L86
text key is always poped by default adapter, so we would never know if it misses the text key or just because one record has empty field
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.