huggingface / huggingface/tokenizers
Progress bar doesn't show in log file.
- Dominant language
- Rust
- Stars
- 11k
- Forks
- 1.2k
- Avg merge
- 3d 8h
- Merged PRs (30d)
- 26
Description
If not redirect it to my log file, it's all OK.
```
root@5b325f584bab:/data/project/# python -u ./src/tokenizing.py --vocab_size 20000
Processing: 2%|███▏ | 458702/22828272 [00:31<25:29, 14628.06examples/s]
Training BPE: 0%| | 0/459 [00:00 ./log/log.tokenizing &
```
The output is as following:
```
Processing: 0%| | 0/22828272 [00:00
Contributor guide
Assessment
This issue has not been assessed yet.