huggingface / huggingface/tokenizers
Support for Golang now or support a cli for other languages?
Open
- Dominant language
- Rust
- Stars
- 11k
- Forks
- 1.2k
- Avg merge
- 3d 8h
- Merged PRs (30d)
- 26
Description
Hey team,
Thanks for this great library, this helped us to avoid installing the whole transformers library to be able to use the tokenizer!
Any plan for Golang binding over the Rust implementation or from scratch?
Also, where one would start to write it from scratch in Golang?
Contributor guide
Assessment
This issue has not been assessed yet.