huggingface / huggingface/transformers.js
Add support for indictrans2
- Dominant language
- JavaScript
- Stars
- 16.3k
- Forks
- 1.2k
- Avg merge
- 6d 2h
- Merged PRs (30d)
- 6
Description
### Model description
With the recent support for custom models, is it possible to run [IndicTrans2](https://huggingface.co/ai4bharat/indictrans2-en-indic-dist-200M) . It is basically nllb with a custom tokenizer.
### Prerequisites
- [X] The model is supported in Transformers (i.e., listed [here](https://huggingface.co/docs/transformers/index#supported-models-and-frameworks))
- [X] The model can be exported to ONNX with Optimum (i.e., listed [here](https://huggingface.co/docs/optimum/main/en/exporters/onnx/overview))
### Additional information
_No response_
### Your contribution
None, no idea of whether the custom tokenizer is required on js side or nllb tokenizer is fine.
Contributor guide
Assessment
This issue has not been assessed yet.