huggingface / huggingface/setfit
Match setfit.Trainer Ray compatibility with Transformers
Open
- Dominant language
- Jupyter Notebook
- Stars
- 2.8k
- Forks
- 267
- Avg merge
- 36m
- Merged PRs (30d)
- 5
Description
Currently the `setfit.Trainer` class only accepts `datasets.Dataset`-like objects, which means I cannot pass `ray.data` Dataset like I would normally do when using `transformers.Trainer`
See ray docs for example code: https://docs.ray.io/en/latest/train/getting-started-transformers.html
Currently, passing a ray dataset fails at this line: https://github.com/huggingface/setfit/blob/b9617171d281c2101487cf6b0ab81c14807b7110/src/setfit/trainer.py#L189
Is it possible to allow SetFit to run on ray using a distributed dataset?
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.