huggingface / huggingface/setfit

MultiGPU support or better intergration for loading models

Open
#509 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.8k
Forks
267
Avg merge
36m
Merged PRs (30d)
5

Description

Is it posssible to train on more than one gpu https://huggingface.co/BAAI/bge-m3 currently ooming on this model. BGE allows to load fp16 but cant do it with sefit

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.