huggingface / huggingface/sentence-transformers

How to use multi GPU in training

Open
#59 1 comment 13 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
19.1k
Forks
2.9k
Avg merge
1d 19h
Merged PRs (30d)
61

Description

Hi, I have four GPUs of 1080ti. I have tried to use multi gpu for training. But it doesn't work. It can read four four gpus but only one be used.
Do I need to do any change of the code?
Thanks!

Contributor guide

No contributing guide indexed for this repository

Research direction

No files, tests, or training entry points are named. Start by reproducing training with the four GPUs and trace the project’s multi-GPU training path to determine why only one device is used. Done means training demonstrably uses all four GPUs, with a documented reproduction or verification.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.