AnswerDotAI / AnswerDotAI/ModernBERT

ST train example doesn't work on multi gpu

Open
#147 8 comments 0 reactions 1 assignee Claimed by @NohTow View on GitHub
Dominant language
Python
Stars
1.7k
Forks
145
PR merge metrics
No merged PRs in 30d

Description

When trying to run https://github.com/AnswerDotAI/ModernBERT/blob/main/examples/train_st.py on a machine with multiple GPU it crashes with

`RuntimeError: Detected that you are using FX to symbolically trace a dynamo-optimized function. This is not supported at the moment.`

Its the same with most existing hugging face examples, will it / should multi GPU be supported?

Using the CUDA_VISIBLE_DEVICES is how I worked around it to train with one GPU.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.