facebookresearch / facebookresearch/perception_models

how to finetune PLM with Deepspeed or other method to reduce GPU mem usage

Open
#62 1 comment 0 reactions 1 assignee Claimed by @shuminghu View on GitHub
PLM
Dominant language
Jupyter Notebook
Stars
2.4k
Forks
162
PR merge metrics
No merged PRs in 30d

Description

I find that , for [apps.plm.train](https://github.com/facebookresearch/perception_models/blob/main/apps/plm/train.py), PLM has been applied FSDP. It can not be fine-tuned with two 80G GPU mem (OOM error), setting `tp_size=2` and `batch_size=1` . the code can be trained with Deepspeed?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.