facebookresearch / facebookresearch/perception_models

Does PLM support multi-GPU inference?

Open
#52 1 comment 0 reactions 0 assignees View on GitHub
PLM
Dominant language
Jupyter Notebook
Stars
2.4k
Forks
162
PR merge metrics
No merged PRs in 30d

Description

Hello,

Thank you for your great work.

I'm currently using apps/plm/generate.py for PLM model inference and noticed that it appears to only support single-GPU operation. For larger models, having multi-GPU support would be highly beneficial.

Could you please advise if:

There are existing multi-GPU inference capabilities that I might have missed in the implementation?

If not, are there plans to add this functionality in future releases?

Are there recommended workarounds or modifications to enable multi-GPU inference with the current codebase?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.