Training on Multiple GPUs

Hi, I was able to train on GPU successfully. I was wondering if the package supports training on multiple GPUs? If not, is there a way for me to modify the source code to take advantage of training in parallel?

Thank you.

The issue names no files, tests, or entry points. Start by locating the training entry point and checking how device selection is handled. Done would require a clearly defined approach to multi-GPU training, along with documentation or tests demonstrating the resulting behavior.

Written by the indexing model from the issue text.