pytorch 2.4 is too old.

The sd3 branch recommends using pytorch 2.4, but this is too old for new hardware (such as 5090 or MI300). I tried installing and running with 2.7, but got lots of errors when I tried to train a Lora. It looks like some effort is required to upgrade all the dependencies to a newer version of pytorch.

Start by reviewing the sd3 branch dependency setup and reproducing LoRA training with PyTorch 2.7. Identify the dependency and compatibility errors that occur on newer hardware such as the 5090 or MI300. Done means the sd3 branch supports a newer PyTorch version and LoRA training runs without those errors.

Written by the indexing model from the issue text.