Torch Compile?

Thanks for such wonderful work!
I see you comment out this line:

https://github.com/AnswerDotAI/fsdp_qlora/blob/d7818ec86d17f37db4beef36f80870cbcac37957/train.py#L722

May I ask what is the rationale behind it? Is fsdp_qlora compatible with torch compile?

Start with train.py at line 722 and inspect the commented-out line in the referenced commit. Read the surrounding training setup and determine whether torch.compile is intended to work with the FSDP and QLoRA configuration; the issue is done when the rationale and compatibility status are established and clearly documented.

Written by the indexing model from the issue text.