AnswerDotAI / AnswerDotAI/fsdp_qlora
train.py
- Dominant language
- Jupyter Notebook
- Stars
- 1.6k
- Forks
- 201
- PR merge metrics
- No merged PRs in 30d
Description
I had to vary this code here in the Train.py to get it to work on my system
# LoRA and DORA modules
sys.path.append("./scripts")
from scripts.lora import LORA
from scripts.dora import BNBDORA, HQQDORA, DORALayer, MagnitudeLayer
probably because i already had a module called dora and lora in the pip.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with Train.py and inspect the imports for scripts/lora.py and scripts/dora.py. Reproduce the reported setup with pip modules named dora and lora, then verify that the training entry point resolves the intended project modules without manual changes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100