AnswerDotAI / AnswerDotAI/fsdp_qlora

train.py

Open
#63 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.6k
Forks
201
PR merge metrics
No merged PRs in 30d

Description

I had to vary this code here in the Train.py to get it to work on my system
# LoRA and DORA modules
sys.path.append("./scripts")
from scripts.lora import LORA
from scripts.dora import BNBDORA, HQQDORA, DORALayer, MagnitudeLayer

probably because i already had a module called dora and lora in the pip.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with Train.py and inspect the imports for scripts/lora.py and scripts/dora.py. Reproduce the reported setup with pip modules named dora and lora, then verify that the training entry point resolves the intended project modules without manual changes.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.