Lightning-AI / Lightning-AI/lit-llama
This codebase has so many errors it is completely useless and unusable
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 6.1k
- Forks
- 517
- PR merge metrics
- No merged PRs in 30d
Description
precision = "bf16-true"
is unsupported but in the code for lora-finetuning
fabric.init_module
causes a does not exist error.
with fabric.device
results in an error in full fine-tuning script
Overall very poor experience and poor documentation. Garbage
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the reported failures in the lora-finetuning and full fine-tuning scripts, checking the bf16-true setting, fabric.init_module, and fabric.device references. Done requires identifying the separate causes and making those scripts run without the reported errors, but the issue does not specify expected behavior or tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100