AnswerDotAI / AnswerDotAI/fsdp_qlora
What if I have three graphics cards?
Open
- Dominant language
- Jupyter Notebook
- Stars
- 1.6k
- Forks
- 201
- PR merge metrics
- No merged PRs in 30d
Description
I have rtx3090 * 1, rtx 3060 16G * 2, total mem is 24+16 * 2=56G
In this case, is it possible to finetune models?
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names no file, test, or entry point to inspect. First assess whether the RTX 3090 and two RTX 3060 cards can support the repository's QLoRA + FSDP fine-tuning setup; done would be a documented, reproducible answer or a clearly scoped implementation request.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100