AnswerDotAI / AnswerDotAI/fsdp_qlora

bugs for fine-tune fsdp multinode

Open
#26 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.6k
Forks
201
PR merge metrics
No merged PRs in 30d

Description

![image](https://github.com/AnswerDotAI/fsdp_qlora/assets/77484083/03335c76-e593-4534-9afa-84f16ff05007)
how to fix that

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue provides only an attached screenshot and asks how to fix bugs in multinode FSDP fine-tuning. Start by identifying the error shown and reviewing the QLoRA + FSDP training setup; done should include a reproducible diagnosis and a verified fix for multinode fine-tuning.

Written by the indexing model from the issue text.

Assessment

Domain
distributed-systems, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.