AnswerDotAI / AnswerDotAI/fsdp_qlora

Results after running

Open
#50 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.6k
Forks
201
PR merge metrics
No merged PRs in 30d

Description

![image](https://github.com/AnswerDotAI/fsdp_qlora/assets/149936473/e576bd0b-5e61-4872-8089-917b94a0e246)
![image](https://github.com/AnswerDotAI/fsdp_qlora/assets/149936473/98668c14-087d-4cfe-b46d-8e535d3243b2)
![image](https://github.com/AnswerDotAI/fsdp_qlora/assets/149936473/9cd83408-57d2-4743-828e-986fd3b2b2ea)
Why do I lose a lot of pre training weights after running, and how can I use the trained files for downstream tasks?

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points and provides only screenshots from a training run. Start by examining the run outputs and the repository's training workflow; determine whether the apparent loss of pretrained weights is expected and how the trained files can support downstream tasks. Done means both questions have documented, reproducible answers.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook
Domain
machine-learning
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.