AnswerDotAI / AnswerDotAI/fsdp_qlora

Why is o_proj not targetted?

Open
#44 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
1.6k
Forks
201
PR merge metrics
No merged PRs in 30d

Description

This issue has no description.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue has no description, files, tests, or entry point. Start by locating the LLM training configuration in the repository and trace how target modules are selected, with particular attention to o_proj. Done should include a confirmed explanation of why o_proj is not targeted and a clearly defined intended behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.