[BUG]try to train lora but the lora parameter seem not be updated, how to check the reason

Open

#7,632 opened on Oct 15, 2025 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug training

Dominant language: Python
Stars: 43.1k
Forks: 5k
Avg merge: 4d 15h
Merged PRs (30d): 112

Description

Describe the bug
A clear and concise description of what the bug is.

here is my train code to check, I check the parameter value, and find it not change during my train, it is always 0.0, I don't know how to debug for the problem

Contributor guide

Open the contributing guide

First steps

Read the whole issue, then the project's contributing guide.
Comment on the issue to say you are picking it up — it saves two people doing the same work.
Fork the repository and make your change on a branch.
Open a pull request that references the issue number.

Research direction

Start with the attached training code and the parameter-value check shown in the issue. Reproduce the LoRA training run, determine why the parameter remains 0.0 during training, and document the debugging result or a fix.

Written by the indexing model from the issue text.

Assessment

Tech stack: python
Domain: machine-learning
Issue type: Bug
Difficulty: 4/5
Estimated time: 3-5 days
Activity status: Stale
Clarity: Needs clarification
Newbie friendliness: 25/100

A short digest of beginner-friendly GitHub issues.