awslabs / awslabs/keys_values

Refactor main fine-tuning script

Open
#151 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
18
Forks
8
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**
The main fine-tuning script `keys_values/finetune/longcontext_full.py` has lots of code not really used anymore.

**Describe the solution you'd like**
Remove code or move it to functions. Make sure the script is easy to understand and modify.

Contributor guide

Open the contributing guide

Research direction

Start by reading keys_values/finetune/longcontext_full.py and trace which parts of the fine-tuning script are still used. Refactor or remove obsolete code while keeping the script easy to understand and modify; done means the resulting script has no unused code identified during the review.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Refactor
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.