awslabs / awslabs/keys_values

Do finetune scripts work with AMP?

Open
#14 0 comments 0 reactions 0 assignees View on GitHub
question
Dominant language
Python
Stars
18
Forks
8
PR merge metrics
No merged PRs in 30d

Description

**Is your feature request related to a problem? Please describe.**

Can AMP be used here? https://developer.nvidia.com/automatic-mixed-precision

If not, why not?

Contributor guide

Open the contributing guide

Research direction

Start by locating the finetune scripts and reviewing how they perform training, then compare that setup with NVIDIA's Automatic Mixed Precision guidance linked in the issue. Determine whether AMP works without changing the scripts and document the compatibility result, including why it does or does not work.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.