awslabs / awslabs/agent-training-kit

Val performance not improving

Open
#3 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
31
Forks
4
PR merge metrics
No merged PRs in 30d

Description

Hi, I'm getting these results when running the quick start without changing any settings:

Image

Running on a p4de.24xlarge

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the quick start without changing settings on a p4de.24xlarge and inspect the attached results image. Compare the observed Val performance with the quick-start expectations, then identify the relevant training entry point and verify the cause with a repeatable measurement.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.