aRustyDev / aRustyDev/ccgram

Train fallback model

Open
#13 0 comments 0 reactions 0 assignees View on GitHub
experiment model
Dominant language
Python
Stars
0
Forks
0
PR merge metrics
No merged PRs in 30d

Description

## Summary
Train the neural fallback model on the training dataset.

## Success Criteria
- [ ] Training loop implemented with proper logging
- [ ] Validation loss tracked
- [ ] Best checkpoint saved automatically
- [ ] Training reproducible with fixed seeds
- [ ] Training completes in reasonable time (<24h on consumer GPU)
- [ ] Final model meets latency requirements

## Training Details
- Loss: Cross-entropy on next token prediction
- Optimizer: AdamW
- LR schedule: Warmup + cosine decay
- Batch size: Tune for hardware

## Experiment Tracking
- Log to experiments/neural-fallback-v1/
- Track: loss curves, learning rate, gradient norms
- Save: config, final metrics, best checkpoint

## Hardware Target
- Should train on single consumer GPU (RTX 3080 or similar)
- CPU training acceptable if slow but completes

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.