Cloud-Code-AI / Cloud-Code-AI/BrowserEval
[Eval Results] smollm2-360m-instruct on smalleval/mmlu-nano:mmlu_high_school_mathematics.jsonl - 26.8% Accuracy
Open
- Dominant language
- TypeScript
- Stars
- 2
- Forks
- 3
- PR merge metrics
- No merged PRs in 30d
Description
## Evaluation Results
### Metadata
- **Dataset**: smalleval/mmlu-nano:mmlu_high_school_mathematics.jsonl
- **Model**: smollm2-360m-instruct
### Performance Metrics
- **Accuracy**: 26.8%
- **Average Latency**: 455.14ms
- **Tokens/Second**: 455.14
- **Memory Usage**: 398.24MB
### System Information
- **Browser**: chrome 131
- **OS**: MacIntel
- **CPU**: 10 cores
- **RAM**: 8GB
- **GPU**: Not Available
- **Timestamp**: 2025-01-23 06:34:54
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.