Cloud-Code-AI / Cloud-Code-AI/BrowserEval
[Eval Results] smollm2-360m-instruct on smalleval/mmlu-nano:mmlu_high_school_physics.jsonl - 23.8% Accuracy
- Dominant language
- TypeScript
- Stars
- 2
- Forks
- 3
- PR merge metrics
- No merged PRs in 30d
Description
## Evaluation Results
### Metadata
- **Dataset**: smalleval/mmlu-nano:mmlu_high_school_physics.jsonl
- **Model**: smollm2-360m-instruct
- **Evaluation Type**: evaluation
### Performance Metrics
- **Accuracy**: 23.8%
- **Total Questions**: 151
- **Average Latency**: 0.00ms
- **Tokens/Second**: 0.00
- **Memory Usage**: 269.19MB
### System Information
- **Browser**: chrome 131
- **OS**: MacIntel
- **CPU**: 10 cores
- **RAM**: 8GB
- **GPU**: Not Available
- **Timestamp**: 2025-01-21 05:35:04
[Evaluation Results Jan 21 2025 (1).json](https://github.com/user-attachments/files/18485246/Evaluation.Results.Jan.21.2025.1.json)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.