Cloud-Code-AI / Cloud-Code-AI/BrowserEval
[Eval Results] smollm2-360m-instruct on smalleval/mmlu-nano:mmlu_high_school_mathematics.jsonl - 24.0% Accuracy
- Dominant language
- TypeScript
- Stars
- 2
- Forks
- 3
- PR merge metrics
- No merged PRs in 30d
Description
## Evaluation Results
### Metadata
- **Dataset**: smalleval/mmlu-nano:mmlu_high_school_mathematics.jsonl
- **Model**: smollm2-360m-instruct
- **Evaluation Type**: evaluation
### Performance Metrics
- **Accuracy**: 24.0%
- **Total Questions**: 250
- **Average Latency**: 0.00ms
- **Tokens/Second**: 0.00
- **Memory Usage**: 265.22MB
### System Information
- **Browser**: chrome 131
- **OS**: MacIntel
- **CPU**: 10 cores
- **RAM**: 8GB
- **GPU**: Not Available
- **Timestamp**: 2025-01-23 05:38:11
[Evaluation Results Jan 23 2025.json](https://github.com/user-attachments/files/18515621/Evaluation.Results.Jan.23.2025.json)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.