huggingface / huggingface/AIEnergyScore

What types of models can be submitted?

Open
#7 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
42
Forks
8
PR merge metrics
No merged PRs in 30d

Description

Hello HF team!

We tried to submit e.g. quantized models to the benchmark directly on [the web interface](https://huggingface.co/spaces/AIEnergyScore/submission_portal)? However, it mostly returns that the model is not compatible with the task while we use a LLM for the text generation task. As a concrete example, `PrunaAI/microsoft-phi-4-AWQ-4bit-smashed` or `PrunaAI/HuggingFaceTB-SmolLM-135M-Instruct-HQQ-1bit-smashed` returned this error.

- How can we submit the quantized models?
- Do you plan to support quantized models?

Looking forward to submit models here.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.