huggingface / huggingface/model-evaluator

Warn users if model-to-be-evaluated does not have a model card

Open
#62 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
14
Forks
8
Avg merge
34m
Merged PRs (30d)
1

Description

I uploaded a new model and forgot to set a model card for it, so the eval job was failing silently (no error gets returned in this code, so the PR just never showed up). We should check model card existence for all models before kicking off the job, else raise an error.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.