huggingface / huggingface/model-evaluator

Cap the number of zero-shot evaluations allowed simultaneously

Open
#65 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
14
Forks
8
Avg merge
34m
Merged PRs (30d)
1

Description

Should this be a cap on the number of models to be evaluated per job, or a cap on the number of jobs runnable by a user at a time?

Not sure if there's an endpoint in AutoTrain which we can ping to find out what's running under a user ID — I assume so because the AutoTrain UI would need it, but I'm not clear on where that is.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.