huggingface / huggingface/evaluate

Tests for Spaces requirements.txt upon push of new module

Open
#307 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
341
PR merge metrics
No merged PRs in 30d

Description

Upon merges we've sometimes had metrics Spaces break because of missing requirements which then need to be added to requirements.txt later.

Not sure what the best way to detect this is, though — sometimes it's not obvious because the requirement is wrapped in a library which has optional dependencies (e.g. [this](https://huggingface.co/spaces/evaluate-measurement/toxicity/blob/main/toxicity.py) one requires torch because it loads a torch classifier, but you wouldn't know it from the imports).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.