huggingface / huggingface/model-evaluator

Extend list of compatible models to include Text2Text models for translation / summarisation

Open
#37 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
14
Forks
8
Avg merge
34m
Merged PRs (30d)
1

Description

Many translation / summarization models are text2text pipelines that get excluded in the current filter for `summarization` or `translation`.

Do some tests in AutoTrain to see if we can easily evaluate these models and then extend the logic in the UI if so.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.