huggingface / huggingface/lighteval

[FT] Manage script and language in the Language enum

Open
#745 2 comments 0 reactions 0 assignees View on GitHub
feature good first issue
Dominant language
Python
Stars
2.5k
Forks
555
Avg merge
1d 6h
Merged PRs (30d)
1

Description

## Issue encountered
At the moment, we assume one single script per language (which is incorrect).

## Solution/Feature
The Language enum needs to be updated to include the script, and templates need to be edited to select which script to provide among the alternatives. See the FLORES 200 task for an example where some subsets had to be removed for this reason.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.