huggingface / huggingface/lighteval

[BUG] custom model docs don't run: missing imports

Open
#760 5 comments 0 reactions 0 assignees View on GitHub
bug documentation good first issue
Dominant language
Python
Stars
2.5k
Forks
555
Avg merge
1d 6h
Merged PRs (30d)
1

Description

## Describe the bug

https://github.com/huggingface/lighteval/blob/v0.9.2/docs/source/evaluating-a-custom-model.mdx#creating-a-custom-model did not import `ParallelismManager`.

https://github.com/huggingface/lighteval/blob/v0.9.2/docs/source/using-the-python-api.mdx uses a nonexistent `EnvConfig`

## To Reproduce

N/a

## Expected behavior

Docs to not have missing imports

## Version info

`lighteval==0.9.2`

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.