huggingface / huggingface/lighteval

[BUG] return _winapi.DuplicateHandle

Open
#1,108 1 comment 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
2.5k
Forks
555
Avg merge
1d 6h
Merged PRs (30d)
1

Description

## Describe the bug
A clear and concise description of what the bug is.

Every question, it returns the following:
```bash
File "", line 1, in
from multiprocessing.spawn import spawn_main; spawn_main(parent_pid=17480, pipe_handle=1604)
~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\chigo\AppData\Local\Programs\Python\Python313\Lib\multiprocessing\spawn.py", line 113, in spawn_main
new_handle = reduction.duplicate(pipe_handle,
source_process=source_process)
File "C:\Users\chigo\AppData\Local\Programs\Python\Python313\Lib\multiprocessing\reduction.py", line 79, in duplicate
return _winapi.DuplicateHandle(
```

## To Reproduce
Please provide all the steps needed to reproduce the behavior, or provide a minimal working example if needed. We will ignore issues missing this section.

```bash
set OPENAI_BASE_URL=http://localhost:11434/v1
set OPENAI_API_KEY=apikey
lighteval eval --timeout 600 --max-connections 1 --max-tasks 1 openai/gpt-oss:20b gsm8k
```

## Expected behavior
A clear and concise description of what you expected to happen.

It should run without printing the warning every question.

## Version info
Please provide your operating system, lighteval version or commit if you installed from main, and pip/conda environment if your problem concerns dependencies.

Windows 10
commit 6496d623f0b2905ce3118ac13179c3a665194759
uv 0.8.13

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.