huggingface / huggingface/lighteval

[BUG] core dump when using endpoint litellm

Open
#623 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
2.5k
Forks
555
Avg merge
1d 6h
Merged PRs (30d)
1

Description

## Describe the bug
When executing litellm endpoint tasks in a directory on the distributed file system, such as glusterfs, it causes a core dump.

Maybe the root cause is that in “lighteval/models/litellm_model.py“, the litellm cache type used is "disk" without specifying a directory. In disk cache mode, litellm uses ./.litellm_cache as the default directory. When this directory is located on the glusterfs distributed file system, there may be conflicts with SQLite, which is the underlying storage engine of diskcache.

## To Reproduce
lighteval endpoint litellm ...

## Expected behavior

## Version info
commit b9a2e56

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.