brain-score / brain-score/language

Severe slowdown in `scipy.stats.pearsonr` calls when using Dask (via result_caching)

Open
#241 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
45
Forks
21
Avg merge
1h 7m
Merged PRs (30d)
1

Description

When the `dask` library is installed as a dependency (through the `result_caching` module, see [here](https://github.com/brain-score/result_caching/blob/31ea59215e8a81ed3b6720dbe6eef3e9fd065f6e/setup.py#L12)), calls to `scipy.stats.pearsonr` become significantly slower. This slowdown notably impacts performance during ceiling calculations, which rely on `result_caching`. Removing or bypassing `dask` in this workflow returns `pearsonr` to its expected speed. We need to investigate why `dask` is causing this overhead and how to mitigate it without sacrificing functionality in `result_caching`.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.