dask / dask/distributed

groupby on a filtered frame should automatically persist

Open
#617 9 comments 0 reactions 0 assignees View on GitHub
performance
Dominant language
Python
Stars
1.7k
Forks
778
Avg merge
2h 50m
Merged PRs (30d)
3

Description

so when doing a filtered frame (not using the index, maybe that is a different case), then doing an intensive operation, like a groupby. It is optimal to ``.persist`` the intermediate before the final computation to avoid many recompuations (e.g. for each of the groupers at the very least).

![image](https://cloud.githubusercontent.com/assets/953992/19929017/a34cf8f2-a0d7-11e6-950b-3f6a85dc7ecb.png)

![image](https://cloud.githubusercontent.com/assets/953992/19929023/ab2a539e-a0d7-11e6-8dee-274e5eae926d.png)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.