datafusion-contrib / datafusion-contrib/datafusion-distributed
High elapsed compute in network shuffle with 100s of tasks
Open
@gene-bordegaray is already working on this.
Since Apr 16, 2026.
- Dominant language
- Rust
- Stars
- 139
- Forks
- 67
- Avg merge
- 3d 1h
- Merged PRs (30d)
- 35
Description
The hypothesis is that this is caused by the way we propagate plans, maybe we spend too much time serializing these messages. See #354.
We should investigate and determine the root cause.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.