apache / apache/gluten

[VL] Push Velox dynamic filters to shuffle reader

Open
#11,605 14 comments 1 reaction 1 assignee Claimed by @QCLyu View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 21h
Merged PRs (30d)
85

Description

As Velox's dynamic filter API is extensible, it's worth investigating whether we can push the filters down to Gluten's Velox shuffle reader to reduce the amount of data materialized from shuffle.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.