Filter predicate should be able to filter on columns not specified in projection pushdown
- 主要言語
- Java
- スター
- 3.1k
- フォーク
- 1.6k
- 平均マージ
- 3日 12時間
- マージ済み PR(30日)
- 33
説明
When using both filter predicate and projection pushdown of columns, the column specified in the filter predicate, should not have to be specified in the projection pushdown.
For example, if I want the first names of students that are over the age of 16, then I should be able to specify ParquetInputFormat.setFilterPredicate(jobConf, IntColumn("age") > 16) and only have to specify ThriftReadSupport.setProjectionPushdown(jobConf, "fname")
**Reporter**: [Tim Chan](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=zzztimbo) / @zzztimbo
**Note**: *This issue was originally created as [PARQUET-295](https://issues.apache.org/jira/browse/PARQUET-295). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*
コントリビューションガイド
このリポジトリのコントリビューションガイドは索引されていません
調査の方向性
Start with ParquetInputFormat.setFilterPredicate and ThriftReadSupport.setProjectionPushdown, using the example in the issue to trace how projected columns and filter columns are handled together. The work is done when a projection containing only fname can still filter on age > 16, with coverage for that behavior added to the relevant existing tests.
索引モデルが issue の本文から書いたものです。
評価
- 技術スタック
- java
- 領域
- data
- issue の種類
- 機能追加
- 難易度
- 4/5
- 見積もり時間
- 3〜5日
- 活発さ
- 停滞
- 明瞭さ
- おおむね明確
- 初心者へのやさしさ
- 38/100