Convert AQEShuffleReadExec to native implementation.
Open
- Dominant language
- Rust
- Stars
- 1.8k
- Forks
- 241
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 22
Description
Convert AQEShuffleReadExec to native implementation
eg:
select /*+ REBALANCE(a) */ * from xxx_uuu_xxxx_datasource
after convert
InputAdapter
+- AQEShuffleRead coalesced
+- ShuffleQueryStage 0
+- NativeShuffleExchange hashpartitioning(a#0, 1000), REBALANCE_PARTITIONS_BY_COL, [id=#24]
+- InputAdapter [#0]
+- NativeOrcScan test.xxx_uuu_xxxx_datasource (FileScan orc bigdata_qa.xxx_uuu_xxxx_datasource[a#0] Batched: true, DataFilters: [], Format: ORC, Location: InMemoryFileIndex(1 paths)[-----, PartitionFilters: [], PushedFilters: [], ReadSchema: struct)
AQEShuffleReadExec never convert to native
Contributor guide
Assessment
This issue has not been assessed yet.