apache / apache/datafusion

Fuse multiple scalar-aggregate subqueries over the same source into a single scan

Aperta
#23,213 1 commento 0 reazioni 1 assegnatario Rivendicata da @nathanb9 Vedi su GitHub
Lingua principale
Rust
Stelle
9.3k
Fork
2.4k
Merge medio
3g 11h
PR unite (30g)
360

Descrizione

**Problem**

When a query computes several uncorrelated scalar-aggregate subqueries over the same table, DataFusion scans that table once per subquery.

**Proposed rewrite**

When 2 or more such subqueries share one source, fuse them into a single scan + aggregate, pushing each subquery's predicate into a `FILTER (WHERE ...)` clause:

```sql
-- Before: two scans of t
SELECT (SELECT count(*) FROM t WHERE a < 10),
(SELECT avg(x) FROM t WHERE a >= 10);

-- After: one scan of t
SELECT count(*) FILTER (WHERE a < 10),
avg(x) FILTER (WHERE a >= 10)
FROM t;
```

The source filter becomes the OR of the branch predicates, and each scalar subquery is replaced by a reference to the merged aggregate.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.