examine optimizations for projection
- Lingua principale
- Haskell
- Stelle
- 952
- Fork
- 50
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
Based on new benchmarks, projection is unnecessarily expensive. Projection on 1000 tuples take 50 seconds, which is really excessive. Profiling reveals that duplicate tuple detection (tuple hashing) is the cause.
Some potential optimizations are:
* elimination of deduplication on projection on key attributes - if the attributes passed in cover a candidate key, then no deduplication (hashing) is required
* replacing relFold + union with something targeting tuples instead of relations
* deferring deduplication until the projection is complete
* bloom filters for the hash values as a first pass
Are there some other ideas?
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Valutazione
Questa issue non è ancora stata valutata.