examine optimizations for projection
- Vorherrschende Sprache
- Haskell
- Sterne
- 952
- Forks
- 50
- PR-Merge-Kennzahlen
- Keine gemergten PRs in 30 T.
Beschreibung
Based on new benchmarks, projection is unnecessarily expensive. Projection on 1000 tuples take 50 seconds, which is really excessive. Profiling reveals that duplicate tuple detection (tuple hashing) is the cause.
Some potential optimizations are:
* elimination of deduplication on projection on key attributes - if the attributes passed in cover a candidate key, then no deduplication (hashing) is required
* replacing relFold + union with something targeting tuples instead of relations
* deferring deduplication until the projection is complete
* bloom filters for the hash values as a first pass
Are there some other ideas?
Beitragsleitfaden
Für dieses Repository ist kein Beitragsleitfaden indexiert
Bewertung
Dieses Issue wurde noch nicht bewertet.