agentm / agentm/project-m36

examine optimizations for projection

未關閉
#180 3 則留言 0 個 reaction 已指派 1 人 已被 @agentm 認領 在 GitHub 檢視
主要語言
Haskell
星號
952
分支
50
PR 合併指標
30 天內沒有已合併 PR

描述

Based on new benchmarks, projection is unnecessarily expensive. Projection on 1000 tuples take 50 seconds, which is really excessive. Profiling reveals that duplicate tuple detection (tuple hashing) is the cause.

Some potential optimizations are:

* elimination of deduplication on projection on key attributes - if the attributes passed in cover a candidate key, then no deduplication (hashing) is required
* replacing relFold + union with something targeting tuples instead of relations
* deferring deduplication until the projection is complete
* bloom filters for the hash values as a first pass

Are there some other ideas?

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。