ClickHouse / ClickHouse/ClickHouse
FlatDictionary decrease memory consumption
Open
comp-dictionary
external
feature
memory
- Dominant language
- C++
- Stars
- 49.9k
- Forks
- 9k
- Avg merge
- 21h 32m
- Merged PRs (30d)
- 515
Description
Currently for each dictionary attribute we allocate array, and we also have loaded ids array. Loaded ids and attributes arrays size equals to greatest fetched index from source.
This is suboptimal because we can insert in attributes values only for keys that are actually fetched from source, in loaded ids array we store index of element in attributes array.
Contributor guide
Assessment
This issue has not been assessed yet.