ClickHouse / ClickHouse/ClickHouse

FlatDictionary decrease memory consumption

Open
#22,041 0 comments 2 reactions 0 assignees View on GitHub
comp-dictionary external feature memory
Dominant language
C++
Stars
49.9k
Forks
9k
Avg merge
21h 32m
Merged PRs (30d)
515

Description

Currently for each dictionary attribute we allocate array, and we also have loaded ids array. Loaded ids and attributes arrays size equals to greatest fetched index from source.
This is suboptimal because we can insert in attributes values only for keys that are actually fetched from source, in loaded ids array we store index of element in attributes array.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.