h2oai / h2oai/datatable

Eager evaluator should memoize intermediate results

Open
#849 0 comments 0 reactions 0 assignees View on GitHub
DT[i,j,...] performance
Dominant language
C++
Stars
1.9k
Forks
164
Avg merge
7h 31m
Merged PRs (30d)
1

Description

Sometimes calculated expressions may compute the same column or subexpression multiple times. For example, in `{"sum": f.A + f.B, "dif": f.A - f.B}` each of the columns `A` and `B` is extracted from the source Frame and materialized twice, even though we could have remembered the result on the first run. A similar mechanism is already used for llvm evaluator, so this should be relatively easy to implement.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.