h2oai/db-benchmark

View on GitHub

reproducible benchmark of database-like ops

Stars: 351
Forks: 100
Open beginner issues: 0
Indexed issues: 51

Dominant language: R
License: MPL-2.0
Last GitHub push: Jun 9, 2021
Latest indexed: Sep 17, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Open All

51 open issues indexed

measure memory usage Open

h2oai/db-benchmark#9 · 1 comment · 2 reactions · 0 assignees · Indexed Sep 17, 2026
add `subset` task Open

new task

h2oai/db-benchmark#14 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
advanced questions for `join` tests Open

new task

h2oai/db-benchmark#18 · 5 comments · 0 reactions · 1 assignee · Indexed Sep 17, 2026
Add python's modin Open

new solution

h2oai/db-benchmark#38 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
add groupby 500GB (1e10) Open

h2oai/db-benchmark#39 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
Consider adding mapd Open

new solution

h2oai/db-benchmark#43 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
`sort` task Open

new task

h2oai/db-benchmark#61 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
"by reference" operations task Open

new task

h2oai/db-benchmark#62 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
add R's disk.frame as a solution Open

new solution

h2oai/db-benchmark#88 · 5 comments · 2 reactions · 0 assignees · Indexed Sep 17, 2026
subset and group combined task Open

new task

h2oai/db-benchmark#103 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Add Rust's DataFusion (arrow) Open

new solution

h2oai/db-benchmark#107 · 9 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
R gc is choking during groupby 1e9 k=2 Open

data.table dplyr exceptions

h2oai/db-benchmark#110 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
not enough memory to read 1e9 data Open

dask exceptions pandas

h2oai/db-benchmark#111 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
sort-ops tasks Open

new task

h2oai/db-benchmark#115 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
new task: read Open

new task

h2oai/db-benchmark#131 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
new task: timeseries Open

new task

h2oai/db-benchmark#139 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
dplyr cannot compute groupby on 1e9 rows data anymore Open

dplyr exceptions

h2oai/db-benchmark#152 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
awk Open

new solution

h2oai/db-benchmark#160 · 11 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
clickhouse join fails for 1e9 data size Open

clickhouse exceptions

h2oai/db-benchmark#169 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
pandas (and dask) cannot yet handle NAs during groupby Open

dask exceptions pandas

h2oai/db-benchmark#171 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
dask new exception during groupby 1e8 q10 Open

dask exceptions

h2oai/db-benchmark#174 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
reshape task (pivot, unpivot) Open

new task

h2oai/db-benchmark#175 · 4 comments · 4 reactions · 0 assignees · Indexed Sep 17, 2026
Whole script performance Open

new task

h2oai/db-benchmark#177 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Add Vaex comparison Open

new solution

h2oai/db-benchmark#180 · 5 comments · 3 reactions · 0 assignees · Indexed Sep 17, 2026
arrow internal error in groupby 1e9 k=2 Open

arrow exceptions

h2oai/db-benchmark#190 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
new tasks: sort and groupby/join Open

new task

h2oai/db-benchmark#203 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
duckdb NA handling regression in 0.2.6 Open

duckdb exceptions

h2oai/db-benchmark#206 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
groupby q7 should not decompose complex expression Open

dask pandas

h2oai/db-benchmark#213 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
cudf with dask does not yet have median implemented Open

cudf

h2oai/db-benchmark#216 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
cudf via dask fail with groupby q10 Open

cudf

h2oai/db-benchmark#217 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
cudf dask join on categorical fails Open

cudf

h2oai/db-benchmark#218 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
cudf join 1e8 fails on q5 Open

cudf

h2oai/db-benchmark#220 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
cudf does not handle NAs anymore Open

cudf

h2oai/db-benchmark#221 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
data.table uses keyby in place of by Open

h2oai/db-benchmark#226 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
developer's script location is accidentally left in the source code Open

h2oai/db-benchmark#227 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Consider renaming "Arrow" case? Open

h2oai/db-benchmark#229 · 12 comments · 5 reactions · 0 assignees · Indexed Sep 17, 2026
Mind re-running with DuckDB 0.2.8? Thanks! Open

h2oai/db-benchmark#231 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 17, 2026
allow solutions to load data on demand for joining task Open

h2oai/db-benchmark#234 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Steps of running benchmarks in Windows Open

h2oai/db-benchmark#236 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
pyarrow supports groupby operations now. Open

h2oai/db-benchmark#237 · 0 comments · 3 reactions · 0 assignees · Indexed Sep 17, 2026
Add q/shakti Open

h2oai/db-benchmark#239 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Make datasets more accessible Open

h2oai/db-benchmark#241 · 4 comments · 1 reaction · 0 assignees · Indexed Sep 17, 2026
Get DataFusion added to H2O AI DB-Benchmark Open

h2oai/db-benchmark#242 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 17, 2026
Add Pyspark.pandas to benchmark Open

h2oai/db-benchmark#246 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Has anyone following this created a dockerfile to run this? Open

h2oai/db-benchmark#247 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
update the benchmarks? Open

h2oai/db-benchmark#248 · 6 comments · 15 reactions · 0 assignees · Indexed Sep 17, 2026
CUDF Package Issue: Merging on categorical variables with mismatched ordering is ambiguous Open

h2oai/db-benchmark#249 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Ruby Dataframes Open

h2oai/db-benchmark#250 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026
Where I can download duckdb-latest 0.8.0 for test Open

h2oai/db-benchmark#253 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 17, 2026
h2oai Database-like OPS Benchmark Foster Innovation and Competition Open

h2oai/db-benchmark#254 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 17, 2026

h2oai/db-benchmark

Get new issues in your inbox