apache / apache/arrow-adbc

perf(c/driver/sqlite): ideas to improve bulk ingest speed

Open
#1,106 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C#
Stars
627
Forks
217
Avg merge
17h
Merged PRs (30d)
57

Description

https://voidstar.tech/sqlite_insert_speed/

I don't think it's a big deal, but in case we ever need to...

The big wins seem to be (1) unrolling the inner loop by inserting a few rows per statement and (2) delaying the index until the insert is finished

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.