tursodatabase / tursodatabase/libsql

Expose a way to INSERT without parsing SQL?

Open
#2,057 1 comment 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
C
Stars
17.2k
Forks
531
Avg merge
1h 12m
Merged PRs (30d)
1

Description

I'm looking at inserting 100s of millions of rows into libSQL/SQLite. I've been wondering if one way to optimize that would be to get rid of:

  1. building those huge strings with INSERT ... VALUES
  2. having to parse strings those on libsql side

Ideally, there would be some db.Insert(table, [row1, row2]) API that allows to avoid going through SQL layer.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. Start by locating the existing INSERT and SQL parsing paths in libSQL/SQLite, then determine the API and implementation scope needed to support bulk row insertion without SQL text; done should include a defined interface and evidence that it avoids the stated overhead.

Written by the indexing model from the issue text.

Assessment

Tech stack
sqlite
Domain
database
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.