lance-format/lance

View on GitHub

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Stars: 7.1k
Forks: 852
Open beginner issues: 23
Indexed issues: 798
Avg merge: 3d 18h
Merged PRs (30d): 272

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 18, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

798 open issues indexed

MergeInsertBuilder: no API to set WriteParams (allow_external_blob_outside_bases) Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 72/100

lance-format/lance#6426 · Opened Apr 7, 2026
take_blobs: _rowaddr column duplicated on unsorted row ID path Open

enhancement

Difficulty 1/5 Under an hour Newbie friendliness 84/100

lance-format/lance#6425 · 2 comments · Opened Apr 7, 2026
index reader for segmented index Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

lance-format/lance#6399 · Opened Apr 3, 2026
Support byte-sized batch limits in file reader Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6387 · Opened Apr 2, 2026
range end index out of range for slice after merge Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

lance-format/lance#6386 · Opened Apr 2, 2026
Use u64 for lance-io reader byte ranges Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

lance-format/lance#6385 · 1 reaction · Opened Apr 2, 2026
Python GPU IVF training is ~5.8× slower than necessary due to redundant sampling and disk I/O Open

A-index A-python performance

Difficulty 4/5 3-5 days Newbie friendliness 52/100

lance-format/lance#6382 · Opened Apr 2, 2026
A slowly grown index created by calls to optimize does not yield as many partitions as one might expect Open

A-index performance

Difficulty 4/5 3-5 days Newbie friendliness 50/100

lance-format/lance#6380 · 1 reaction · Opened Apr 1, 2026
Support blob descriptor conversion for INSERT INTO SELECT across tables Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6372 · 3 comments · Opened Apr 1, 2026
KMeans to_kmeans centroid recomputation is suboptimal — each core redundantly scans all data Open

A-index performance

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6369 · 1 comment · Opened Apr 1, 2026
chore: use Uuid type for Transaction.uuid instead of String Open

chore

Difficulty 3/5 1-2 days Newbie friendliness 76/100

lance-format/lance#6346 · Opened Mar 30, 2026
Add metadata field into BranchContents and TagContents Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6337 · Opened Mar 30, 2026
Add tag creation and update timestamps to the Lance format Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

lance-format/lance#6333 · Opened Mar 30, 2026
Java: Add blob v2 write support with external blob references Open

A-encoding A-java enhancement

Difficulty 5/5 Over a week Newbie friendliness 42/100

lance-format/lance#6322 · Opened Mar 28, 2026
re-use Dataset.commit() as the main entry point to commit transactions Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6317 · Opened Mar 27, 2026
Improve retry handling for rename_if_not_exists Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6315 · 1 comment · Opened Mar 27, 2026
Tracking: Distributed Indexes Search Open

enhancement

lance-format/lance#6309 · 4 comments · 6 reactions · 1 assignee · Opened Mar 27, 2026
Optimize merge_partial_vector_auxiliary_files performance for 'non-PQ' index with ShardMergeReader Open

A-index performance

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6288 · Opened Mar 25, 2026
python: train_ivf() should accept target_partition_size instead of deprecated num_partitions Open

A-python enhancement

Difficulty 3/5 1-2 days Newbie friendliness 68/100

lance-format/lance#6286 · Opened Mar 25, 2026
Invalid results from FTS or vector search after a data replacement Open

A-index enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6283 · 1 comment · Opened Mar 24, 2026
Investigate better handling of streaming writes / lists in AIMD throttle Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#6272 · 1 comment · Opened Mar 24, 2026
Multi-base with the same bucket name in different storage accounts Open

enhancement

lance-format/lance#6230 · 2 comments · 1 assignee · Opened Mar 19, 2026
take_blobs(indices=...) fails with _rowaddr schema collision on multi-fragment tables Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#6227 · 1 comment · 1 reaction · Opened Mar 19, 2026
[Dictionary Encoding and Index] Got schema error when I try to create index on explicit dictionary columns Open

A-encoding A-index enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6226 · Opened Mar 18, 2026
Slowly increasing RSS Open

performance

lance-format/lance#6219 · 3 comments · 1 assignee · Opened Mar 18, 2026
Default num_partitions inconsistent and maybe not correct for large scales Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6201 · 1 reaction · Opened Mar 13, 2026
Make _take_rows & _rowid Public Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6200 · Opened Mar 13, 2026
panic when using merge_insert with an index and # of rows * embedding dimension > u32::MAX Open

A-index bug

lance-format/lance#6195 · 1 assignee · Opened Mar 13, 2026
[Blobs V2] Bulk / coalesced reads for BlobFile Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6178 · 6 reactions · Opened Mar 12, 2026
Overwrite / Restore asymmetry Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#6157 · Opened Mar 10, 2026
Document primary key behavior Open

A-docs documentation

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6156 · Opened Mar 10, 2026
Does Project only remove columns from the schema? Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

lance-format/lance#6155 · Opened Mar 10, 2026
Migrate away from Merge Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#6151 · 1 comment · Opened Mar 10, 2026
Make it possible for Rewrite to rebase on top of an Update / Delete Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

lance-format/lance#6150 · Opened Mar 10, 2026
Rebase successfully if two deletes affect the same rows Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6149 · Opened Mar 10, 2026
Feature Request: Use zstd trained dictionaries for miniblock compression Open

A-encoding feature

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6141 · 1 comment · Opened Mar 9, 2026
Concurrency throttle should be skipped on in-memory object stores and local / NVMe storage Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6135 · 1 comment · Opened Mar 9, 2026
Process-wide concurrency limit should be scoped to object stores instead Open

enhancement

lance-format/lance#6134 · 2 comments · 1 assignee · Opened Mar 9, 2026
Automatic cleanup of indexes on failed builds Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

lance-format/lance#6123 · Opened Mar 7, 2026
Support phrase queries on massive datasets (possibly via new search strategies) Open

A-index enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#6104 · 2 comments · Opened Mar 5, 2026
Make sure ScanScheduler works well with multiple object stores Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#6098 · 3 comments · Opened Mar 4, 2026
Feature Request: Support Per-Base Independent Credentials in Multi-Base Datasets Open

feature

lance-format/lance#6093 · 2 comments · 1 assignee · Opened Mar 4, 2026
Support versions count Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

lance-format/lance#6081 · Opened Mar 3, 2026
Simplify rules when vector/fts used as filter Open

A-index enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

lance-format/lance#6076 · 7 comments · 2 reactions · Opened Mar 2, 2026
Bounded Compaction Planner To Limit the amount of data processed during a single compaction Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

lance-format/lance#6039 · 1 comment · Opened Feb 27, 2026
Put data and deletion files in subdirectories Open

performance

lance-format/lance#6030 · 4 comments · 1 assignee · Opened Feb 27, 2026
Refactor index cache to store data-only IndexData and rehydrate indices without IO Open

A-index chore

lance-format/lance#6029 · 1 reaction · 1 assignee · Opened Feb 26, 2026
Follow-up: remove per-batch offsets copy in variable full-zip decode Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6027 · Opened Feb 26, 2026
Add clickbench results Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

lance-format/lance#5992 · Opened Feb 23, 2026
Allow the part files to be skipped when training FTS Open

A-index enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#5970 · Opened Feb 20, 2026

lance-format/lance

Get new issues in your inbox