lance-format/lance

View on GitHub

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Stars: 7.1k
Forks: 852
Open beginner issues: 23
Indexed issues: 798
Avg merge: 3d 18h
Merged PRs (30d): 272

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 18, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

798 open issues indexed

Write Range and Delta offsets in Lance 2.3 Open

A-encoding A-format enhancement format-change

lance-format/lance#8008 · 1 assignee · Opened Jul 27, 2026
Read generic variable-width offsets Open

A-encoding A-format enhancement

lance-format/lance#8007 · 1 assignee · Opened Jul 27, 2026
Add Range and Delta block codecs Open

A-encoding A-format enhancement format-change

lance-format/lance#8006 · 1 assignee · Opened Jul 27, 2026
Use concrete fallible block codec trees Open

A-encoding enhancement

lance-format/lance#8005 · 1 assignee · Opened Jul 27, 2026
feature: add lazy Polars integration for nearest-neighbor search Open

feature

Difficulty 5/5 Over a week Newbie friendliness 38/100

lance-format/lance#7996 · 4 comments · Opened Jul 24, 2026
Zonemap support for all data types Open

feature

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#7987 · Opened Jul 24, 2026
Reduce datafusion dependency in lance-index-core Open

feature

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#7981 · Opened Jul 24, 2026
Move ScalarIndexPlugin into lance-index-core Open

feature

Difficulty 3/5 1-2 days Newbie friendliness 50/100

lance-format/lance#7980 · Opened Jul 24, 2026
Tracking: Stability and Performance Optimization of Trillion-row Lance Tables Open

performance

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#7968 · 2 reactions · Opened Jul 24, 2026
bug: reject mismatched shard spec before epoch claim Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

lance-format/lance#7945 · Opened Jul 23, 2026
feat: Split version manifests into a hierarchical, independently loadable fragment catalog Open

feature performance

Difficulty 5/5 Over a week Newbie friendliness 30/100

lance-format/lance#7941 · Opened Jul 23, 2026
bug: manifest_scan_batch_size=0 can trust a stale manifest hint Open

bug performance

Difficulty 3/5 1-2 days Newbie friendliness 72/100

lance-format/lance#7928 · Opened Jul 23, 2026
Appending an all-null DictionaryArray fails with an out-of-bounds error Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 68/100

lance-format/lance#7906 · Opened Jul 22, 2026
refactor(index): centralize data-overlay invalidation masking across index query paths Open

A-index chore

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#7898 · Opened Jul 21, 2026
Register re-scannable write sources to avoid spilling re-readable inputs (Scanner/LanceDataset) Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 45/100

lance-format/lance#7895 · Opened Jul 21, 2026
Support cascading compression for sparse structural arrays Open

A-encoding A-format enhancement format-change

Difficulty 5/5 Over a week Newbie friendliness 30/100

lance-format/lance#7886 · 1 comment · Opened Jul 21, 2026
Huge performance regression between 2.0 and 2.1 formats in ordered scan Open

performance

lance-format/lance#7860 · 2 comments · 1 assignee · Opened Jul 20, 2026
`remove_dir_all` does not delete directories on ADLS Gen2 with hierarchical namespace Open

performance

Difficulty 5/5 Over a week Newbie friendliness 42/100

lance-format/lance#7847 · 2 comments · Opened Jul 19, 2026
Index reads fail with `Not found: .../tree/<parent>/_indices/...` through a branch created from another branch Open

feature

Difficulty 4/5 3-5 days Newbie friendliness 68/100

lance-format/lance#7840 · 1 comment · Opened Jul 18, 2026
`compact_files()` fails on any dataset containing null structs with non-nullable children — scanner null propagation breaks the read→write roundtrip Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 52/100

lance-format/lance#7826 · Opened Jul 16, 2026
Use original base paths when writing to a branch Open

feature

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#7785 · 3 comments · 1 reaction · Opened Jul 14, 2026
column expression parsing always use sql Open

performance

Difficulty 3/5 1-2 days Newbie friendliness 58/100

lance-format/lance#7781 · Opened Jul 14, 2026
Shallow clone has much worse random take() latency than source dataset for heavy columns under concurrency Open

performance

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#7762 · Opened Jul 13, 2026
Support distributed optimize of vector index delta segments Open

A-index enhancement performance

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#7731 · Opened Jul 10, 2026
feat: support conditional delete in merge-insert when_matched clause Open

feature

Difficulty 4/5 3-5 days Newbie friendliness 56/100

lance-format/lance#7725 · Opened Jul 10, 2026
write_fragments(enable_stable_row_ids=True) silently produces fragments without row-id metadata, rejected on commit Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 55/100

lance-format/lance#7702 · Opened Jul 9, 2026
Support list string columns in MemWAL FTS Open

A-index enhancement

Difficulty 3/5 1-2 days Newbie friendliness 67/100

lance-format/lance#7654 · 1 reaction · Opened Jul 7, 2026
Blob physical projection misreads empty non-null values Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#7598 · 1 comment · Opened Jul 3, 2026
Support HDFS as a storage backend Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#7584 · 13 comments · Opened Jul 2, 2026
Support dynamic filter pushdown in FilteredReadExec Open

enhancement performance rust

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#7562 · 3 comments · 1 reaction · Opened Jul 1, 2026
Soft-delete for DirectoryNamespace: separate DROP/PURGE, add TTL, and make listing O(1) Open

A-namespace enhancement

Difficulty 5/5 Over a week Newbie friendliness 28/100

lance-format/lance#7539 · Opened Jun 30, 2026
feat(ngram): add stop-trigram filtering for high-frequency tokens Open

A-index feature

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#7526 · 1 comment · Opened Jun 30, 2026
[Feature Request] In-place materialize of base-referenced files (promote a shallow clone / branch to independent without deep_clone) Open

feature

Difficulty 5/5 Over a week Newbie friendliness 42/100

lance-format/lance#7515 · 1 reaction · Opened Jun 29, 2026
cleanup_old_versions does not protect data files referenced via base_paths from another dataset (shallow-clone vacuum-on-source hazard) Open

A-format bug

Difficulty 5/5 Over a week Newbie friendliness 42/100

lance-format/lance#7514 · 2 comments · Opened Jun 29, 2026
V2 Format: Compaction outputs one page per input fragment Open

A-format enhancement

Difficulty 4/5 3-5 days Newbie friendliness 68/100

lance-format/lance#7502 · 5 comments · Opened Jun 26, 2026
Add time-to-idle (TTL) to LanceCache and revisit eviction policy for retired/old-version entries Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#7490 · 2 comments · Opened Jun 25, 2026
Default disable_transaction_file once v1.0.0+ readers are widespread Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#7487 · Opened Jun 25, 2026
Expose a public toggle for disable_transaction_file (skip redundant external transaction file) Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 52/100

lance-format/lance#7486 · Opened Jun 25, 2026
feat(index): support flattened JSON sub-doc indexing Open

feature

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#7445 · Opened Jun 24, 2026
Support nested column references in UpdateBuilder::set() Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#7420 · Opened Jun 23, 2026
perf(merge_insert): defer reading non-source columns via late-materialization optimizer rule Open

enhancement

lance-format/lance#7363 · 1 comment · 1 assignee · Opened Jun 18, 2026
Java release likely to be rate limited by Sonatype Open

A-java

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#7346 · 2 comments · Opened Jun 17, 2026
Slice 7: Deprecate .inner + explicit as_upstream_object_store() escape hatch Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#7338 · Opened Jun 17, 2026
Slice 4: Fault-injection / instrumentation parity test harness Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#7337 · Opened Jun 17, 2026
Slice 3: Reimplement IO stats as a pure store/reader/writer wrapper Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

lance-format/lance#7336 · Opened Jun 17, 2026
Slice 6: Migrate mutation .inner call sites to ObjectStore methods Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#7335 · Opened Jun 17, 2026
Slice 5: Migrate read .inner call sites to ObjectStore methods Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#7334 · Opened Jun 17, 2026
Slice 2: Write-path through wrapped Lance Writer Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#7333 · Opened Jun 17, 2026
Slice 1 (HITL): Lance-level wrapper surface + read-path tracer bullet Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#7332 · Opened Jun 17, 2026
Fully encapsulate object I/O behind Lance ObjectStore; deprecate .inner Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#7331 · 2 comments · 1 reaction · Opened Jun 17, 2026

lance-format/lance

Get new issues in your inbox