lance-format/lance

View on GitHub

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

Stars: 7.1k
Forks: 852
Open beginner issues: 23
Indexed issues: 798
Avg merge: 3d 18h
Merged PRs (30d): 272

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 18, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

798 open issues indexed

Push limit into scalar index query Open

A-index enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6949 · 1 comment · Opened May 26, 2026
feat(index): add strided KMeans data view to avoid PQ sub-vector copies Open

A-index feature

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6928 · 2 comments · Opened May 24, 2026
Lance-Flink looks abandoned Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#6927 · 1 comment · Opened May 24, 2026
Stable-row-id Update/Merge: action for per-row version metadata refresh Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6914 · Opened May 22, 2026
Update: action translation + conflict resolution Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

lance-format/lance#6898 · Opened May 21, 2026
Rewrite: RewriteFragments action + translation + conflict resolution Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#6897 · Opened May 21, 2026
Overwrite: action translation + conflict resolution Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6896 · Opened May 21, 2026
Migrate CreateIndex to action-level conflict resolution Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6895 · Opened May 21, 2026
Migrate schema operations (Project, Merge) to action-level conflict resolution Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6894 · Opened May 21, 2026
Migrate metadata operations to action-level conflict resolution Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 28/100

lance-format/lance#6893 · Opened May 21, 2026
Action-level conflict resolution: framework + Append/Delete tracer bullet Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6892 · Opened May 21, 2026
Slow ANN search on very large distributed IVF_PQ index with many deltas Open

A-index performance

Difficulty 5/5 Over a week Newbie friendliness 38/100

lance-format/lance#6860 · 1 reaction · Opened May 20, 2026
Support u128 bitpacking for decimal128 columns Open

A-encoding enhancement

Difficulty 4/5 3-5 days Newbie friendliness 70/100

lance-format/lance#6857 · Opened May 20, 2026
Expose precomputed `RowAddrMask` as scanner prefilter input from Python API Open

A-python enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6852 · 4 comments · Opened May 19, 2026
DataReplacement: ReplaceFragmentColumns action + translation + conflict resolution Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

lance-format/lance#6842 · Opened May 19, 2026
Concurrent Dataset::open against the same URI rebuilds ObjectStore N times under a shared Session Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

lance-format/lance#6838 · Opened May 19, 2026
Add partition-level pruning for serial vector search Open

A-index enhancement performance rust

lance-format/lance#6825 · 1 assignee · Opened May 18, 2026
Add small-dimension batch kernels for Hamming and binary metrics Open

A-index enhancement performance rust

lance-format/lance#6824 · 1 assignee · Opened May 18, 2026
Add fused batch distance kernels for vector search Open

A-index enhancement performance rust

lance-format/lance#6823 · 1 assignee · Opened May 18, 2026
Vector search performance optimization roadmap Open

A-index enhancement epic performance

lance-format/lance#6820 · 1 assignee · Opened May 18, 2026
Options to heal a fragmented stable row id Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6803 · 1 comment · 1 reaction · Opened May 15, 2026
Tracking: Aggregate pushdown Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#6765 · 1 comment · 1 reaction · Opened May 13, 2026
COUNT(DISTINCT) cross-bucket combine Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6764 · Opened May 13, 2026
Aggregate pushdown optimizer rule Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 38/100

lance-format/lance#6763 · Opened May 13, 2026
IndexedAggregateExec: physical operator for index-driven aggregates Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6762 · Opened May 13, 2026
Implement CacheCode for HNSW indices Open

A-index enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

lance-format/lance#6745 · 1 comment · Opened May 12, 2026
How do I relocate / rename / replace a registered base path on an existing dataset? Open

question

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6720 · 2 comments · Opened May 8, 2026
Add benchmarks for the stable row id feature Open

benchmark enhancement performance

Difficulty 5/5 Over a week Newbie friendliness 42/100

lance-format/lance#6707 · 2 comments · 2 reactions · Opened May 7, 2026
Fast way to verify and eliminate corrupted data files Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6694 · Opened May 6, 2026
FR: Support Python 3.14 free-threading Open

A-python enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6690 · 2 comments · Opened May 5, 2026
Refactor IVF index build/optimize into a unified pipeline Open

A-index chore

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6686 · 1 comment · 2 reactions · Opened May 5, 2026
Expose build_index_metadata_from_segments (or commit_existing_index_segments) for two-phase vector-index commits outside the lance crate Open

A-index enhancement rust

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#6666 · 1 comment · Opened May 2, 2026
docs: document supported Azure file path formats Open

A-docs documentation

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6663 · 1 comment · Opened May 1, 2026
feat: add UAX#29 / ICU tokenizer for multi-language FTS support Open

A-index feature

Difficulty 5/5 Over a week Newbie friendliness 50/100

lance-format/lance#6661 · 3 comments · Opened May 1, 2026
Why can't we configure 1MiB blocks? On nested fixed-width lists, larger miniblock chunks cut file size ~6x, but a 4-bit metadata limit blocks it Open

A-encoding question

Difficulty 5/5 Over a week Newbie friendliness 38/100

lance-format/lance#6634 · 6 comments · Opened Apr 28, 2026
Stability: index stability of Lance under ultra-large table scenarios Open

A-index enhancement

lance-format/lance#6615 · 1 assignee · Opened Apr 25, 2026
cleanup_old_versions can delete files held by long-running readers Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6607 · 6 comments · Opened Apr 24, 2026
Support pluggable authentication providers for REST Namespace (e.g. AWS SigV4) Open

A-namespace enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6583 · 6 comments · Opened Apr 21, 2026
Follow-up: add NEON UDOT backend for dot_u8 once stabilized Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 38/100

lance-format/lance#6551 · Opened Apr 16, 2026
Feature: Support High Performance CAGRA GPU Vector Index Open

A-index feature performance

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#6534 · 9 comments · Opened Apr 16, 2026
.lance files can not be symlinks: "file size is too small" Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 68/100

lance-format/lance#6497 · Opened Apr 13, 2026
Support Tiered in-memory + SSD cache for data Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 45/100

lance-format/lance#6483 · 1 comment · Opened Apr 11, 2026
Redesign `index_statistics` Open

needs-info

Difficulty 5/5 Over a week Newbie friendliness 30/100

lance-format/lance#6481 · 1 comment · Opened Apr 10, 2026
Support PyArrow sorted MapType schemas Open

A-python enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6478 · 1 comment · 1 reaction · Opened Apr 10, 2026
PMC vote: new protobuf format for Action-based transactions Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

lance-format/lance#6455 · Opened Apr 8, 2026
Remove legacy Operation code paths Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

lance-format/lance#6454 · Opened Apr 8, 2026
storage options does not dedupe on equivalent keys Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

lance-format/lance#6447 · Opened Apr 8, 2026
Remove v1 merge_insert code path Open

chore

Difficulty 4/5 3-5 days Newbie friendliness 45/100

lance-format/lance#6445 · 2 reactions · Opened Apr 8, 2026
Implement scalar-indexed joins on v2 merge_insert path Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

lance-format/lance#6444 · Opened Apr 8, 2026
Research spike: indexed join strategy for v2 merge_insert Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

lance-format/lance#6443 · 1 comment · Opened Apr 8, 2026

lance-format/lance

Get new issues in your inbox