lance-format / lance-format/lance

Provide easy method for optimizing table

Open
#1,414 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

A-python documentation
Dominant language
Rust
Stars
7.1k
Forks
852
Avg merge
3d 18h
Merged PRs (30d)
272

Description

We'll be adding more methods for optimizing tables, but we want to keep it convenient for users to optimize their tables.

We can do three things to achieve this:

  • Add a method to run default optimizations, that has reasonable defaults that work for most tables.
  • Allow setting optimization configuration within the format. The default optimization method should pick up this configuration and run with those. This way users only have to customize once and not pass the parameters every time.
  • Write good documentation directing users on the trade offs of different optimizations and how often they are run.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No files, tests, or entry points are named. Start by reviewing the existing table optimization methods and format configuration, then determine how default optimizations and persisted settings should interact. Done should include a convenient default method, configuration support, and documentation covering optimization trade-offs and frequency.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.