lance-format / lance-format/lance
Provide easy method for optimizing table
Open
Nobody has claimed this yet.
A-python
documentation
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
We'll be adding more methods for optimizing tables, but we want to keep it convenient for users to optimize their tables.
We can do three things to achieve this:
- Add a method to run default optimizations, that has reasonable defaults that work for most tables.
- Allow setting optimization configuration within the format. The default optimization method should pick up this configuration and run with those. This way users only have to customize once and not pass the parameters every time.
- Write good documentation directing users on the trade offs of different optimizations and how often they are run.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by reviewing the existing table optimization methods and format configuration, then determine how default optimizations and persisted settings should interact. Done should include a convenient default method, configuration support, and documentation covering optimization trade-offs and frequency.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100