lance-format / lance-format/lance

Refactor: we should move `DatasetIndexExt` into the `lance` crate

Open
#5,222 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

chore rust
Dominant language
Rust
Stars
7.1k
Forks
852
Avg merge
3d 18h
Merged PRs (30d)
272

Description

As I was working on the describe indexes function this trait was kind of annoying because it is in the lance-index crate. The lance-index create shouldn't need to have any knowledge of the concept of a "dataset". I'm not sure we gain anything by having this here.

Dropping this here because I want to try and remember to address this after https://github.com/lancedb/lance/pull/5221 merges.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review the DatasetIndexExt trait in the lance-index crate and the describe indexes work mentioned in the issue. Confirm the dependency on PR 5221, then trace the trait's uses before moving the dataset-specific responsibility into the lance crate; done means lance-index no longer knows about datasets.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
backend
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.