lance-format / lance-format/lance

python: train_ivf() should accept target_partition_size instead of deprecated num_partitions

Open
#6,286 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

A-python enhancement
Dominant language
Rust
Stars
7.1k
Forks
852
Avg merge
3d 18h
Merged PRs (30d)
272

Description

Currently, the Python API lance.index.train_ivf() only accepts num_partitions, which is marked as deprecated in the docstring.

However, the recommended and modern parameter target_partition_size is not exposed in the Python binding, even though it is fully supported in the Rust core.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start at the Python binding for lance.index.train_ivf() and compare its exposed arguments with the Rust core implementation, which already supports target_partition_size. Done means the recommended target_partition_size parameter is available through the Python API instead of only the deprecated num_partitions parameter.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, rust
Domain
api
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
68/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.