lance-format / lance-format/lance

Refactor python take benchmark

Open
#4,103 1 comment 5 reactions 1 assignee View on GitHub

@yanghua is already working on this.

Since Jun 30, 2025.

A-python benchmark chore performance
Dominant language
Rust
Stars
7.1k
Forks
852
Avg merge
3d 18h
Merged PRs (30d)
272

Description

Currently, the benchmark in Python (for example test_random_access.py) has some issues:

  • does not apply Python benchmark framework, it's hard to compare performances;
  • depends on some contexts, e.g., need to prepare ~/lineitemsf1.snappy.parquet
  • Compared with the legacy format, we should focus on v2.0 and v2.1;

I am doing the benchmark for Lance (Rust and Python), and will try to refactor the benchmark infra.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.