microsoft / microsoft/LakeBench

Proposal: ruff + CLI + cloud engines + TPC-DI + Databricks (5-PR stack)

Open
#82 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
54
Forks
21
Avg merge
1d 20h
Merged PRs (30d)
15

Description

I've got a set of changes I'd like to contribute as a 5-part stack, each based on main:

  1. lint — adopt ruff + pre-commit, enforce in CI
  2. cloud engines — Livy / Spark Connect + AST-based multi-part name qualification (fixes a silent catalog-dropping bug; makes fuzzy column remap opt-in)
  3. clilakebench CLI + profiles (fixes a token_env credential-dropping bug)
  4. tpcdi — TPC-DI benchmark port across six engines
  5. databricks — Databricks Connect engine

Each is independently green (ruff + tests). Do you prefer a base-chained stack of PRs, or sequential PRs against main (open #1, merge, rebase next)? Happy to do whichever fits your review workflow. I'll also call out two design questions inline (the Databricks constructor re-exec, and the W291/W293 lint ignore).

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start from the repository's main branch and review the proposed five areas separately: ruff and pre-commit CI, cloud engines, the lakebench CLI and profiles, TPC-DI, and Databricks Connect. Run the existing tests and lint checks for each independently green part, then resolve the requested PR-order and design questions before defining completion.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, spark
Domain
build-system, cli, cloud, data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.