datafusion-contrib / datafusion-contrib/datafusion-dft

TPCH support

Open
#335 2 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Rust
Stars
203
Forks
22
Avg merge
18h 5m
Merged PRs (30d)
8

Description

Hi @matthewmturner this is not really an issue but more of a discussion thread, I've recently released https://github.com/clflushopt/datafusion-tpch which acts as a "boilerplate builder" for a TPC-H integration as we discussed a while ago in https://github.com/apache/datafusion/issues/14608. Let me know if it makes your life simpler, it acts as a sort of plugin to expose table functions and other helpers for running TPC-H directly. I am aware that you've integrated tpchgen into dft but let's see if using datafusion-tpch can help make it easier from an integration perspective.

P.S: I would be happy to donate and maintain the project as part of the datafusion-contrib repo if that is something you're open to @alamb suggested that it might help with discoverability in https://github.com/apache/datafusion/issues/14608#issuecomment-3016555361

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Review the linked datafusion-tpch project and DataFusion issue 14608 first; this issue names no file, test, or entry point in datafusion-dft. Done is undefined until maintainers decide whether to adopt the proposed integration and clarify its scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
cli, database
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.