apache / apache/gravitino

[Subtask] Integrate tpc-ds and tpc-h in the spark-connector to provide more complex test cases

Open
#3,420 0 comments 0 reactions 0 assignees View on GitHub
subtask
Dominant language
Java
Stars
3.2k
Forks
935
Avg merge
1d 15h
Merged PRs (30d)
315

Description

### Describe the subtask

Integrate tpc-ds and tpc-h in the spark-connector.

Refer to gluten its, https://github.com/apache/incubator-gluten/tree/022c208564dbb6dc59b7d64fbc4ad002c166e012/tools/gluten-it

### Parent issue

https://github.com/datastrato/gravitino/issues/1227

Contributor guide

Open the contributing guide

Research direction

Review the spark-connector and the referenced Gluten tools/gluten-it integration first, then use parent issue #1227 for scope. Done means TPC-DS and TPC-H are integrated as complex test cases in the spark-connector; the issue provides no file or test path, so confirm entry points before coding.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
data-engineering, testing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.