apache / apache/cloudberry

[Cherry-pick] Cherry pick gpfdist and optimize performance

Open
#968 0 comments 0 reactions 0 assignees View on GitHub
cherry-pick
Dominant language
C
Stars
1.4k
Forks
247
Avg merge
4d 3h
Merged PRs (30d)
39

Description

### Apache Cloudberry version

_No response_

### What happened

none

### What you think should happen instead

load data by gpfdist when run TPCH or TPCDS, optimize load time.

### How to reproduce

TPCH, TPCDS

### Operating System

centos 8

### Anything else

_No response_

### Are you willing to submit PR?

- [x] Yes, I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/cloudberry/blob/main/CODE_OF_CONDUCT.md).

Contributor guide

Open the contributing guide

Research direction

No source file or test is identified. Start by reproducing the TPCH/TPCDS load scenario and tracing the existing data-loading path to determine where gpfdist should be used. Done means TPCH and TPCDS data loads use gpfdist and the load time is measurably improved.

Written by the indexing model from the issue text.

Assessment

Tech stack
c
Domain
databases, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.