citusdata / citusdata/test-automation

Improve data loading for pgbench tests

Open
#122 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C
Stars
15
Forks
3
PR merge metrics
No merged PRs in 30d

Description

We currently do the following:

- Create a local table & indexes
- Load data
- create distributed table

The third step is slow because we're actually loading the data on the shards again, with indexes already created. This is especially becoming slow if the data size relatively high.

Instead, we can use the functions [here](https://gist.github.com/onderkalaci/89d83fc14b1c8bfc378a9bab9d7d2be5), which skips (a) loading the data on the local table (b) creating the indexes after the data load on the distributed tables

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.