pingcap / pingcap/tidb

global sort: test the global sort whole process in ut

Open
#48,952 0 comments 0 reactions 0 assignees View on GitHub
type/enhancement
Dominant language
Go
Stars
40.5k
Forks
6.2k
PR merge metrics
PR metrics pending

Description

## Enhancement
Currently, global sort contains 3 steps:
1. write sorted files to s3.
2. merge sort sorted files and write to s3.
3. read files by key range and sort them.

But the whole process only run in integration test in ci with only 1 tidb node.
We need a way to mimic the dist execution process in UT to make the planning process and execution process more reliable and easier to debug during developing.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.