pingcap / pingcap/tidb-binlog

Make integration tests faster (eg. finished in less than 3 minutes)

Open
#582 2 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

status/help-wanted type/test
Dominant language
Go
Stars
291
Forks
131
Avg merge
5m
Merged PRs (30d)
2

Description

The task of running integration tests is the bottleneck of the build pipeline.
We may try to make it faster by:

  1. Reducing the number of SQLs tested, may be some of the tests should belong to chaos testing instead of integration testing;
  2. Split the task into multiple ones and run them in parallel

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by locating the integration-test task, the SQL tests it runs, and the build-pipeline configuration. Compare the current runtime with the proposed test reduction or parallel execution approaches; done means integration tests complete in less than three minutes without losing required coverage.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, sql
Domain
ci-cd, performance, testing-qa
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.