citusdata / citusdata/test-automation

Test automation -- Beyond 6.1

Open
#2 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
C
Stars
15
Forks
3
PR merge metrics
No merged PRs in 30d

Description

I'm noting some ideas for future improvements (and keep updating in the future as I think of other ideas):

* Add ability to compare the data in the placements of shards. Use case for this: run a lot of concurrent modifications and then compare the placements of shards to ensure that nothing goes wrong.
* Consider this framework as a new kind of regression suite. For instance, as a new feature tester in the release testing, use a very simple API and add your tests to this new regression test suite. This could enable running those tests repeatedly and use it in the future.
* I don't know the methodology of this yet, just noting here not to forget.
* We could very well integrate concurrency testing into this.
* We should have an easy way of killing the workers in various ways (`kill -9`, `pg_ctl stop` etc)

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points to start from. Read the existing test-automation framework before deciding whether to pursue shard-placement comparison, regression-suite integration, or worker-killing scenarios. Done would require a defined scope and methodology for one or more of these future improvements.

Written by the indexing model from the issue text.

Assessment

Tech stack
postgresql
Domain
testing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.