tektoncd / tektoncd/operator

Testing Matrix

Open
#1,826 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

area/release area/roadmap area/testing kind/feature
Dominant language
Go
Stars
608
Forks
263
Avg merge
1d 3h
Merged PRs (30d)
125

Description

The operator should be tested on a variety of Kubernetes version, from the lowest we support to the latest available.

We should nightly as well as on pull-requests (running them in parallel). Today, we only have one check which is pull-tekton-operator-integration-tests. Instead we should have several of them, one per k8s version we "support". We do not necessarily need to run the full test-suites on all version (if they are taking ages), but a selected number that should cover the basis (and most components if not all).

  • We can go the chains route and start by using GitHub workflows (and kind)
  • We can then (or initially) go the tekton+matrix routes and hook the dogfooding tekton cluster to this repository.

I would suggest we should go ahead with the GitHub workflow to work on the "tooling" to do this. Porting it to tekton then should be relatively straightforward.

cc @tektoncd/operator-maintainers

Note: e.g. tektoncd/chains is doing that on pull-request (like here)
2023-11-03-121630

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the existing pull-tekton-operator-integration-tests check and compare the GitHub workflow approach used by tektoncd/chains. Identify the lowest and latest supported Kubernetes versions and how kind can run the selected integration tests in parallel on pull requests and nightly. Done means separate version checks cover the support range without requiring the full suite for every version.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, go, kubernetes
Domain
ci-cd, devops, testing-qa
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.