Kong / Kong/kongctl

[benchmark-regression] Declarative benchmark regressions

Open
#974 2 comments 0 reactions 0 assignees View on GitHub
benchmark-regression
Dominant language
Go
Stars
17
Forks
24
Avg merge
8h 13m
Merged PRs (30d)
196

Description

# Declarative Benchmark Regression Report

- Run: [`26147784648`](https://github.com/Kong/kongctl/actions/runs/26147784648)
- Git commit: `95a6b20`
- Suite duration: `3m18.667s`
- HTTP requests: `516`
- HTTP errors: `0`
- History samples required: `3`

Regressions detected in the latest benchmark run.

| Case | Phase | Signals | Request Δ | Duration Δ | Current errors | Failed phases |
| --- | --- | --- | ---: | ---: | ---: | ---: |
| `small-multi-file` | `apply_create` | requests | +1 (+16.7%) | +57 (+11.2%) | 0 | 0 |
| `small-multi-file` | `apply_noop` | requests | +1 (+25.0%) | +44 (+14.6%) | 0 | 0 |
| `small-single-file` | `apply_create` | requests | +1 (+16.7%) | -18 (-2.9%) | 0 | 0 |
| `small-single-file` | `apply_noop` | requests | +1 (+25.0%) | +87 (+27.0%) | 0 | 0 |

Inspect workflow artifacts for raw `kongctl` logs, generated fixtures, and per-command HTTP metrics.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with workflow run 26147784648 and inspect its artifacts, including raw kongctl logs, generated fixtures, and per-command HTTP metrics. Compare the regressions against the history samples and commit 95a6b20 to identify the source of the extra requests and duration. Done means the regressions are explained and a follow-up benchmark confirms they no longer occur.

Written by the indexing model from the issue text.

Assessment

Tech stack
github-actions, go
Domain
cli, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.