agent-substrate / agent-substrate/substrate

Automated Benchmarking

Offen
#176 0 Kommentare 0 Reaktionen 1 zugewiesene Person Beansprucht von @maxsmythe Auf GitHub ansehen
area/dev-infra kind/feature prio/P0
Vorherrschende Sprache
Go
Sterne
1.8k
Forks
316
Ø Merge
2 T. 43 Min.
Gemergte PRs (30 T.)
287

Beschreibung

In anticipation of regular benchmarking runs we should design a system for automated Benchmarking.

This includes:

* A process to orchestrate the benchmark (provision necessary cluster resources, generate load, manage results gathering, persist results)
* A format in which results will be persisted (should be flexible enough to accommodate adding/removing metrics as product understanding grows)

This system should run as a simple shell command and output the metrics results to files in order to streamline integration with most CI/CD systems.

ClusterLoader2 is a good example of the general idea of the I/O and execution model, though CL2 has a much broader scope than this proposal intends.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.