agent-substrate / agent-substrate/substrate

Automated Benchmarking

Abierto
#176 0 comentarios 0 reacciones 1 asignado Reclamado por @maxsmythe Ver en GitHub
area/dev-infra kind/feature prio/P0
Lenguaje dominante
Go
Estrellas
1.8k
Forks
316
Merge medio
2 d 43 min
PR fusionados (30 d)
287

Descripción

In anticipation of regular benchmarking runs we should design a system for automated Benchmarking.

This includes:

* A process to orchestrate the benchmark (provision necessary cluster resources, generate load, manage results gathering, persist results)
* A format in which results will be persisted (should be flexible enough to accommodate adding/removing metrics as product understanding grows)

This system should run as a simple shell command and output the metrics results to files in order to streamline integration with most CI/CD systems.

ClusterLoader2 is a good example of the general idea of the I/O and execution model, though CL2 has a much broader scope than this proposal intends.

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.