agent-substrate / agent-substrate/substrate

Automated Benchmarking

未關閉
#176 0 則留言 0 個 reaction 已指派 1 人 已被 @maxsmythe 認領 在 GitHub 檢視
area/dev-infra kind/feature prio/P0
主要語言
Go
星號
1.8k
分支
316
平均合併
2 天 43 分鐘
30 天內合併 PR
287

描述

In anticipation of regular benchmarking runs we should design a system for automated Benchmarking.

This includes:

* A process to orchestrate the benchmark (provision necessary cluster resources, generate load, manage results gathering, persist results)
* A format in which results will be persisted (should be flexible enough to accommodate adding/removing metrics as product understanding grows)

This system should run as a simple shell command and output the metrics results to files in order to streamline integration with most CI/CD systems.

ClusterLoader2 is a good example of the general idea of the I/O and execution model, though CL2 has a much broader scope than this proposal intends.

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。