agent-substrate / agent-substrate/substrate
Crashed Actors Affect Benchmarking
Open
area/benchmarking
kind/bug
- Dominant language
- Go
- Stars
- 1.8k
- Forks
- 316
- Avg merge
- 2d 43m
- Merged PRs (30d)
- 287
Description
## Expected Behavior
When an actor is crashed, a benchmark should either attempt to recover the actor or stop attempting to resume it -- otherwise a few crashed actors can flood a benchmark with errors.
## Actual Behavior
Crashed actors receive the majority of the QPS, distorting sampling
## Steps to Reproduce the Problem
1. Run a benchmark with a non-trivial number of actors
## Specifications
- Version:
- Platform:
Contributor guide
Assessment
This issue has not been assessed yet.