agent-substrate / agent-substrate/substrate

Crashed Actors Affect Benchmarking

Open
#1,321 1 comment 0 reactions 0 assignees View on GitHub
area/benchmarking kind/bug
Dominant language
Go
Stars
1.8k
Forks
316
Avg merge
2d 43m
Merged PRs (30d)
287

Description

## Expected Behavior
When an actor is crashed, a benchmark should either attempt to recover the actor or stop attempting to resume it -- otherwise a few crashed actors can flood a benchmark with errors.

## Actual Behavior

Crashed actors receive the majority of the QPS, distorting sampling

## Steps to Reproduce the Problem

1. Run a benchmark with a non-trivial number of actors

## Specifications

- Version:
- Platform:

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.