hiero-ledger / hiero-ledger/hiero-consensus-node

Hedera State Validator stability issues

Open
#24,766 1 comment 0 reactions 2 assignees Claimed by @thenswan View on GitHub
Hedera State Operator P1 Stability
Dominant language
Java
Stars
406
Forks
226
Avg merge
3d 4h
Merged PRs (30d)
210

Description

State validation has been very unstable recently. Lots of failures, most are because of infrastructure or other issues, but they result in Rootly alerts anyway and must be fixed. The goal is to catch all real problem and filter out all false positives.

A few examples and comments:

* Request to https://status.hedera.com/api/v2/summary.json failed. Max attempts (5) exceeded

There should be more retries / longer waits between retries. Also, need to check with RE why github runners may have connection issues.

* Errors during initial setup for Previewnet Node N. Please check the job for details

The failing script is `.github/scripts/hedera-network-status.sh Previewnet "false"`, so it may be related to the previous one.

* Entity ID counter mismatch, e.g. EVM hook storage counts or token rel counts. There is a ticket about it filed some time ago, but the problem has become more visible since then: https://github.com/hiero-ledger/hiero-consensus-node/issues/24291

* Diff test failed for node N (round XYZ)

This seems to be a problem with downloading block streams, but I may be wrong. A workaround has been applied for this issue, but the underlying problem should still be identified and resolved.

* Migration test failed for node N (round XYZ)

Java version mismatch?

```
Error: LinkageError occurred while loading main class com.hedera.statevalidation.StateOperatorCommand
java.lang.UnsupportedClassVersionError: com/hedera/statevalidation/StateOperatorCommand has been compiled by a more recent version of the Java Runtime (class file version 69.0), this version of the Java Runtime only recognizes class file versions up to 65.0
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.