ChainSafe / ChainSafe/gossamer

panic: failed to maintain txn pool after re-org: pebble: not found

Open
#3,944 0 comments 0 reactions 1 assignee Claimed by @EclesioMeloJunior View on GitHub
C-complex P-low S-sync-westend
Dominant language
Go
Stars
454
Forks
144
PR merge metrics
No merged PRs in 30d

Description

## Describe the bug

After finalizing block `#281600` the Gossamer westend client running on staging face the following panic:

````
May 09, 2024 at 12:36 (UTC-4:00) | panic: failed to maintain txn pool after re-org: pebble: not found | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
-- | -- | -- | --
May 09, 2024 at 12:36 (UTC-4:00) | goroutine 446 [running]: | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | github.com/ChainSafe/gossamer/dot/core.(*Service).handleBlocksAsync(0xc000258d80) | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | github.com/ChainSafe/gossamer/dot/core/service.go:384 +0x1fc | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | created by github.com/ChainSafe/gossamer/dot/core.(*Service).Start in goroutine 1 | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | github.com/ChainSafe/gossamer/dot/core/service.go:109 +0x4f | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | 2024-05-09T16:36:48Z ERROR could not get state root from block 0xe15dc214e471c745399260cf921a7b02238c4ca946b093fbf5c2468d159b35d8: %!w(*withstack.withStack=&{0xc00050fcb0 0xc000013c08}) pkg=core | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | 2024-05-09T16:36:37Z INFO 🔨 finalised block #281600 (0xd921d5e1c8226a3b2a766ac02575e8dbfdef2c21c783a35fa949088525c88bc3), round 173, set id 455 pkg=state

May 09, 2024 at 12:36 (UTC-4:00) panic: failed to maintain txn pool after re-org: pebble: not found [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) goroutine 446 [running]: [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) github.com/ChainSafe/gossamer/dot/core.(*Service).handleBlocksAsync(0xc000258d80) [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) github.com/ChainSafe/gossamer/dot/core/service.go:384 +0x1fc [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) created by github.com/ChainSafe/gossamer/dot/core.(*Service).Start in goroutine 1 [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) github.com/ChainSafe/gossamer/dot/core/service.go:109 +0x4f [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) 2024-05-09T16:36:48Z ERROR could not get state root from block 0xe15dc214e471c745399260cf921a7b02238c4ca946b093fbf5c2468d159b35d8: %!w(*withstack.withStack=&{0xc00050fcb0 0xc000013c08}) pkg=core [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) 2024-05-09T16:36:37Z INFO 🔨 finalised block #281600 (0xd921d5e1c8226a3b2a766ac02575e8dbfdef2c21c783a35fa949088525c88bc3), round 173, set id 455 pkg=state
````

The main error is:
````
2024-05-09T16:36:48Z ERROR could not get state root from block 0xe15dc214e471c745399260cf921a7b02238c4ca946b093fbf5c2468d159b35d8: %!w(*withstack.withStack=&{0xc00050fcb0 0xc000013c08}) pkg=core
````

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.