ChainSafe / ChainSafe/gossamer
panic: failed to maintain txn pool after re-org: pebble: not found
- Dominant language
- Go
- Stars
- 454
- Forks
- 144
- PR merge metrics
- No merged PRs in 30d
Description
## Describe the bug
After finalizing block `#281600` the Gossamer westend client running on staging face the following panic:
````
May 09, 2024 at 12:36 (UTC-4:00) | panic: failed to maintain txn pool after re-org: pebble: not found | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
-- | -- | -- | --
May 09, 2024 at 12:36 (UTC-4:00) | goroutine 446 [running]: | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | github.com/ChainSafe/gossamer/dot/core.(*Service).handleBlocksAsync(0xc000258d80) | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | github.com/ChainSafe/gossamer/dot/core/service.go:384 +0x1fc | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | created by github.com/ChainSafe/gossamer/dot/core.(*Service).Start in goroutine 1 | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | github.com/ChainSafe/gossamer/dot/core/service.go:109 +0x4f | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | 2024-05-09T16:36:48Z ERROR could not get state root from block 0xe15dc214e471c745399260cf921a7b02238c4ca946b093fbf5c2468d159b35d8: %!w(*withstack.withStack=&{0xc00050fcb0 0xc000013c08}) pkg=core | 3a832ef18c534d27afdd6daed3c81dea | gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) | 2024-05-09T16:36:37Z INFO 🔨 finalised block #281600 (0xd921d5e1c8226a3b2a766ac02575e8dbfdef2c21c783a35fa949088525c88bc3), round 173, set id 455 pkg=state
May 09, 2024 at 12:36 (UTC-4:00) panic: failed to maintain txn pool after re-org: pebble: not found [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) goroutine 446 [running]: [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) github.com/ChainSafe/gossamer/dot/core.(*Service).handleBlocksAsync(0xc000258d80) [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) github.com/ChainSafe/gossamer/dot/core/service.go:384 +0x1fc [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) created by github.com/ChainSafe/gossamer/dot/core.(*Service).Start in goroutine 1 [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) github.com/ChainSafe/gossamer/dot/core/service.go:109 +0x4f [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) 2024-05-09T16:36:48Z ERROR could not get state root from block 0xe15dc214e471c745399260cf921a7b02238c4ca946b093fbf5c2468d159b35d8: %!w(*withstack.withStack=&{0xc00050fcb0 0xc000013c08}) pkg=core [3a832ef18c534d27afdd6daed3c81dea](https://us-east-2.console.aws.amazon.com/ecs/v2/clusters/gossamer-stg/services/gossamer-westend-svc/tasks/3a832ef18c534d27afdd6daed3c81dea?region=us-east-2) gossamer-westend
May 09, 2024 at 12:36 (UTC-4:00) 2024-05-09T16:36:37Z INFO 🔨 finalised block #281600 (0xd921d5e1c8226a3b2a766ac02575e8dbfdef2c21c783a35fa949088525c88bc3), round 173, set id 455 pkg=state
````
The main error is:
````
2024-05-09T16:36:48Z ERROR could not get state root from block 0xe15dc214e471c745399260cf921a7b02238c4ca946b093fbf5c2468d159b35d8: %!w(*withstack.withStack=&{0xc00050fcb0 0xc000013c08}) pkg=core
````
Contributor guide
Assessment
This issue has not been assessed yet.