apache / apache/bookkeeper

Status of some ledgers have remained IN_RECOVERY for long

Open
#1,200 2 comments 0 reactions 0 assignees View on GitHub
area/autorecovery triage/week-33
Dominant language
Java
Stars
2k
Forks
976
Avg merge
6d 15h
Merged PRs (30d)
7

Description

**BUG REPORT**

#### What did you do?

We are using BookKeeper with [Pulsar](https://github.com/apache/incubator-pulsar).
Recently, the status of some ledgers have remained `IN_RECOVERY` for long in our cluster.

We tried to recover the ledgers by executing `readleger` command with `--force-recovery` option.
However, an exception occurred and the recovery failed.
https://gist.github.com/massakam/2136f3843259ec80af2d5f1312090854

During this time, the CPU usage of the Bookie server was very high.

#### What did you expect to see?

We expect that `IN_RECOVERY` ledgers change to `CLOSED` immediately and automatically.

#### What did you see instead?

The status of the ledgers does not change from `IN_RECOVERY`.

System configuration
BookKeeper version: 4.3.1.83-yahoo
Number of Bookies: 10
Ensemble size: 2
Write quorum size: 2
Ack quorum size: 2

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.