apache / apache/pulsar

Make the autoSkipNonRecoverableData can work for schema Ledger

Open
#17,221 2 comments 0 reactions 1 assignee Claimed by @poorbarcode View on GitHub
help wanted Stale
Dominant language
Java
Stars
15.3k
Forks
3.8k
Avg merge
1d 14h
Merged PRs (30d)
160

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar.

### Motivation

After we enabled autoSkipNonRecoverableData, the topic will skip the non-recoverable ledger which will lose some data, but the topic is able to load and continues to provide messaging service. This usually happens when multiple bookie replicas are corrupted, or the Ledger has been deleted This usually happens when multiple bookie copies are corrupted

But the Ledger used by the schema is not able to be skipped even if autoSkipNonRecoverableData=true

### Solution

Make the schema can skip the non-recoverable Ledger if autoSkipNonRecoverableData=true
And looks like we need to provide a new option to skip the data that the schema is lost.

### Alternatives

No

### Anything else?

No

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.