jd-opensource / jd-opensource/joyqueue

archive issue: consume log exception

Open
#322 3 comments 0 reactions 1 assignee Assigned to @minusmajun View on GitHub
Dominant language
Java
Stars
383
Forks
139
PR merge metrics
No merged PRs in 30d

Description

归档功能异常:消费归档功能里,在批量进行读取消费记录日志文件的时候,如果读取是在两个文件里进行的(比如批量1000条,500条读取完后再进行下一个文件的500条读取),操作hbase存储如果出现异常的话进行位置回退处理,此时的回退处理是对1000条整体位置的偏移量进行回退,但偏移量横跨两个文件进行读取计算的,所以会导致回退偏移量设置异常,从而影响整个消费记录日志的存储线程。

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.