apache / apache/doris

[Bug] Streaming Job

Open
#67,475 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
15.9k
Forks
3.9k
Avg merge
2d 23h
Merged PRs (30d)
520

Description

### Search before asking

- [x] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.

### Version

doris 4.1.3

### What's Wrong?

doris use mysql Streaming Job , fe.warn.log repoert WARN (EditLog-Flusher|76) [BDBJEJournal.write():172] write bdb journal batch data is too large, data size 714271, the first journal id 1517333, batch size 1

### What You Expected?

How to eliminate this warning

### How to Reproduce?

_No response_

### Anything Else?

_No response_

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

Open the contributing guide

Research direction

Start by examining the fe.warn.log entry for BDBJEJournal.write():172 and the reported BDB journal batch size of 714271 during a streaming job. Reproduce the warning with Doris 4.1.3 using MySQL, then trace the journal-writing path to determine when this warning is emitted. Done means the warning is explained and an appropriate fix or documented resolution is verified.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
backend, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.