[Bug] Streaming Job
- Dominant language
- Java
- Stars
- 15.9k
- Forks
- 3.9k
- Avg merge
- 2d 23h
- Merged PRs (30d)
- 520
Description
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no similar issues.
### Version
doris 4.1.3
### What's Wrong?
doris use mysql Streaming Job , fe.warn.log repoert WARN (EditLog-Flusher|76) [BDBJEJournal.write():172] write bdb journal batch data is too large, data size 714271, the first journal id 1517333, batch size 1
### What You Expected?
How to eliminate this warning
### How to Reproduce?
_No response_
### Anything Else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
Contributor guide
Research direction
Start by examining the fe.warn.log entry for BDBJEJournal.write():172 and the reported BDB journal batch size of 714271 during a streaming job. Reproduce the warning with Doris 4.1.3 using MySQL, then trace the journal-writing path to determine when this warning is emitted. Done means the warning is explained and an appropriate fix or documented resolution is verified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, mysql
- Domain
- backend, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100