default batch_size makes slow ingestion stutter
Open
discuss
- Dominant language
- Java
- Stars
- 14.9k
- Forks
- 3.5k
- Avg merge
- 19h 14m
- Merged PRs (30d)
- 63
Description
the default batch size for the next gen pipeline is 125.
When executing a slow rate pipeline in the terminal you don't see what you'd expect:
you have to set batch size to 1 to see events flowing at 0.1 seconds per event:
I wonder if we should set different defaults for the batches in certain situations. for example: if tty? is true, set to 1?
Contributor guide
Assessment
This issue has not been assessed yet.