apache / apache/beam

Unbounded SDF wrapper causes performance regression on DirectRunner

Open
#20,662 0 comments 0 reactions 0 assignees View on GitHub
bug core direct java P3 runners
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

There is a significant performance regression when switching from UnboundedSource to Unbounded SDF wrapper. So far there are 2 IOs reported:
* Pubsub Read: https://lists.apache.org/thread.html/re6b0941a8b4951293a0327ce9b25e607cafd6e45b69783f65290edee%40%3Cdev.beam.apache.org%3E
* Kafka Read: https://the-asf.slack.com/archives/C9H0YNP3P/p1606155042346600

Imported from Jira [BEAM-11403](https://issues.apache.org/jira/browse/BEAM-11403). Original Jira may contain additional context.
Reported by: boyuanz.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.