apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 2d 9h
Merged PRs (30d): 202

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3807 open issues indexed

Merge multiple input to one BeamUnionRel Open

dsl improvement P3 sql

apache/beam#19515 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
test_split_crazy_sdf broken in python presubmit. 'DataInputOperation' object has no attribute 'index' Open

failing test new feature P3

apache/beam#19516 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Spark portable runner: support Bundle Finalization Open

new feature P3 portability runners spark

apache/beam#19517 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubSubIO watermark does not advance for very low volumes Open

bug gcp io java P3

apache/beam#19518 · 0 comments · 2 reactions · 0 assignees · Indexed Sep 14, 2026
Upgrade jetty-http Open

dependencies P3 sub-task

apache/beam#19520 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
TestGCSIO.test_last_updated (gcsio_test.py) fails when the current timezone offset and the timezone offset on 2nd of Jan 1970 differ Open

bug core P3 python

apache/beam#19523 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ReadAllViaFileBasedSource does not output the timestamps of the read elements Open

bug core java P3

apache/beam#19524 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Flink runner supports Bundle Finalization Open

cross-language flink new feature P3 runners

apache/beam#19525 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Portable Flink runner support bundle finalization in Batch Open

flink P3 runners sub-task

apache/beam#19526 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
TfIdfTest should not be marked ValidatesRunner Open

bug examples java P3

apache/beam#19527 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Colab examples for element-wise transforms (Python) Open

improvement P3 website

apache/beam#19528 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Use temp_location for BQ FILE_LOADS on DirectRunner, and autocreate it in GCS if not specified by user. Open

bug core P3 python

apache/beam#19529 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Github link requires login and example link is broken Open

examples improvement P3 python

apache/beam#19530 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
RabbitMqIO uses a deprecated API Open

bug io java P3 rabbitmq

apache/beam#19531 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support custom environment types when expanding external transforms Open

beam-model bug core java P3 portability

apache/beam#19532 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remote sources provide insufficient metadata about relative sizes of splits Open

core improvement java P3

apache/beam#19533 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Run NeedsRunner test category with Spark Runner Open

P3 runners spark tests

apache/beam#19534 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ViewTest.testEmptySingletonSideInput breaks on Spark runner Open

P3 runners spark sub-task

apache/beam#19535 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
GatherAllPanesTest.multiplePanesMultipleReifiedPane breaks on Spark runner Open

P3 runners spark sub-task

apache/beam#19536 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
FileBasedSink is not creating file paths according to target filesystem Open

bug core P3 python

apache/beam#19537 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Reduce the log severity of profiling agent discovery Open

dataflow improvement P3 runners

apache/beam#19538 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Install google-cloud-storage on py worker container Open

harness improvement P3 python

apache/beam#19539 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DirectRunner GameStats fails, ValueError: PCollection of size 2 with more than one element accessed as a singleton view. First two elements encountered are "181.611538462", "9.1". [while running 'CalculateSpammyUsers/ProcessAndFilter'] Open

direct gearpump improvement P3 runners

apache/beam#19540 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
SQL Delta JOIN Open

dsl new feature P3 sql

apache/beam#19541 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Side inputs are not supported when using the state API Open

bug core dataflow direct P3 runners

apache/beam#19542 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Update CassandraIO to use the cassandra driver 4.x.x Open

cassandra improvement io java P3

apache/beam#19543 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add Python global window side input pattern Open

improvement P3 website

apache/beam#19545 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add steps to run the examples in mobile gaming walkthrough Open

improvement P3 website

apache/beam#19546 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Colab examples for aggregation transforms (Python) Open

improvement P3 website

apache/beam#19547 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Document Deployment of a Flink and Spark Clusters with Portable Beam Open

improvement P3 website

apache/beam#19549 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Example configs for Beam on Flink kubernetes operator Open

flink P2 runners sub-task

apache/beam#19550 · 0 comments · 2 reactions · 0 assignees · Indexed Sep 14, 2026
Update pydocs front page Open

bug P3 website

apache/beam#19551 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Pipeline options documentation has typos and does not show how to use user-defined the options. Open

bug P3 website

apache/beam#19552 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add Utility BiTemporalStreamJoin Open

improvement P3 sdk-ideas

apache/beam#19553 · 1 comment · 1 reaction · 0 assignees · Indexed Sep 14, 2026
User reports protobuf ClassChangeError running against 2.6.0 or above Open

bug dataflow P2 runners

apache/beam#19556 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Log message argument missing for stager's .whl extra_package warning Open

bug core P4 runners

apache/beam#19558 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add unit tests for InMemoryBagUserStateFactory Open

fn-execution java P4 tests

apache/beam#19559 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Consider documenting the intended usage of --fix in standard_coders_test or removing that codepath if no longer needed. Open

bug core P4 python

apache/beam#19560 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Multiple Instances of Beam Table During Query Planning Open

dsl improvement P3 sql

apache/beam#19562 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Cannot import InteractiveRunner as IPython.display is no longer a valid symbol. Open

bug core P3 python

apache/beam#19563 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Dynamic Writer - combining computed shards' number for late events with window's Open

bug dataflow P3 runners

apache/beam#19564 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Example of DoFn.setup() Open

examples new feature P3 python

apache/beam#19565 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
GcsFileSystem should validate directories and file names for \n chars Open

bug gcp io java P3

apache/beam#19566 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
bundle_processor log spam using python SDK on dataflow runner Open

bug core dataflow P3 python runners

apache/beam#19567 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Pycharm debugger for apache_beam/*_test.py broken Open

bug core P3 python tests

apache/beam#19568 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Tagging python transform class as experimental breaks tests Open

bug core P3 python

apache/beam#19569 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add ReadAll transform for MongoDBIO Open

improvement io java mongodb P3

apache/beam#19570 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Document dynamic destinations for avro Open

documentation improvement P3 pipeline-patterns website

apache/beam#19571 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Implementing getTableStatistics for HCatalogTable Open

dsl hcatalog io java new feature P3 sql

apache/beam#19572 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubsubIO (Java) write batch size can exceed request payload limit Open

bug gcp io java P3

apache/beam#19573 · 0 comments · 7 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox