apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 2d 9h
Merged PRs (30d): 202

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3810 open issues indexed

Pipeline context manager calls wait_until_finish on streaming pipelines Open

core improvement P3 python

apache/beam#19574 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PGBKCVOperation is undocumented Open

core documentation improvement P3 python

apache/beam#19575 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Fedora 30: ImportError: libnsl.so.1 when importing apache_beam in Python 3 Open

bug core dependencies P3 python

apache/beam#19577 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Clean tests after Python 2 deprecation Open

core P3 python task

apache/beam#19578 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Stop job service when pipeline execution finishes Open

flink improvement P3 portability runners

apache/beam#19579 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Documentation for word count example is unclear about inputFile vs pom.xml Open

bug examples java P3

apache/beam#19580 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Improve health signal for StreamingDataflowWorker Open

dataflow improvement P3 runners

apache/beam#19581 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Make HBaseIO write return so it can be composed (e.g. used with Wait.on) Open

hbase improvement io java P3

apache/beam#19582 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove experimental annotation from stable transforms in Java HBaseIO connector Open

hbase improvement io java P3

apache/beam#19583 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support passing stateBackend through pipeline options in python sdks Open

flink new feature P3 runners

apache/beam#19585 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Keep python library version synced between setup.py and base_image_requirements.txt Open

core improvement P3 python

apache/beam#19587 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubsubMessageWithAttributesCoder should not produce null attributes map Open

gcp improvement io java P3

apache/beam#19588 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Separate PR template for website changes only Open

P3 website wish

apache/beam#19619 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Dataflow runner needs to identify the new format of metric names for distribution metrics Open

dataflow improvement P3 runners

apache/beam#19620 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Warn at job submit time if a step is named with a / or empty in DataflowRunner Open

dataflow improvement P3 runners

apache/beam#19621 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
error syncing pod - failed to start container artifact (python SDK) Open

bug harness P3 python

apache/beam#19622 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Unnesting with large schema causes error Open

bug dsl P3 sql

apache/beam#19623 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
TypeError: can't pickle _cffi_backend.CDataGCP objects Open

bug core dataflow P3 python runners

apache/beam#19624 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Fix gradlew to allow offline builds Open

build improvement P3

apache/beam#19625 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Standardize naming for cross-language transform URN Open

beam-model core improvement P3 portability runners

apache/beam#19626 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Rate estimation for Pub/Sub Table Open

dsl gcp io java new feature P3 sql

apache/beam#19627 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Check whether Python AvroCoder implementation is deterministic Open

avro core improvement io P3 python

apache/beam#19628 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Plugging BeamCostModel and Metadata Handlers in JDBC Path Open

dsl new feature P3 sql

apache/beam#19629 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Streaming from PubSub to Firestore doesn't work on Dataflow Open

bug dataflow gcp io P3 python runners

apache/beam#19630 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DoFn invocation has wrong argument assignment Open

bug core P3 python

apache/beam#19631 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Portable wordcount tests must verify that output was created and is correct. Open

bug flink harness P3 portability python runners spark tests

apache/beam#19633 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Create Presto I/O connector Open

ideas io new feature P3

apache/beam#19635 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
TextIO.Write silently fails in python when writing to GCS streaming. Open

gcp io new feature P3 python

apache/beam#19636 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
:beam-test-tools project fails to build locally Open

bug P3 tests

apache/beam#19638 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Clean up docker images in GCR after test on Portable Flink runner Open

improvement P3 tests

apache/beam#19639 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
SQL should support complex types for UDF and have documentation Open

dsl new feature P3 sql

apache/beam#19640 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
beam.Create([...]) does not create an properly shaped PCollection until pipeline executes Open

core improvement P3 python

apache/beam#19641 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Stack trace not useful in SQL dsl for Java Open

dsl improvement P3 sql

apache/beam#19642 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Read TFRecord Files from hdfs will meet exception if file size is large Open

bug flink io java P3 runners tfrecord

apache/beam#19644 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
WindmillStateCache grossly misunderestimates object size in its weighting function Open

bug dataflow P3 runners

apache/beam#19645 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support Fanout in Apache BEAM SQL extension Open

bug dsl P3 sql

apache/beam#19646 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Document optional kwargs argument in Partition Ptransform Open

bug core P3 python

apache/beam#19647 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Create IO tests for synthetic sources Open

P3 tests wish

apache/beam#19648 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Synthetic unbounded source looses (duplicates?) data while splitting Open

bug P3 tests

apache/beam#19649 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
CombineGlobally translation is risky and not very performant. Open

improvement P3 runners spark

apache/beam#19650 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ExecutableStage should be able to accept multiple input PCollection Open

fn-execution java new feature P3

apache/beam#19651 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Intermittent empty accumulator values in extractOutput of Combine.perKey on Dataflow Open

bug dataflow P3 runners

apache/beam#19652 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Retry createJob requests in Dataflow Runner for retriable errors. Open

dataflow improvement P3 runners

apache/beam#19653 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Event-time timers seem to sometimes fire multiple times on dataflow + streaming engine Open

bug dataflow P3 runners

apache/beam#19654 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Fix Java parquetio write transform used from Python SDK Open

bug fn-execution java P3

apache/beam#19655 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
SqlTransform#getSchema for "SELECT DISTINCT + JOIN" has invalid field names Open

bug dsl P3 sql

apache/beam#19656 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Dataflow runner - KafkaIO process stuck Open

bug dataflow P3 runners

apache/beam#19657 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
withCustomGcsTempLocation should also be implemented for BigQueryIO.Read Open

gcp improvement io java P3

apache/beam#19658 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Provide a better error message for 410 Gone errors from GCS Open

bug gcp io java P3 python

apache/beam#19659 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Refactor LoadTestBuilder.groovy Open

P3 tests wish

apache/beam#19660 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox