apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 2d 5h
Merged PRs (30d): 204

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3810 open issues indexed

Support BigQuery DML in BigQueryIO.Write Open

gcp io java new feature P3

apache/beam#18528 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Construct iterators directly if possible to allow spilling to disk Open

improvement P3 runners spark

apache/beam#18529 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Direct runner could display the watermark for debugging Open

direct improvement P3 runners

apache/beam#18530 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
BigQueryIO withFailedInsertRetryPolicy is endlessly retrying "invalid" rows Open

bug gcp io java P3

apache/beam#18531 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
KafkaIO.read fails job upon broker death Open

bug io java kafka P3

apache/beam#18532 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add OrientDbIO Open

ideas io new feature P3

apache/beam#18534 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Gremlin IO Open

ideas io P3 wish

apache/beam#18537 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Spec out what mutations are allowed to a constructed model pipeline, particularly coders Open

beam-model improvement P3 portability

apache/beam#18538 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Build blocks on parsing long as int from github status json Open

bug build P3

apache/beam#18539 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Templates shouldn't have region option populated Open

bug core gcp io java P3 python

apache/beam#18541 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Consider not pinning all python dependencies, or moving them to requirements.txt Open

build P3 wish

apache/beam#18542 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
generic api support for Graph Computation like GraphX on Spark Open

new feature P3 sdk-ideas wish

apache/beam#18543 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support for window analytic functions Open

dsl new feature P3 sql

apache/beam#18544 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add support for windowed filenames in Python SDK Open

core improvement P3 python

apache/beam#18545 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Transform rehydrator registration should be idempotent Open

bug core P3 runners

apache/beam#18546 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Enable the ability to grow partition count in the underlying Spark RDD Open

improvement P3 runners spark

apache/beam#18550 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubSubIO: make Write.withWriteFn and Read.withCoderAndParseFn public Open

gcp io java P3 wish

apache/beam#18551 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
can't read/write hdfs in Flink CLUSTER(Standalone) Open

bug flink P3 runners

apache/beam#18553 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Nexmark: create a query that illustrates a simple custom window merge Open

improvement nexmark P3 tests

apache/beam#18554 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Nexmark: migrate WinningBids to state API in place of custom window merge. Open

improvement nexmark P3 tests

apache/beam#18555 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubsubIO.fromSubscription(ValueProvider) throws RuntimeException Open

bug gcp io java P3

apache/beam#18556 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Nexmark: enhance unit tests of queries Open

nexmark P3 tests

apache/beam#18557 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Nexmark: Fix query9 window merging Open

bug nexmark P3 tests

apache/beam#18558 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Update Beam capability matrix using Nexmark Open

nexmark P3 task tests

apache/beam#18559 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Be able to specify the Spark Partitioner via the pipeline options Open

new feature P3 runners spark

apache/beam#18561 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Update BigQueryIO to support schema auto detection when executing load jobs Open

gcp improvement io java P3

apache/beam#18562 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Update Documentation of BigQuery source/sink to include the exact format of data read/written Open

core improvement P3 python

apache/beam#18564 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Retry downloading required test artifacts with a backoff when download fails. Open

failing test improvement P3 tests

apache/beam#18565 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
BagState.isEmpty needs a tighter spec Open

beam-model bug P3

apache/beam#18567 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Logs from python custom commands are not visible at installation time Open

bug core P3 python

apache/beam#18568 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Map and Multimap views should use structural value for equality comparisons instead of Java equality Open

bug core java P3 portability runners

apache/beam#18569 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Factor execution time and construction time dependencies into a non-SDK component Open

core java new feature P3 runners

apache/beam#18572 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
TextIO.withoutSharding sets shard template name to empty string instead of null Open

bug core java P3

apache/beam#18573 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
AfterProcessingTime trigger doesn't create any file panes Open

bug core java P3

apache/beam#18574 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
WriteFiles windowed writes don't work with session windows Open

bug core java P3

apache/beam#18575 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Improve cleanup of zombie temporary files in WriteFiles Open

bug core java P3

apache/beam#18577 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Provide a withReadableByteChannelFactory on TextIO.Read Open

core improvement java P3

apache/beam#18578 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Proto generation installation is broken for Windows Open

bug core P3 python windows

apache/beam#18579 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Release process for container images Open

beam-model improvement P3 portability

apache/beam#18580 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add the ability run a pipeline via Runner.run(transform) Open

core improvement java P3 python

apache/beam#18581 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Results of ReadableState.read() should be snapshots of the underlying state Open

bug core java P3

apache/beam#18582 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Fn API combiner support w/ lifting to PGBK Open

beam-model improvement P3 portability

apache/beam#18583 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support portable combiner lifting in Java Flink Runner Open

flink P3 runners sub-task

apache/beam#18584 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Pipeline proto seems to be incorrect for Combine.GroupedValues Open

core dataflow java P3 portability runners sub-task

apache/beam#18585 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support portable combiner lifting in Java Spark Runner Open

P3 portability runners spark sub-task

apache/beam#18586 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Fn Execution APIs should not depend on the Java SDK Open

bug core P3 runners

apache/beam#18587 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Change PubsubBoundedWriter to check total byte size Open

bug gcp io java P3

apache/beam#18588 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Gradle configurations do not declare correct inputs/outputs, requiring --rerun-tasks Open

build gradle improvement P3

apache/beam#18589 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Stop depending on Test JARs Open

bug core gcp harness io java P3 runners

apache/beam#18593 · 4 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Push metrics to a backend in an runner agnostic way Open

core java new feature P3 runner-extensions-metrics

apache/beam#18594 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox