apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 2d 5h
Merged PRs (30d): 204

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3810 open issues indexed

[SQL] CASE CAST(.. as DATE) ELSE NULL doesn't work Open

bug dsl P3 sql

apache/beam#19155 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Running ParDo in loop with DirectRunners raises RuntimeException Open

bug P3 tests

apache/beam#19156 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python post-commit tests overwrite nosetests.xml Open

P3 tests

apache/beam#19157 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Unable to store nil value in BigQuery go sdk Open

go improvement P3

apache/beam#19158 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
OOMs on Pub/Sub to BigQuery via FILE_LOADS Open

bug gcp io java P3

apache/beam#19159 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Reshuffle causes brittle pipelines on Spark runner Open

bug P3 runners spark

apache/beam#19160 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Beam should report the account used to attempt to submit a job to Dataflow Open

bug dataflow P3 runners

apache/beam#19161 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Allow to change the PubsubClientFactory when using PubsubIO Open

gcp improvement io java P3

apache/beam#19162 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
FR: Enable Transactional writes with DatastoreIO Open

gcp io java new feature P3

apache/beam#19164 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Using gs:// paths without first doing a "gcloud auth" gives an unhelpful error message Open

bug gcp io java P3

apache/beam#19165 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Automatically infer gcp project from environment. Open

core improvement P3 python

apache/beam#19166 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Move ptransform_fn out of experimental status Open

core improvement P3 python

apache/beam#19167 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Intuitive default behavior for sdk_location pipeline option Open

harness improvement P3 portability python

apache/beam#19168 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Dataflow migrates to using shared portability library for user timers Open

dataflow improvement P3 runners

apache/beam#19169 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Provide support for Gevent Open

harness improvement P3 python

apache/beam#19170 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Cannot deploy job to Dataflow with RuntimeValueProvider Open

bug core dataflow P3 python runners

apache/beam#19171 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Processing stuck in StreamingFn Open

bug gcp io java P3

apache/beam#19173 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
BigQuery IO Source is not Exporting to GCS as written in documentation Open

bigquery bug core gcp P3 python

apache/beam#19174 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
SQL could support equijoins on complex expressions, not just column refs Open

dsl new feature P3 sql

apache/beam#19175 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support conjunction clause when it's only equi-join Open

dsl P3 sql sub-task

apache/beam#19176 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support nested AND Open

dsl P3 sql sub-task

apache/beam#19177 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
support OR Open

dsl P3 sql sub-task

apache/beam#19178 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
col1 + col2 = value Open

dsl P3 sql sub-task

apache/beam#19179 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubsubIO Write to multiple topics Open

gcp io java new feature P3

apache/beam#19180 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Rework Docker-inside-Docker for JobServer container Open

flink improvement P3 portability runners

apache/beam#19181 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Allow modification of JSON value before writing to ElasticSearch Open

elasticsearch improvement io java P3

apache/beam#19182 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Allow Runners to configure parallelism of GrpcStateService Open

core improvement P3 runners

apache/beam#19183 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Tensor flow on Flink taking too much time to process data Open

bug flink fn-execution java P3 runners

apache/beam#19184 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DirectRunner doesn't trigger deserialization of coders. Open

bug direct P3 runners

apache/beam#19185 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Update nexmark perfkit dashboards with gearpump graphs in streaming mode. Open

improvement nexmark P3 tests

apache/beam#19187 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Update to cover bugs for a release - motivate activity within 7 days Open

build improvement P3

apache/beam#19188 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
TestDirectRunner: poll matchers for wait_until_finish_duration, then cancel the pipeline Open

bug core P3 python

apache/beam#19189 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PreCommits should support a flag to not run GCP tests Open

bug build P3

apache/beam#19190 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add more integration tests for BigQueryIO Open

core gcp io java P3 python tests

apache/beam#19192 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Vendor dependencies that are currently shaded Open

build new feature P3

apache/beam#19193 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add support for intellij to work with vendored artifacts generated as part of the Apache Beam build process Open

build P3 sub-task

apache/beam#19194 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Publish shaded source jars Open

core java P3 sub-task

apache/beam#19195 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove shadow plugin from SDK Java core Open

core java P3 sub-task

apache/beam#19196 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Vendor kryo Open

core java P3 sub-task

apache/beam#19197 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Vendor protobuf-java Open

core java P3 sub-task

apache/beam#19198 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Vendor commons Open

core java P3 sub-task

apache/beam#19199 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Update (or create new) release guide for vendored dependencies Open

build P3 sub-task

apache/beam#19200 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Update contribution guide with information about vendored dependencies Open

build P3 sub-task

apache/beam#19201 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove commons-lang3 dependency from sdks/java/core Open

build P3 sub-task

apache/beam#19202 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Artifact staging service cannot write to HDFS Open

bug fn-execution java P3

apache/beam#19203 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
BeamPython on Flink runs at scale Open

bug harness P3 python

apache/beam#19204 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
LocalFileSystem.matchNewResource fails to handle file scheme in URIs Open

bug core java P3

apache/beam#19206 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
FileSystems contract rename/delete to allow prior partial successes to make continued progress Open

core improvement java P3 python

apache/beam#19208 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DirectRunner not producing output on TextIO withWindowedWrites() and withNumShards(1) Open

bug core direct java P3 runners

apache/beam#19209 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Flink portable runner GRPC cleanup failure after user class loader was removed Open

flink improvement P3 portability runners

apache/beam#19210 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox