apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 1d 20h
Merged PRs (30d): 196

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3816 open issues indexed

FileIOChannelFactory.match() traverses entire parent directory recursively Open

bug core java P3

apache/beam#18193 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Code coverage numbers are not accurate Open

bug build core good first issue java P3 tests

apache/beam#18194 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Move website job definitions to main Beam repo Open

bug P3 tests

apache/beam#18195 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PipelineOptions subclasses defined in the main session could be duplicated Open

bug core P3 python

apache/beam#18197 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Implement real synchronized processing time in Flink runner Open

flink new feature P3 runners

apache/beam#18198 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats. Open

dataflow good first issue P3 runners tests

apache/beam#18199 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support MapState in DataflowRunner Open

dataflow new feature P3 runners

apache/beam#18200 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Create a dockerized developer environment for Beam Open

examples java new feature P3

apache/beam#18201 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Source.getDefaultOutputCoder() - hard to implement for adapter style sources Open

core improvement java P3

apache/beam#18202 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Give new DoFn the ability to output to a particular window Open

beam-model core java new feature P3 python

apache/beam#18203 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Consider merging KeyedPValueTrackingVisitor with DirectGraphVisitor Open

direct good first issue improvement P3 runners

apache/beam#18205 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
io/google-cloud-platform should not depend on runners/dataflow for testing Open

core java P3 task

apache/beam#18207 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Assert over metrics sent to Graphite Open

improvement P3 runners spark

apache/beam#18208 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
java DataflowRunner should warn if the stagingLocation has a TTL Open

dataflow good first issue improvement P3 runners

apache/beam#18209 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Trigger postcommit builds on Github push notifications Open

bug P3 tests

apache/beam#18210 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Use checkstyle on everything Open

build P3 task

apache/beam#18211 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Consider a hint ParDo.withHighFanout() Open

core improvement java P3

apache/beam#18212 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Unicode chars in local file system paths break dataflow runner tests. Open

bug dataflow P3 runners

apache/beam#18213 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add streaming support to Python DirectRunner Open

core new feature P3 python

apache/beam#18214 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Serialize more coders via URN + Class name Open

bug core P4 runners

apache/beam#18216 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add test cases for large keys to GroupByKeyTest Open

bug core java P4

apache/beam#18218 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
conda python breaks the python tests Open

improvement P4 website

apache/beam#18219 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
The DirectRunner should interact more directly with SplittableDoFn Open

direct improvement P3 runners

apache/beam#18220 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Embed example/test data within jars instead of using world readable Google Cloud Storage paths Open

examples improvement java P3 tests

apache/beam#18221 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Migrate to gcloud java core for default GCP project id detection Open

gcp improvement io java P3

apache/beam#18223 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python SDK build process leaks tox dependency into user space Open

core improvement P3 python

apache/beam#18224 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Consider adding interactive notebooks as examples Open

community-onboarding core P3 python wish

apache/beam#18225 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add a Cloud Object Translator for WriteBundlesToFiles.ResultCoder Open

bug dataflow P3 runners

apache/beam#18226 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
HBaseIO metrics Open

hbase improvement io java P3

apache/beam#18228 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Consider removing the default coder from TfRecordIO Open

backward-incompatible core P3 python wish

apache/beam#18229 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Clean up import guards for GCP libraries in the python SDK Open

core improvement P3 python

apache/beam#18230 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Clean up usage of temporary files in Python SDK tests Open

bug core P3 python

apache/beam#18231 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Annotate code references inside inline documentation in Python-SDK Open

core good first issue improvement P3 python

apache/beam#18232 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Migrate DecodeAndEmitDoFn to be a SplittableDoFn Open

dataflow improvement P3 runners

apache/beam#18233 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Create an examples/java and examples/java8 uber jar that doesn't contain a runner Open

examples improvement java P3

apache/beam#18234 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Trying to use an object from another pipeline should have a more obvious error message Open

bug dataflow P3 runners

apache/beam#18235 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
mapOutputs doesn't permit one replacement PValue to be used to represent multiple original PValues Open

bug core P3 runners

apache/beam#18236 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PBegin | Write produces obscure error Open

core improvement P3 python

apache/beam#18237 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python word count with DirectRunner gets stuck during application termination on Windows Open

bug core P3 python

apache/beam#18238 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
--worker_harness_container_image should issue a warning if not used with --runner DataflowRunner Open

core improvement P3 python

apache/beam#18239 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Convert to Codahale Metric interfaces where possible in WithMetricsSupport MetricRegistry Open

improvement P3 runners spark

apache/beam#18240 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
--setup_file needs fuller-path Open

bug core P3 python

apache/beam#18241 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
SideInputHandler should garbage collect PCollectionView contents Open

apex core flink improvement P3 runners spark

apache/beam#18242 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
The DirectRunner should garbage collect PCollectionView contents Open

direct improvement P3 runners

apache/beam#18243 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Improve log configuration when using multiple logging frameworks in Pipeline Open

beam-model improvement P3

apache/beam#18244 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Allow only one runner profile active at once in examples and archetypes Open

examples java P3 sub-task

apache/beam#18245 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Documentation around logging in different runners Open

P2 sub-task website

apache/beam#18246 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Initial size estimation fails for mobile gaming examples for DataflowRunner when run in Windows Open

bug core P3 python

apache/beam#18247 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Error about mixing pipelines in nosetests Open

bug core P3 python

apache/beam#18248 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
SparkRunnerDebugger fails when provided with a spark context in pipeline options Open

bug P3 runners spark

apache/beam#18250 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox