apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 1d 20h
Merged PRs (30d): 196

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3816 open issues indexed

Starter archetype pipeline has no runner on its classpath Open

bug core java P3

apache/beam#18067 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
annotations should support custom messages and classes Open

core good first issue improvement P3 python

apache/beam#18068 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Execute ReduceFnRunner Directly in Flink Runner Open

flink improvement P3 runners

apache/beam#18069 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Backoff in the DirectRunner Monitor if no work is Available Open

bug direct P3 runners

apache/beam#18070 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Service Account Based Authentication Broken Open

bug core P3 python

apache/beam#18071 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DoFn Setup and Teardown methods should have access to PipelineOptions Open

core improvement java P3

apache/beam#18072 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Support for new State API in SparkRunner Open

new feature P3 runners spark

apache/beam#18073 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support state API in Spark streaming mode. Open

P3 runners spark sub-task

apache/beam#18074 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
In WC Walkthrough: Document how logging works on Apache Flink Open

P3 task website

apache/beam#18075 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
In WC Walkthrough: Document how logging works on Apache Spark Open

P3 task website

apache/beam#18076 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Integration tests should create/destroy resources required for running Open

bug P3 tests

apache/beam#18077 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Cleanup SDK regarding lint warnings (and lint warning suppression). Open

core good first issue improvement P3 python

apache/beam#18078 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Provide a runner-internal ExecutorService for maintenance tasks Open

direct improvement P3 runners

apache/beam#18079 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove StateTag Open

core P3 runners wish

apache/beam#18080 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove getPCollection from (Un)CommittedBundle Open

bug direct good first issue P3 runners

apache/beam#18081 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Simple pattern for per-bundle and per-DoFn Closeable resources Open

improvement P3 sdk-ideas

apache/beam#18083 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add TriggerTester methods to check that timers are set Open

bug core good first issue P3 runners tests

apache/beam#18084 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add support for side inputs/outputs to Java 8 lambdas in MapElements Open

improvement P3 sdk-ideas

apache/beam#18085 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
KafkaIO should support dynamic addition of Kafka partitions to assigned topics. Open

improvement io java kafka P3

apache/beam#18086 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Consider asking Apache to register Apache Beam trademark Open

P3 project-management task

apache/beam#18087 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add CountingInput Transform to python sdk Open

core good first issue improvement P3 python

apache/beam#18088 · 10 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Crunch Runner for Beam Open

ideas P3 runners wish

apache/beam#18089 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Enable caching of side-input dependent computations Open

beam-model new feature P3

apache/beam#18090 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support for testing how soon output is emitted Open

direct improvement P3 runners tests

apache/beam#18091 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
KafkaIO does not commit offsets to Kafka Open

bug io java kafka P3

apache/beam#18092 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Consider moving control of output location out of WordCountIT and WindowedWordCountIT Open

improvement P3 tests

apache/beam#18093 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Always explicitly specify --output for ITs Open

improvement P3 tests

apache/beam#18094 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Range join in Beam Open

new feature P3 sdk-ideas

apache/beam#18095 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Support set/delete of timer by ID in Spark runner Open

new feature P3 runners spark

apache/beam#18096 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
The DirectRunner can complete before reporting the results of all ModelEnforcements Open

bug direct P3 runners

apache/beam#18097 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Enable selected ROS tests for streaming. Open

improvement P3 runners spark

apache/beam#18098 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
filesToStage should allow for common ways in which people package their resources Open

dataflow improvement P3 runners

apache/beam#18099 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DoFns should be serialized at apply time and deserialized when executing Open

core improvement P3 python

apache/beam#18100 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add element modification check to Python Beam Open

bug core P3 python

apache/beam#18101 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
When and how can merging windows "shrink" or "grow"? Open

beam-model new feature P3

apache/beam#18102 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
AvroSource should update progress within blocks Open

core improvement P3 python

apache/beam#18103 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Refine specification for WindowFn.isCompatible() Open

beam-model new feature P3

apache/beam#18104 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Extend the TestSparkRunner with its own TransformTranslator containing test evaluators Open

improvement P3 runners spark

apache/beam#18105 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
GcsUtil batch remove() and copy() need tests. Open

gcp io java P3 tests

apache/beam#18106 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Apache Pig DSL Open

P3 sdk-ideas wish

apache/beam#18107 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add JpaIO Open

ideas io new feature P3

apache/beam#18108 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Run WindowedWordCount Integration Test in Spark Streaming Open

improvement P3 tests

apache/beam#18109 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Use a provider to create JMS ConnectionFactory and avoid Serialization issues Open

improvement io java jms P3

apache/beam#18110 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Annotations are not properly rendered in JavaDoc when using <pre>{@code} Open

bug core java P4 runners

apache/beam#18111 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubsubIO should allow for a user to supply the function which computes the watermark that is reported Open

gcp improvement io java P3

apache/beam#18112 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Streaming watermark should be easier to read Open

dataflow improvement P3 runners

apache/beam#18113 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Inline AfterDelayFromFirstElementStateMachine to AfterProcessingTimeStateMachine and simplify Open

core improvement P3 runners

apache/beam#18117 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
OutputTimeFn maybe should be allowed to move elements back in time Open

bug core good first issue P3 runners

apache/beam#18119 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Allow a DoFn to opt in to mutating it's input Open

beam-model new feature P3

apache/beam#18121 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Improve UnboundedSourceShard structure Open

direct good first issue improvement P3 runners

apache/beam#18122 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox