apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 2d 2h
Merged PRs (30d): 205

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3811 open issues indexed

All runners should support ProfilingOptions Open

core good first issue improvement P3 python

apache/beam#18011 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support Display Data on Composite Transforms Open

dataflow improvement P3 runners

apache/beam#18012 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Check immutability violations in DirectPipelineRunner Open

core good first issue new feature P3 python

apache/beam#18013 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Non-transient non-serializable instance field in WatermarkHold Open

bug core good first issue java P3

apache/beam#18014 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
QuantileStateCoder should be a StandardCoder Open

backward-incompatible bug core java P3

apache/beam#18015 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Print Properties on validation failures in PipelineOptionsValidator Open

core improvement java P3

apache/beam#18016 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
StateTags$CombiningValueStateTag inherits equals from super class but without incorporating its state Open

bug core good first issue java P3

apache/beam#18017 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Tests which evaluate DisplayData but don't run a pipeline should be marked @NeedsRunner not @RunnableOnService Open

bug core java P3

apache/beam#18018 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ReduceFnRunner should GC based on current WM, not on a fired Timer Open

bug core java P3

apache/beam#18019 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
HolderCoder should be a StandardCoder and not a CustomCoder Open

backward-incompatible bug core java P3

apache/beam#18020 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
CombineFns with no inputs should produce no outputs when used as a main input Open

bug core java P3

apache/beam#18021 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Spark runner should provide a default BoM Open

improvement P3 runners spark

apache/beam#18022 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Batch Pub/Sub sink does not set idLabel Open

bug gcp good first issue io java P3

apache/beam#18023 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Create UDP/TCP SocketIO Open

ideas io new feature P3

apache/beam#18024 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
All E2E Tests Run Against All Runners In Postcommit Open

improvement P3 tests

apache/beam#18025 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add DistributedLog IO Open

ideas io new feature P3

apache/beam#18026 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support other message than TextMessage in JmsIO Open

improvement io java jms P3

apache/beam#18030 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Examples demonstrate code, but not project configuration Open

examples improvement java P3

apache/beam#18031 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Swap to using CoGBK as grouping primitive instead of GBK Open

backward-incompatible beam-model improvement P3 portability

apache/beam#18032 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Modify offset range tracker to use first response as start offset Open

core good first issue improvement P3 python

apache/beam#18033 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Execute some bounded source reads via composite transform Open

core improvement P3 runners

apache/beam#18034 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support Verifiers in TestFlinkRunner Open

flink improvement P3 runners

apache/beam#18035 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add BSP runner Open

ideas new feature P3 runners

apache/beam#18036 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Log RPC requests when they fails to improve error messages Open

gcp improvement io java P3

apache/beam#18037 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Aggregator Verifier and Integrate to E2E Test Framework Open

P3 task tests

apache/beam#18039 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove the notion of a Fake subscription from PubsubIO Open

backward-incompatible gcp improvement io java P3

apache/beam#18041 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Pickling error when pickling a nested function Open

bug core P3 python

apache/beam#18042 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Merge, Split, Delay, and Reorder bundles in the DirectRunner Open

direct improvement P3 runners

apache/beam#18043 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Streaming BigQueryIO should support user-provided IDs Open

gcp improvement io java P3

apache/beam#18044 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Trigger AST should use @AutoValue Open

core good first issue improvement java P4

apache/beam#18045 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Replace Xyz.INSTANCE throughout the SDK with either static methods or XyzFactory.default() Open

core improvement java P4

apache/beam#18046 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Data locality for DoFns Open

improvement P3 runners spark

apache/beam#18047 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ParDo should validate window merging against StateSpec being auto-combinable Open

bug core java P3

apache/beam#18048 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Update Read PTransform to implicitly use maxNumRecords and maxReadTime Open

core improvement java P3

apache/beam#18049 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Make BZIP compressed files splittable Open

core java P3 python wish

apache/beam#18050 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Figure out TestPipeline.create(PipelineOptions) / TestPipeline.fromOptions(PipelineOptions) story Open

core improvement java P3 tests

apache/beam#18051 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
@DefaultCoder(MyCoder.class) should work if MyCoder has .of() Open

core java new feature P3

apache/beam#18052 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PTranform name uniqueness javadoc Open

bug core java P3

apache/beam#18053 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Per-step, per-execution nonce Open

core improvement java P3

apache/beam#18054 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Test pipeline that uses side input from prior window Open

core java P3 tests

apache/beam#18055 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Redesign PipelineResult API Open

core improvement java P3

apache/beam#18056 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
KeyedWorkItemCoder claims three coder arguments in getCoderArguments but only has two generic type variables Open

bug core java P3

apache/beam#18057 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Values transform does not use the correct output coder when values is an Iterable<T> Open

bug core java P3

apache/beam#18058 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
StateNamespaces.window() potentially unstable / stable encodings for windows Open

core improvement java P3

apache/beam#18059 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Clean build fails on Windows in Starter archetype Open

bug core java P3 windows

apache/beam#18061 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Validation needs to exist that ValidatesRunner tests execute Open

core dataflow direct flink gearpump improvement java P3 runners spark

apache/beam#18062 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Javadoc should clearly separate facts from runner requirements Open

bug core java P3

apache/beam#18063 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Standardize naming of PipelineResult objects Open

core good first issue improvement java P3 python

apache/beam#18064 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Primitive to shift the watermark while assigning timestamps Open

beam-model new feature P3

apache/beam#18065 · 0 comments · 4 reactions · 0 assignees · Indexed Sep 14, 2026
Add support for local execution to DatastoreIO using the google cloud emulator Open

gcp io java new feature P3

apache/beam#18066 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox