apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 2d 5h
Merged PRs (30d): 204

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3810 open issues indexed

Local server api descriptors contain urls that work on Mac and Linux Open

core improvement P3 runners

apache/beam#18929 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Syntax Features Unsupported Open

dsl P3 sql task

apache/beam#18930 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DockerJobBundleFactory's ProvisionInfo is empty. Open

bug core P3 runners

apache/beam#18931 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Move core utilities into a new top-level module Open

bug core java P3

apache/beam#18932 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Gradle build does not allow to overwrite versions of provided dependencies Open

build gradle improvement P3

apache/beam#18933 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Pickler enters infinite recursion with self-referential classes Open

bug core P3 python

apache/beam#18934 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Suppress tracebacks on failure-catching tests Open

bug core good first issue P3 python

apache/beam#18935 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Add support for decompressing and reading tar files Open

core java new feature P3

apache/beam#18936 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Go SDK CPU Profiling Open

go improvement P3

apache/beam#18937 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Move pom generation metadata logic out of build_rules.gradle Open

build gradle improvement P3

apache/beam#18938 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Pubsub: add DirectRunner support for id_label and timestamp_attribute in Python SDK Open

bug core direct P3 python runners

apache/beam#18939 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Member classes of SdkHarnessClient should have their own files. Open

core improvement P3 runners

apache/beam#18940 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Executable stages allow side input coders to be set and/or queried Open

bug core P3 portability runners

apache/beam#18941 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
BundleBasedDirectRunner fails with recent side input changes Open

core improvement P3 python

apache/beam#18942 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Performance Tests Results Analysis and Regression Detection Open

build improvement P3

apache/beam#18943 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Go SDK-Tune in memory pre-combine caching for Lifted Combines. Open

go improvement P3

apache/beam#18944 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Run tests against shaded JAR Open

build new feature P3

apache/beam#18945 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add Python streaming wordcount snippets and test Open

core improvement P3 python

apache/beam#18946 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Disable cython profiling by default Open

core P3 python task

apache/beam#18947 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Build test infra for end-to-end streaming test in Python SDK Open

P3 task tests

apache/beam#18948 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ExecutorServiceParallelExecutorTest#ensureMetricsThreadDoesntLeak in PR #4965 does not pass in gradle Open

disabled test gradle improvement P3 tests

apache/beam#18950 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Go code should get standard URNs from proto annotations Open

go improvement P3

apache/beam#18951 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Provide a better way for programmatically handling errors raised while encoding/decoding data Open

beam-model core new feature P3 runners

apache/beam#18952 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Contributor's guide needs to document the flow of a Pull Request for new contributors Open

improvement P3 website

apache/beam#18953 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add details of using org.apache.beam.sdk.io.hdfs with different FS Open

improvement P3 website

apache/beam#18954 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Java is missing an unbounded example for wordcount series Open

bug P3 website

apache/beam#18955 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Do we want to encourage release pinning? Open

bug P3 website

apache/beam#18956 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Element type inference doesn't work for multi-output DoFns Open

bug core P3 python types

apache/beam#18957 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Kubectl version on beam executors must be upgraded to at least 1.9.3 Open

build improvement P3

apache/beam#18958 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Beam SQL should clean up resources upon termination of the pipeline Open

dsl new feature P4 sql

apache/beam#18959 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Modify run_validatescontainer.sh in Python sdk to allow validating user-provided containers. Open

bug harness P4 python

apache/beam#18960 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Document common build pattern for SDKs Open

core improvement P4 python

apache/beam#18961 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Convert gen_protos to tox task. Open

core new feature P3 python

apache/beam#18963 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Re-enable checkstyle JavadocParagraph Open

build good first issue improvement P3

apache/beam#18964 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Avro-Protobuf support Open

avro io java P3 wish

apache/beam#18965 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Java TextIO should accept an optional Encoding parameter Open

improvement io java P3 text

apache/beam#18966 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add dataflow cluster load metrics to Beam dashboard Open

build P3 tests wish

apache/beam#18967 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Fix FutureReturnValueIgnored violations in direct runner Open

bug direct P3 runners

apache/beam#18968 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
XmlIOIT fails on Spark and Flink Open

bug P3 tests

apache/beam#18969 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add README to Subprocess sample Open

examples improvement java P3

apache/beam#18970 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PreCommit filtering broken based upon PR contents Open

bug build P3

apache/beam#18972 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Thread local caching of GcsIO instances does not work Open

bug core P3 python

apache/beam#18973 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Reuse validateShadedJarDoesntLeakNonOrgApacheBeamClasses across all subprojects which perform shading Open

bug build P3

apache/beam#18974 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
TFRecordIOIT fails on Spark and Flink Open

bug P3 tests

apache/beam#18975 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Re-enable checkstyle LineLength Open

build good first issue improvement P3

apache/beam#18976 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
BigQueryIO WRITE_TRUNCATE documentation is out of date Open

core gcp improvement io java P3 python

apache/beam#18977 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Improve / Fix documentation examples for Beam 2.4.0 for TextIO and BigQueryIO Open

gcp improvement io java P3 text

apache/beam#18978 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove redundant Checkstyle rules covered by ErrorProne Open

build improvement P3

apache/beam#18979 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Parquet IO position invalid when writing integers Open

bug io java P3 parquet

apache/beam#18980 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Make HBaseIO.read() based on SDF by default Open

hbase improvement io java P3

apache/beam#18981 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox