apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 2d 9h
Merged PRs (30d): 202

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3810 open issues indexed

Problem loading ISO-8859-1 into BigQuery using DataFlow Open

bug gcp io java P3 text

apache/beam#19723 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Encoder exception for structure contains Iterable of KV Open

bug extensions java P3 sorter

apache/beam#19724 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Portable Wordcount on Flink runner finishes but does not produce output files in DOCKER execution mode Open

bug core flink P3 portability python runners

apache/beam#19726 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Using BigQueryIO.read with DIRECT_READ causes Illegal Mutation Open

bug gcp io java P3

apache/beam#19727 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Externally configured KafkaIO / PubsubIO consumer causes coder problems Open

bug core flink java P3 runners

apache/beam#19728 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 14, 2026
Add ReadAll transform for DynamoDBIO Open

aws improvement io java P3

apache/beam#19729 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
SELECT COALESCE(...) isn't inferred as non-nullable field Open

bug dsl P3 sql

apache/beam#19730 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add ValueState in Python sdk Open

core new feature P3 python

apache/beam#19732 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add ability to query a pipeline from a gRPC JobService Open

beam-model improvement P3 portability

apache/beam#19733 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Detect unexported fields in unregistered types for better error messages Open

go improvement P3

apache/beam#19735 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python's DirectRunner emits multiple panes per window and does not discard late data Open

bug core P3 python

apache/beam#19736 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add type hints to python code Open

core new feature P3 python

apache/beam#19737 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Finish migration to standard Python typing Open

core improvement P3 python

apache/beam#19738 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Worker pool option for Java SDK container Open

harness improvement java P3

apache/beam#19739 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add Delete method to gRPC JobService Open

beam-model improvement P3 portability

apache/beam#19740 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Provide a simple LineSource built on top of SDF Open

core new feature P3 python

apache/beam#19742 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DataflowRunner writes to System.out instead of logging Open

bug dataflow P3 runners

apache/beam#19743 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Pubsub message size limit not taking size increase from base64 encoding into account Open

bug gcp io java P3

apache/beam#19744 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add Wordcount-on-Flink to Python 3.6 and 3.7 test suite Open

flink P3 runners task

apache/beam#19745 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[python] The coder returned for typehints.List should be IterableCoder Open

core improvement P3 python

apache/beam#19746 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Finalize Portable Schema Representation Open

beam-model P3 task

apache/beam#19747 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ParquetTable.buildIOReader should support column projection and filter predicate Open

dsl io java new feature P3 parquet sql

apache/beam#19748 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Optimize GroupIntoBatches for batch Dataflow pipelines Open

dataflow improvement P3 runners

apache/beam#19749 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Pipeline instances are not garbage collected Open

bug core P3 python

apache/beam#19751 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add test for Self Setting Timers close to GC TImer Open

core java P3 tests

apache/beam#19752 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Provide a way for user code to read dataflow runner stats Open

dataflow improvement P3 runners

apache/beam#19753 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add drain() to DataflowPipelineJob Open

dataflow improvement P3 runners

apache/beam#19754 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Release automation improvement Open

build improvement P3 tests

apache/beam#19755 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
build_release_candidate.sh fails if RC > 1 but there's no SVN directory on dist.apache.org Open

build P3 sub-task

apache/beam#19757 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
build_release_candidate.sh fails because of leftover RC tags in working git clone Open

build P3 sub-task

apache/beam#19758 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
cut_release_branch.sh should not push to master without verification and a PR Open

build P3 sub-task

apache/beam#19759 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Cleanup Bigquery dataset after Python Mobile Game validation Open

P3 sub-task tests

apache/beam#19760 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add missing validations to run_rc_validation.sh Open

P3 sub-task tests

apache/beam#19761 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove/Replace Sns's Writer turn type PCollectionTuple Open

aws improvement io java P3

apache/beam#19783 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubsubIO returns empty message bodies for all messages read Open

bug gcp io java P2

apache/beam#19813 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add support for remaining data types in python RowCoder Open

core cross-language new feature P2 python

apache/beam#19815 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
datetime and decimal should be logical types Open

core cross-language improvement java P2

apache/beam#19817 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Investigate possibility of system metrics usage in portable performance tests Open

P4 task tests

apache/beam#19818 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add "How to Build the Sources" section to README.md and Contribute pages Open

improvement P4 website

apache/beam#19820 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Add environment variable support to Docker environment Open

core direct fn-execution improvement java P4 runners

apache/beam#19821 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Provide separate Jenkins job instances for each triggering modes Open

improvement P3 tests

apache/beam#19822 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Gradle SDK container commands should log the name of the image built Open

harness improvement P3 python

apache/beam#19823 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
support side-inputs in trivial_inference Open

core improvement P3 python types

apache/beam#19824 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add support for user defined function with var-arg Open

dsl P3 sql task

apache/beam#19825 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Run IOITs on Flink Runner Open

new feature P3 tests

apache/beam#19826 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Replace Flink StreamingImpulseSource with generic timer-based source Open

flink improvement P3 runners

apache/beam#19827 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Files managed by beam should have associated AVPs such as content-type and content-encoding instead of merely mimeType Open

improvement io java P3 text

apache/beam#19828 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubSubIO.readAvros should produce a schema'd PCollection if clazz has a schema Open

gcp improvement io java P3

apache/beam#19829 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PubSubBigQueryIT.test_file_loads fails on Dataflow Runner Open

gcp good first issue io P3 python tests

apache/beam#19830 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Artifact retrieval failure logs at info level Open

flink improvement P3 portability runners

apache/beam#19831 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox