apache/beam

View on GitHub

Apache Beam is a unified programming model for Batch and Streaming data processing.

Stars: 8.7k
Forks: 4.7k
Open beginner issues: 0
Indexed issues: 3.8k
Avg merge: 2d 5h
Merged PRs (30d): 204

Dominant language: Java
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Open All

3810 open issues indexed

Trigger example in the cookbook failed to run on Dataflow Open

bug examples good first issue java P3

apache/beam#18767 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 14, 2026
Migrate common_job_properties.groovy to use Maps for keyword argument style calls instead of positional arguments Open

good first issue improvement P3 tests

apache/beam#18768 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
BigQueryIO.writeTableRows() and withTimePartitioning() fails with CreateDisposition.CREATE_NEVER Open

bug gcp io java P3

apache/beam#18769 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Create test artifacts Open

build improvement P3 tests

apache/beam#18770 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add Go TF-IDF example Open

go improvement P3

apache/beam#18771 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] Allow casting to complex types Open

dsl improvement P3 sql

apache/beam#18772 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] Support Row construction with named fields Open

dsl improvement P3 sql

apache/beam#18773 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
PTransform input_types hint with potential empty input Open

bug core P3 python

apache/beam#18774 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support ROW_NUMBER() over Open

dsl new feature P3 sql

apache/beam#18775 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Contributor's guide needs to document expectations for tools to use with Python Open

core improvement P3 python

apache/beam#18776 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python Trigger Functions are missing PyDoc Open

core improvement P3 python

apache/beam#18777 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
BigQuery: FILE_LOADS + CREATE_NEVER + field-based partitioning => missing schema exception Open

bug gcp io java P3

apache/beam#18778 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
DirectRunner accumulation mode on side inputs not accumulation fired panes Open

bug direct P3 runners

apache/beam#18780 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python SDK lacks files_to_stage knob that JAva has Open

core improvement P3 python

apache/beam#18781 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Enable Spark runner to run IOITs Open

new feature P3 runners spark tests

apache/beam#18782 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Maximum recursion depth with Apache Beam and Google Cloud SDK Open

bug core P3 python

apache/beam#18783 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Be able to run the IT from github pull request Open

ideas io P3 tests

apache/beam#18784 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add a GHA job for CassandraIOIT Open

P3 sub-task tests

apache/beam#18785 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add a GHA job for ElasticsearchIOIT v5 Open

P3 sub-task tests

apache/beam#18786 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add a GHA job for ElasticsearchIOIT v2 Open

P3 sub-task tests

apache/beam#18787 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Incorrect coder inference for List and Tuple typehints. Open

core improvement P3 python

apache/beam#18788 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
ValueProvider with default value fails using DirectRunner Open

bug dataflow P3 runners

apache/beam#18789 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Prevent control client pool service from leaking stale client references Open

bug core P3 runners

apache/beam#18790 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add abstractions for runners to provide artifacts to ArtifactRetrievalService Open

core improvement P3 runners

apache/beam#18791 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
BigQueryIO ValueProvider support for NumFileShards and Triggering Frequency Open

gcp improvement io java P3

apache/beam#18792 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Generalize DATAFLOW_DISTRIBUTION counter if necessary Open

core P3 python task

apache/beam#18793 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Remove 'manual' teardown from SolrIO tests Open

io java P3 solr tests

apache/beam#18794 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add support for Solr 6.x/7.x Open

improvement io java P3 solr

apache/beam#18795 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
TFRecord Performance Tests doesn't work on hdfs Open

bug io java P3 tests tfrecord

apache/beam#18796 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
FileChannel instance should be closed in ArtifactServiceStager#StagingCallable#get Open

bug core P3 runners

apache/beam#18797 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
SolrIO: Expose connection timeout tuning for writes Open

improvement io java P3 solr

apache/beam#18798 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python ValidatesRunner test coverage is very poor Open

core P3 python tests

apache/beam#18799 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Create infrastructure configuration (docker/k8s) for HCatalogIOIT Open

P3 tests

apache/beam#18801 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Support SortValues GroupByKey extension Open

go improvement P3

apache/beam#18802 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Test shaded jars to ensure everything is in the package path Open

build new feature P3

apache/beam#18803 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
[SQL] Implement date types comparisons Open

dsl improvement P3 sql

apache/beam#18804 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add mobile gaming example Open

go improvement P3

apache/beam#18806 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
How to express "Job Update" in portable Beam Open

beam-model improvement P3

apache/beam#18807 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Build javadoc in precommit Open

build new feature P3

apache/beam#18808 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Aggregated javadoc (:beam-sdks-java-javadoc:aggregateJavadoc) not running in nightly snapshot release Open

bug build P3

apache/beam#18809 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Add Go SDK support for native Kafka IO on Flink Open

go improvement P3

apache/beam#18810 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Upgrade Bigquery to com.google.cloud library Open

gcp io java new feature P3

apache/beam#18811 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Set region when BigqueryIO.write using DirectRunner Open

dataflow direct good first issue new feature P3 runners

apache/beam#18812 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Consolidate Python Label Flag Handling Open

bug core dataflow P3 python runners

apache/beam#18813 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Implement AssignWindows for known WindowFns in the ReferenceRunner Open

direct new feature P3 runners

apache/beam#18814 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Join the local-java and direct-java packages Open

direct new feature P3 runners

apache/beam#18815 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Implement the native Java DirectRunner via the ReferenceRunner and an InProcessServerFactory/Channel Open

direct new feature P3 runners

apache/beam#18816 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python: Portable batch Flink runner passes all ValidatesRunner tests Open

bug core flink harness P3 python runners

apache/beam#18817 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python: FlinkPortableTestRunner: runs portably via self-started local Flink Open

core new feature P3 python tests

apache/beam#18819 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026
Python: PortableRunner: p.run() starts a given JobService docker container and runs through it Open

core new feature P3 python

apache/beam#18820 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 14, 2026

apache/beam

Get new issues in your inbox