apache / apache/beam

Update Python datastore wordcount example to take a dataset parameter

Open
#18,503 0 comments 0 reactions 0 assignees View on GitHub
core improvement P4 python
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
2d 5h
Merged PRs (30d)
204

Description

This will make the example consistent with Java and will allow running the example for cases where the (GCP) project of the input Dataset is different from the project where a job (Dataflow) is executed in.

Imported from Jira [BEAM-3131](https://issues.apache.org/jira/browse/BEAM-3131). Original Jira may contain additional context.
Reported by: chamikara.

Contributor guide

Open the contributing guide

Research direction

Locate the Python datastore wordcount example and compare its dataset handling with the corresponding Java example. Check how the input Dataset and Dataflow job projects are supplied, then verify the example can use a dataset from a different GCP project than the execution project.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering, documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.