Kickstart the C# .net SDK for Beam
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
The idea of this GSoC project is to kickstart the creation of the Beam SDK for C# (.net). The goal is to create the minimal set of pieces required to allow a user to write and execute a WordCount type of pipeline in C# with Beam.
To do this we will need to implement the minimum set of abstractions of the SDK: ParDo (Beam’s Map with super powers) **** GroupByKey, as well as a Harness capable of writing to the data channel, and some internal data representations (WindowedValue and others) to be able to run the pipeline using portable runners.
Don’t worry if the Beam specific details are not clear, just familiarity with the Big Data WordCount concepts are a prerequisite, as well as probably reading some of the Beam introductory material [1-3]. Good knowledge of C# and its idioms, as well as familiarity with the recent .net ecosystem are required for the student who wants to apply for this project.
[1] [https://beam.apache.org/](https://beam.apache.org/)
[2] [https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-101](https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-101)
[3] [https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-102](https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-102)
Imported from Jira [BEAM-9531](https://issues.apache.org/jira/browse/BEAM-9531). Original Jira may contain additional context.
Reported by: iemejia.
Subtask of issue #18876
Contributor guide
Assessment
This issue has not been assessed yet.