generic api support for Graph Computation like GraphX on Spark
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 205
Description
Is there any plan to add support for graph computation like GraphX on Spark?
* graph representation in PCollection
* basic statistics like vertex/edge count
* base function like vertex/edge-wise mapreduce task(i.e., count the outgoing degree of a vertex)
* base function like subgraph combine/join
* ......
Imported from Jira [BEAM-3096](https://issues.apache.org/jira/browse/BEAM-3096). Original Jira may contain additional context.
Reported by: rayeaster.
Contributor guide
Research direction
The issue names no Beam files, tests, or entry points. Start by reviewing the existing PCollection model and the GraphX-on-Spark approach referenced here, then establish scope for graph representation, vertex and edge statistics, vertex/edge-wise mapreduce, and subgraph combine or join. Completion criteria require maintainer agreement.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- spark
- Domain
- data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100