Apache Celeborn Pattern with Spark Operator
Open
data-on-eks
enhancement
high
- Dominant language
- Shell
- Stars
- 857
- Forks
- 303
- Avg merge
- 11h 5m
- Merged PRs (30d)
- 3
Description
Apache Celeborn Pattern with Spark Operator to show remote shuffling service.
Extend this pattern to EMR on EKS as well
Contributor guide
Research direction
No files, tests, or entry points are named. Start by locating the existing Apache Celeborn and Spark Operator pattern, then inspect how deployment examples target EMR on EKS; done means working examples that demonstrate remote shuffling for both Spark Operator and EMR on EKS.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, kubernetes, spark
- Domain
- cloud, data-engineering, distributed-systems
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100