apache / apache/uniffle

[Improvement] Fine-grained shuffle manager fallback at the shuffle level

Open
#142 8 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
454
Forks
172
Avg merge
5d 17h
Merged PRs (30d)
5

Description

### Motivation
Now uniffle's delegation shuffle manager support fallback to sort shuffle manager in app level. We could implement it in shuffle level.

Contributor guide

Open the contributing guide

Research direction

Locate the delegation shuffle manager and sort shuffle manager implementations, then trace how the existing app-level fallback is selected. Define how that fallback should instead be selected independently at the shuffle level, and verify that different shuffles can use the appropriate manager without changing unrelated behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.