apache / apache/uniffle

[Improvement] Ability to create uniffle client docker images

Open
#981 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
454
Forks
172
Avg merge
5d 17h
Merged PRs (30d)
5

Description

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

### Search before asking

- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.

### What would you like to be improved?

Currently we only create a rss-server docker images (used when running coordinators and shuffle servers). It would be good if we also had the option to build/create a relevant client docker image.

I personally am only interested in creating an image for the spark3 client, however, can image this will be useful for other clients? A flag to enable the build of specific images should be suffice and initial support may only target popular clients?

### How should we improve?

Support client images in `deploy/kubernetes/docker/build.sh`

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

Start with deploy/kubernetes/docker/build.sh and inspect how the existing RSS-server image is built and selected. Determine the scope of Spark 3 client image support and the requested per-client build option; done means the client image can be built while existing image builds continue to work.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, java, kubernetes, spark
Domain
build-system, devops, infrastructure
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.