apache / apache/iceberg

Replace the quick-start docker compose image with OSS spark docker image

Open
#13,519 1 comment 1 reaction 0 assignees View on GitHub
improvement not-stale
Dominant language
Java
Stars
9.2k
Forks
3.5k
Avg merge
2d 16h
Merged PRs (30d)
129

Description

### Feature Request / Improvement

mailing list discussion: https://lists.apache.org/thread/4kknk8mvnffbmhdt63z8t4ps0mt1jbf4

Further steps: Reply from @Fokko on that mailing thread
```
we should both remove the vendor reference and
bring this back up to date. My preference would be to rely on the Spark
image provided by the Apache Spark
project, similar to what we do for the Hive
quickstart. We should be able
to load all the Iceberg-specific JARs through the spark.jars.packages
configuration .
```

### Query engine

None

### Willingness to contribute

- [ ] I can contribute this improvement/feature independently
- [ ] I would be willing to contribute this improvement/feature with guidance from the Iceberg community
- [x] I cannot contribute this improvement/feature at this time

Contributor guide

Open the contributing guide

Research direction

Start by locating the quick-start Docker Compose configuration and its references in the repository, then compare it with the Apache Spark image and the Hive quickstart linked in the issue. Done means the vendor image reference is removed, Iceberg JARs use the spark.jars.packages configuration described in the issue, and the quick-start path works.

Written by the indexing model from the issue text.

Assessment

Tech stack
docker, docker-compose, spark
Domain
devops, documentation
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.