apache / apache/doris-spark-connector

[Enhancement] 编译包排除spark 中已经有的jar

Open
#241 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
107
Forks
126
Avg merge
3d 10h
Merged PRs (30d)
4

Description

### Search before asking

- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.

### Description

建议编译包排除spark 中已经有的jar,例如jackson,org.apache.commons等

### Solution

_No response_

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

Open the contributing guide

Research direction

Start by locating the Spark connector's build and packaging configuration, then identify how dependencies such as jackson and org.apache.commons are currently included in the compiled package. Compare that package with Spark's provided libraries and define which duplicate JARs should be excluded. Done means the package omits the agreed duplicates without breaking connector dependency resolution.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
build-system
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.