使用spark2.4.0-cdh6.3.2版本去将数据查出来再写入2.1.1-cdh6.3.2，jar包冲突，可有好的解决方法
Open
- Dominant language
- Java
- Stars
- 6.4k
- Forks
- 1.2k
- Avg merge
- 1d 23h
- Merged PRs (30d)
- 115
Description
使用spark2.4.0-cdh6.3.2版本去将数据查出来再写入2.1.1-cdh6.3.2，jar包冲突，可有好的解决方法
Contributor guide
Research direction
Start by reviewing the attached image and reproducing the data-read and write workflow with Spark 2.4.0-CDH6.3.2 and 2.1.1-CDH6.3.2. Document the conflicting JARs and runtime context; the issue is done when the transfer works without dependency conflicts.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- data-engineering, databases
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100