apache / apache/rocketmq-externals
[rocketmq spark] can rocketmq-spark support spark 3.x?
Open
- Dominant language
- Java
- Stars
- 4.6k
- Forks
- 3k
- Avg merge
- 2h 33m
- Merged PRs (30d)
- 1
Description
spark 2.x depends on old version netty, which exists many security vulnerabilities, spark 3.x depends on new version netty, but some source code in rocketmq-spark only support spark 2.x.
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue concerns rocketmq-spark source compatibility with Spark 3.x and its newer Netty dependency. Start by locating the source code that restricts support to Spark 2.x, then identify the compatibility changes required and verify the project builds and tests successfully with Spark 3.x. No specific files or tests are named in the issue.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, spark
- Domain
- stream-processing
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100