apache / apache/rocketmq-externals

[rocketmq spark] can rocketmq-spark support spark 3.x?

Open
#860 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Java
Stars
4.6k
Forks
3k
Avg merge
2h 33m
Merged PRs (30d)
1

Description

spark 2.x depends on old version netty, which exists many security vulnerabilities, spark 3.x depends on new version netty, but some source code in rocketmq-spark only support spark 2.x.

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue concerns rocketmq-spark source compatibility with Spark 3.x and its newer Netty dependency. Start by locating the source code that restricts support to Spark 2.x, then identify the compatibility changes required and verify the project builds and tests successfully with Spark 3.x. No specific files or tests are named in the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.