apache / apache/pinot

Support Kafka and Spark plugins with Scala 2.12

Open
#6,199 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

Current kafka and spark plugins are using Scala 2.11, which will have conflict if other users want to build their own plugins using Scala 2.12, so we should try to publish both libs and allow users to pick which libs to be included during startup.

Contributor guide

Open the contributing guide

Research direction

The issue names no files or tests; first locate the Kafka and Spark plugin build definitions and their startup loading entry points. Check how Scala 2.11 artifacts are published and selected, then verify that users can choose compatible Scala 2.11 or 2.12 libraries without conflicts.

Written by the indexing model from the issue text.

Assessment

Tech stack
kafka, scala, spark
Domain
build-system, stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.