AbsaOSS / AbsaOSS/spark-commons

Separate the spark-commons module for Spark independence

Open
#49 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
7
Forks
0
Avg merge
19h 57m
Merged PRs (30d)
1

Description

## Background
Any library using `spark-commons` ver, 0.3 (or eventually higher), will need to decide if to work on Spark 2 or Spark 3. And that's despite majority of the code is independent of the Spark version used.

## Feature
Separate `spark-commons` to `spark-commons-core`, and `spark-commons` for version 2 and version 3. Where core is code that is Spark version ambiguous.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.