holdenk / holdenk/spark-testing-base

Need Junit 5 Support

Open
#340 4 comments 4 reactions 0 assignees View on GitHub
Dominant language
Scala
Stars
1.6k
Forks
357
PR merge metrics
No merged PRs in 30d

Description

I was trying to use spark-testing-base with Junit 5 but even after extending SharedJavaSparkContext I was getting jsc() as null. On a quick look I found that SharedJavaSparkContext is expecting junit 4(org.junit.Test).So in my method with junit5 @Test(org.junit.jupiter.api.Test) jsc() was coming as null. If I move to junit4 everything works fine.As we are moving to junit5 I believe this is a must have change in the lib.

Contributor guide

Open the contributing guide

Research direction

Start by reading the SharedJavaSparkContext entry point and tracing how jsc() is initialized from JUnit 4 annotations. Compare that behavior with JUnit 5 annotations and identify the tests covering the shared Spark context. Done means a JUnit 5 test extending SharedJavaSparkContext receives a non-null jsc() while existing JUnit 4 behavior continues to work.

Written by the indexing model from the issue text.

Assessment

Tech stack
scala
Domain
testing-qa
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.