holdenk / holdenk/spark-testing-base
Returning nulls for nullable types
Open
Nobody has claimed this yet.
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 357
- PR merge metrics
- No merged PRs in 30d
Description
I noticed that DataFrameGenerator always returns a non-null value, even for columns which are nullable.
Is this the desired behavior?
If not, I would write a PR to change this 😃
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with core/src/main/1.3/scala/com/holdenkarau/spark/testing/DataframeGenerator.scala around lines 111-138, as linked in the issue. Check how nullable columns are handled and whether related generator behavior or tests define the expected result. Done means the project has a decided and verified behavior for nullable columns, including coverage for the chosen result.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala
- Domain
- data, testing
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100