AbsaOSS / AbsaOSS/spark-partition-sizing
Implement `RecordSizer.fromDirectorySize` method
Open
- Dominant language
- Scala
- Stars
- 9
- Forks
- 2
- PR merge metrics
- No merged PRs in 30d
Description
## Background
To be able to get the average record size based on the data output in the provided directory.
## Feature
Implement `RecordSizer.fromDirectorySize` method
## Proposed Solution [Optional]
Read the directory size similarly as Enceladus does, then read the data to get the record count.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.