S3 tile writer
Open
- Dominant language
- Scala
- Stars
- 81
- Forks
- 26
- PR merge metrics
- No merged PRs in 30d
Description
Currently implemented within `DataFrame.foreach { ... }`, but would potentially be useful as a sink, accepting some data structure that includes the target URI, bytes to write, whether to gzip, the content-type, and possibly other metadata.
See also #93
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by examining the existing S3 tile writer inside DataFrame.foreach and read the related issue #93. Define the sink interface around the target URI, bytes, gzip setting, content type, and other metadata; done requires an agreed design and an implementation that replaces or complements the current approach.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, scala, spark
- Domain
- cloud, data
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100