Add RedshiftIO
Open
ideas
io
new feature
P3
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 2d 5h
- Merged PRs (30d)
- 204
Description
I would like to add a RedshiftIO Java extension to perform bulk read/write to/from AWS Redshift via the UNLOAD and COPY Redshift SQL commands. This requires S3, which is the subject of BEAM-2500.
Imported from Jira [BEAM-3032](https://issues.apache.org/jira/browse/BEAM-3032). Original Jira may contain additional context.
Reported by: jmarble.
Contributor guide
Research direction
Start by reading the imported Jira issue BEAM-3032 and the related S3 issue BEAM-2500 to recover the missing design context. Define the Java extension around AWS Redshift UNLOAD and COPY operations, with S3 support, and consider the work done when bulk reads and writes are implemented and covered by the project's relevant tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, java, sql
- Domain
- cloud, data, database
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100