Change PubsubBoundedWriter to check total byte size
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 2d 2h
- Merged PRs (30d)
- 205
Description
The PubsubBoundedWriter [does not check](https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIO.java#L895-L897) the total byte size of outgoing messages when publishing.
AC:
* Add a check to ensure the total bytes of the outgoing messages is less than pubsub's allowed max
Imported from Jira [BEAM-3218](https://issues.apache.org/jira/browse/BEAM-3218). Original Jira may contain additional context.
Reported by: thang.
Contributor guide
Research direction
Start in sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub/PubsubIO.java around lines 895-897 and inspect PubsubBoundedWriter's outgoing-message checks. Confirm the total outgoing bytes are compared with Pub/Sub's allowed maximum, and verify the relevant Java Pub/Sub tests cover the limit.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- google-cloud, java
- Domain
- cloud
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Clearly specified
- Newbie friendliness
- 40/100