apache / apache/beam

GroupIntoBatches transform for Go SDK

Open
#19,868 0 comments 1 reaction 0 assignees View on GitHub
go new feature P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Add a PTransform that batches inputs to a desired batch size. Batches will contain only elements of a single key.

It should offer the same API as its Java counterpart:

[https://github.com/apache/beam/blob/11a977b8b26eff2274d706541127c19dc93131a2/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/GroupIntoBatches.java](https://github.com/apache/beam/blob/11a977b8b26eff2274d706541127c19dc93131a2/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/GroupIntoBatches.java)

 

And Python counterpart:

https://github.com/apache/beam/blob/c445fdfdfab4a191aa780210564199f2873f85d8/sdks/python/apache_beam/transforms/util.py#L684

Imported from Jira [BEAM-8272](https://issues.apache.org/jira/browse/BEAM-8272). Original Jira may contain additional context.
Reported by: johnpatoch69.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.