apache / apache/beam

Pattern : Limiting the calls to an external service within a DoFn

Open
#20,128 0 comments 0 reactions 0 assignees View on GitHub
new feature P3 pipeline-patterns website
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Pattern : Limiting the calls to an external service within a DoFn

It is easy to overwhelm external services when making calls from a DoFn. Show techniques for mitigation.

Imported from Jira [BEAM-10130](https://issues.apache.org/jira/browse/BEAM-10130). Original Jira may contain additional context.
Reported by: rarokni@gmail.com.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.