apache / apache/beam

Can't use side inputs with Combine.PerKeyWithHotKeyFanout

Open
#20,637 3 comments 0 reactions 1 assignee Claimed by @marc7806 View on GitHub
bug core good first issue java P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

PerKeyWithHotKeyFanout doesn't allow a user to specify a side input and access it in the CombineFn. When the function `withHotKeyFanout` is called, any sideinputs stored in the Combine.PerKey are dropped. ([https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Combine.java#L1571](https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Combine.java#L1571)): 
```

public PerKeyWithHotKeyFanout withHotKeyFanout(
SerializableFunction hotKeyFanout) {
return new PerKeyWithHotKeyFanout<>(fn, fnDisplayData, hotKeyFanout);

}

```

We would like to be able to use side inputs and hot key fanout.

Imported from Jira [BEAM-11005](https://issues.apache.org/jira/browse/BEAM-11005). Original Jira may contain additional context.
Reported by: miagilepner.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.