apache / apache/beam

Make HBaseIO.read() based on SDF by default

Open
#18,981 0 comments 0 reactions 0 assignees View on GitHub
hbase improvement io java P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

BEAM-4020 introduces HBaseIO reads based on SDF. So far the read() method still uses the Source based API because SDF does not support Dynamic Work Rebalancing (DWR) but the Source API of HBase does, so changing it means losing some functionality.

Since DWR is only supported by Dataflow once Dataflow supports SDF  **** DWR we can move the main read() function to use the SDF API and remove the Source based implementation. The rest of the runners already support Bounded based Reads (like HBase based on SDF does) via a default translation without DWR.

Imported from Jira [BEAM-4735](https://issues.apache.org/jira/browse/BEAM-4735). Original Jira may contain additional context.
Reported by: iemejia.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.