apache / apache/beam

Develop a Python cross-language wrapper for Java BigTableIO

Open
#21,356 0 comments 0 reactions 0 assignees View on GitHub
cross-language gcp io new feature P2 python
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

Java connector: [https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableIO.java](https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableIO.java)

 

Documentation for developing Python cross-language transforms:

[https://beam.apache.org/documentation/programming-guide/#1311-creating-cross-language-java-transforms](https://beam.apache.org/documentation/programming-guide/#1311-creating-cross-language-java-transforms)

[https://beam.apache.org/documentation/sdks/python-multi-language-pipelines/](https://beam.apache.org/documentation/sdks/python-multi-language-pipelines/)

 

Existing cross-language transform for Cloud Spanner might serve as a good example to follow.

[https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/spanner.py](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/spanner.py)

[https://github.com/apache/beam/blob/a4e112974d8f3f51e646d9e714a4f8d456d69b4d/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerTransformRegistrar.java](https://github.com/apache/beam/blob/a4e112974d8f3f51e646d9e714a4f8d456d69b4d/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/spanner/SpannerTransformRegistrar.java)

 

 

Imported from Jira [BEAM-13607](https://issues.apache.org/jira/browse/BEAM-13607). Original Jira may contain additional context.
Reported by: chamikara.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.