GoogleCloudPlatform / GoogleCloudPlatform/cloud-sql-python-connector

Create an Official Beam I/O Connector for Cloud SQL

Offen
#1,062 2 Kommentare 1 Reaktion 1 zugewiesene Person Zugewiesen an @hessjcg Auf GitHub ansehen
priority: p2 type: feature request
Vorherrschende Sprache
Python
Sterne
344
Forks
89
Ø Merge
5 Std. 33 Min.
Gemergte PRs (30 T.)
2

Beschreibung

### Feature Description

The current Cloud SQL Python connector is great. But in it's current form, when used via Apache Beam/Google Cloud Dataflow, it is not recognized as an official Apache Beam framework construct. This can lead to unbalanced workers in Dataflow when dealing with any kind of volume in a pipeline.

I suggest creating an official [Beam I/O Connector](https://beam.apache.org/documentation/io/connectors/) so that Cloud SQL can have optimized usage with Beam/Dataflow.

### Sample code

_No response_

### Alternatives Considered

There is current [non-native Cloud SQL](https://github.com/jccatrinck/dataflow-cloud-sql-python) support, but it requires a custom container. This can cause slowdowns and longer approval processes at regulated customers. An official native I/O connector would be ideal.

### Additional Details

_No response_

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.