GoogleCloudPlatform / GoogleCloudPlatform/cloud-sql-python-connector

Create an Official Beam I/O Connector for Cloud SQL

Aperta
#1,062 2 commenti 1 reazione 1 assegnatario Assegnata a @hessjcg Vedi su GitHub
priority: p2 type: feature request
Lingua principale
Python
Stelle
344
Fork
89
Merge medio
5h 33m
PR unite (30g)
2

Descrizione

### Feature Description

The current Cloud SQL Python connector is great. But in it's current form, when used via Apache Beam/Google Cloud Dataflow, it is not recognized as an official Apache Beam framework construct. This can lead to unbalanced workers in Dataflow when dealing with any kind of volume in a pipeline.

I suggest creating an official [Beam I/O Connector](https://beam.apache.org/documentation/io/connectors/) so that Cloud SQL can have optimized usage with Beam/Dataflow.

### Sample code

_No response_

### Alternatives Considered

There is current [non-native Cloud SQL](https://github.com/jccatrinck/dataflow-cloud-sql-python) support, but it requires a custom container. This can cause slowdowns and longer approval processes at regulated customers. An official native I/O connector would be ideal.

### Additional Details

_No response_

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.