GoogleCloudPlatform / GoogleCloudPlatform/cloud-sql-python-connector

Create an Official Beam I/O Connector for Cloud SQL

Ouverte
#1,062 2 commentaires 1 réaction 1 personne assignée Assignée à @hessjcg Voir sur GitHub
priority: p2 type: feature request
Langage dominant
Python
Étoiles
344
Forks
89
Merge moyen
5 h 33 min
PR mergées (30 j)
2

Description

### Feature Description

The current Cloud SQL Python connector is great. But in it's current form, when used via Apache Beam/Google Cloud Dataflow, it is not recognized as an official Apache Beam framework construct. This can lead to unbalanced workers in Dataflow when dealing with any kind of volume in a pipeline.

I suggest creating an official [Beam I/O Connector](https://beam.apache.org/documentation/io/connectors/) so that Cloud SQL can have optimized usage with Beam/Dataflow.

### Sample code

_No response_

### Alternatives Considered

There is current [non-native Cloud SQL](https://github.com/jccatrinck/dataflow-cloud-sql-python) support, but it requires a custom container. This can cause slowdowns and longer approval processes at regulated customers. An official native I/O connector would be ideal.

### Additional Details

_No response_

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.