GoogleCloudPlatform / GoogleCloudPlatform/cloud-sql-python-connector
Create an Official Beam I/O Connector for Cloud SQL
- Vorherrschende Sprache
- Python
- Sterne
- 344
- Forks
- 89
- Ø Merge
- 5 Std. 33 Min.
- Gemergte PRs (30 T.)
- 2
Beschreibung
### Feature Description
The current Cloud SQL Python connector is great. But in it's current form, when used via Apache Beam/Google Cloud Dataflow, it is not recognized as an official Apache Beam framework construct. This can lead to unbalanced workers in Dataflow when dealing with any kind of volume in a pipeline.
I suggest creating an official [Beam I/O Connector](https://beam.apache.org/documentation/io/connectors/) so that Cloud SQL can have optimized usage with Beam/Dataflow.
### Sample code
_No response_
### Alternatives Considered
There is current [non-native Cloud SQL](https://github.com/jccatrinck/dataflow-cloud-sql-python) support, but it requires a custom container. This can cause slowdowns and longer approval processes at regulated customers. An official native I/O connector would be ideal.
### Additional Details
_No response_
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.