GoogleCloudPlatform / GoogleCloudPlatform/cloud-sql-python-connector

Create an Official Beam I/O Connector for Cloud SQL

Abierto
#1,062 2 comentarios 1 reacción 1 asignado Asignado a @hessjcg Ver en GitHub
priority: p2 type: feature request
Lenguaje dominante
Python
Estrellas
344
Forks
89
Merge medio
5 h 33 min
PR fusionados (30 d)
2

Descripción

### Feature Description

The current Cloud SQL Python connector is great. But in it's current form, when used via Apache Beam/Google Cloud Dataflow, it is not recognized as an official Apache Beam framework construct. This can lead to unbalanced workers in Dataflow when dealing with any kind of volume in a pipeline.

I suggest creating an official [Beam I/O Connector](https://beam.apache.org/documentation/io/connectors/) so that Cloud SQL can have optimized usage with Beam/Dataflow.

### Sample code

_No response_

### Alternatives Considered

There is current [non-native Cloud SQL](https://github.com/jccatrinck/dataflow-cloud-sql-python) support, but it requires a custom container. This can cause slowdowns and longer approval processes at regulated customers. An official native I/O connector would be ideal.

### Additional Details

_No response_

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.