Aiven-Open / Aiven-Open/cloud-storage-connectors-for-apache-kafka
[QUESTION] How to properly encode CSV files for easy readability (for BigQuery external tables)?
Offen
GCS
- Vorherrschende Sprache
- Java
- Sterne
- 58
- Forks
- 39
- Ø Merge
- 2 T. 10 Std.
- Gemergte PRs (30 T.)
- 5
Beschreibung
I am trying to create files in CSV format for storage on a GCS bucket. It seems with encoding set to Base64, the CSV files remain as such in plaintext, and when I try to create an external table in BigQuery with these files, the data remains as Base64 in the query results.
When I use "none" as the encoding, querying the external table throws an ASCII error (Bad character (ASCII 0) encountered.).
What is the correct way to go about this? I figured it would work if I could use the Avro converter for the key.converter property, but it seems this is not possible.
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.