Aiven-Open / Aiven-Open/cloud-storage-connectors-for-apache-kafka

[QUESTION] How to properly encode CSV files for easy readability (for BigQuery external tables)?

Offen
#260 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
GCS
Vorherrschende Sprache
Java
Sterne
58
Forks
39
Ø Merge
2 T. 10 Std.
Gemergte PRs (30 T.)
5

Beschreibung

I am trying to create files in CSV format for storage on a GCS bucket. It seems with encoding set to Base64, the CSV files remain as such in plaintext, and when I try to create an external table in BigQuery with these files, the data remains as Base64 in the query results.

When I use "none" as the encoding, querying the external table throws an ASCII error (Bad character (ASCII 0) encountered.).

What is the correct way to go about this? I figured it would work if I could use the Avro converter for the key.converter property, but it seems this is not possible.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.