Aiven-Open / Aiven-Open/cloud-storage-connectors-for-apache-kafka

[QUESTION] How to properly encode CSV files for easy readability (for BigQuery external tables)?

未关闭
#260 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
GCS
主要语言
Java
星标
58
派生
39
平均合并
2 天 10 小时
30 天内合并 PR
5

描述

I am trying to create files in CSV format for storage on a GCS bucket. It seems with encoding set to Base64, the CSV files remain as such in plaintext, and when I try to create an external table in BigQuery with these files, the data remains as Base64 in the query results.

When I use "none" as the encoding, querying the external table throws an ASCII error (Bad character (ASCII 0) encountered.).

What is the correct way to go about this? I figured it would work if I could use the Avro converter for the key.converter property, but it seems this is not possible.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。