googleapis / googleapis/google-cloud-java
[java-bigquery] How can we load GCS json files to bigquery with deduplication
Đang mở
api: bigquery
priority: p3
type: question
- Ngôn ngữ chính
- Java
- Star
- 2.1k
- Fork
- 1.2k
- Merge trung bình
- 1 ngày 23 giờ
- Pull request đã merge (30 ngày)
- 154
Mô tả
Hi Team,
I'm looking for possible ways to load our GCS files which were stored in a way month/day/hour to bigquery. And we would like to remove duplicates by scanning the record based on id and timestamp in json file and move the latest record to bigquery. Could you please help the possible ways to implement this.
Thank You
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.