[java-bigquery] How can we load GCS json files to bigquery with deduplication

Hi Team,

I'm looking for possible ways to load our GCS files which were stored in a way month/day/hour to bigquery. And we would like to remove duplicates by scanning the record based on id and timestamp in json file and move the latest record to bigquery. Could you please help the possible ways to implement this.

Thank You

Non sono menzionati file sorgente, test o entry point. Prima chiarisci il workflow GCS-to-BigQuery previsto, i campi dei record utilizzati per la deduplicazione e la definizione of done prevista, quindi individua gli entry point pertinenti della libreria client Java.

Scritto dal modello di indicizzazione a partire dal testo della issue.