airbytehq / airbytehq/airbyte

[destination-iceberg] Cannot query Iceberg table in Athena when using HadoopCatalog

Offen
#35,344 5 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
area/connectors community connectors/destination/iceberg frozen team/destinations type/bug
Vorherrschende Sprache
Python
Sterne
22.1k
Forks
5.3k
PR-Merge-Kennzahlen
PR-Kennzahlen ausstehend

Beschreibung

### Connector Name

destination-iceberg

### Connector Version

0.1.4

### What step the error happened?

Other

### Relevant information

I used the HadoopCatalog and S3 storage for the destination iceberg, with the source connection as Google Sheet. When I enable the sync for the connection, the data is successfully stored in the S3 location as parquet files.

However, my objective is to create an iceberg table and perform queries on the data stored through AWS Athena.

This is the sql command I used to create iceberg table.

CREATE TABLE iceberg_table (id bigint, data string, category string)
LOCATION 's3://my-bucket/my-folder/'
TBLPROPERTIES ( 'table_type' = 'ICEBERG' )

But when I query this table, it shows "No result found". It fails to recognize the iceberg data.

If someone faced the same issue, please help how to solve this issue.

### Relevant log output

_No response_

### Contribute

- [ ] Yes, I want to contribute

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.