apache / apache/incubator-xtable

Error while creating Hudi format from source Iceberg table using Hive Catalog .

Open
#443 26 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
1.2k
Forks
212
Avg merge
4d 9h
Merged PRs (30d)
16

Description

### Search before asking

- [X] I had searched in the [issues](https://github.com/apache/incubator-xtable/issues?q=is%3Aissue) and found no similar issues.

### Please describe the bug 🐞

Hi all Iam trying to convert my iceberg table which is using hive catalog to hudi format as target but I am getting below error while configuring catalog as --icebergCatalogConfig option. catalog config file is:
catalogImpl: org.apache.iceberg.hive.HiveCatalog
catalogName: prod_iceberg
catalogOptions:
uri: thrift metastore uri
warehouse: s3a://prod_iceberg/warehouse
But if i use hadoopCatalog and pass catalogImpl as org.apache.iceberg.hadoop.HadoopCatalog iam getting no such error , if there anything we need to configure for hive Catalog.
Attaching Screenshot for your reference.

### Are you willing to submit PR?

- [ ] I am willing to submit a PR!
- [x] I am willing to submit a PR but need help getting started!

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
![IMG_20240522_164253171~2.jpg](https://github.com/apache/incubator-xtable/assets/68867210/0e29ebea-b032-4e85-8330-7b0c83e84a84)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the conversion with the `--icebergCatalogConfig` file shown in the issue, using the HiveCatalog settings and then the working HadoopCatalog comparison. Inspect the attached error screenshot and the 26-comment thread for the exact failure and any unresolved conclusions. Done means identifying the required Hive catalog configuration and confirming successful conversion to Hudi.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.