apache / apache/hudi

Missing .hoodie/hoodie.properties in Hudi table

Open
#15,467 1 comment 0 reactions 1 assignee Assigned to @yihua View on GitHub
from-jira priority:high type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

At some point, the ingestion job reports that hoodie.properties is missing and neither of hoodie.properties nor hoodie.properties.backup is present.  Sample stacktrace:

 
{code:java}
Caused by: org.apache.hudi.exception.HoodieIOException: Could not load Hoodie properties from s3://.../.hoodie/hoodie.properties
    at org.apache.hudi.common.table.HoodieTableConfig.(HoodieTableConfig.java:254)
    at org.apache.hudi.common.table.HoodieTableMetaClient.(HoodieTableMetaClient.java:125)
    at org.apache.hudi.common.table.HoodieTableMetaClient.(HoodieTableMetaClient.java:78)
    at org.apache.hudi.common.table.HoodieTableMetaClient$Builder.build(HoodieTableMetaClient.java:668)
    at org.apache.hudi.HoodieSparkSqlWriter$.$anonfun$getHoodieTableConfig$1(HoodieSparkSqlWriter.scala:756)
    at scala.Option.getOrElse(Option.scala:189)
    at org.apache.hudi.HoodieSparkSqlWriter$.getHoodieTableConfig(HoodieSparkSqlWriter.scala:757)
    at org.apache.hudi.HoodieSparkSqlWriter$.write(HoodieSparkSqlWriter.scala:85)
    at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:165) {code}
 

 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-4947
- Type: Bug
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.