[SUPPORT] is not a Parquet file (length is too low: 0)
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
**Environment:**
Hudi MOR+ Spark
**Hudi version :**
0.12.1
**Spark version :**
spark3
**Hadoop version:**
2.8.5
**Problem:**
java.lang.RuntimeException: hdfs://test/warehouse/test.db/t_test/20220811/b4a54eb9-0e0c-406a-a2bd-c2f07b021277-0_8-10-991_20230421093519585.parquet is not a Parquet file (length is too low: 0)
**SQL:**
`insert into table_a_rt select * from table_b_rt;`
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing the reported failure in the Hudi MOR + Spark environment using `insert into table_a_rt select * from table_b_rt;`. Inspect how the referenced zero-length `.parquet` file is produced or read, then confirm the issue is resolved when the insert no longer raises the reported Parquet error; no source file or test is identified in the issue.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100