apache / apache/hudi

[SUPPORT] is not a Parquet file (length is too low: 0)

Open
#8,686 0 comments 0 reactions 0 assignees View on GitHub
area:table-service engine:spark issue:data-consistency
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

**Environment:**

Hudi MOR+ Spark

**Hudi version :**

0.12.1

**Spark version :**

spark3

**Hadoop version:**

2.8.5

**Problem:**

java.lang.RuntimeException: hdfs://test/warehouse/test.db/t_test/20220811/b4a54eb9-0e0c-406a-a2bd-c2f07b021277-0_8-10-991_20230421093519585.parquet is not a Parquet file (length is too low: 0)

**SQL:**

`insert into table_a_rt select * from table_b_rt;`

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported failure in the Hudi MOR + Spark environment using `insert into table_a_rt select * from table_b_rt;`. Inspect how the referenced zero-length `.parquet` file is produced or read, then confirm the issue is resolved when the insert no longer raises the reported Parquet error; no source file or test is identified in the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.