apache / apache/paimon

[Bug] error in initSerDe: java.lang.ClassNotFoundException Class org.apache.paimon.hive.PaimonSerDe not found

Open
#5,555 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.

### Paimon version

paimon-1.0

### Compute Engine

spark-3.2

### Minimal reproduce step

Use SparkSQL Engine、Hive metastore

1. Create table in hive metastore.(use create table statement)
2. Delete the HDFS directory of the table.(hdfs dfs -rm -r table dir)
3. Failed to delete table.(use drop table statement).

### What doesn't meet your expectations?

Tables stored in HMS cannot be deleted using delete statements.

### Anything else?

Some users may delete the table directory directly during use. In this case, the table information in HMS cannot be cleared.

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the initSerDe ClassNotFoundException with Spark 3.2, Paimon 1.0, SparkSQL, and a Hive metastore after deleting the table's HDFS directory. Trace the drop-table path and verify that the Hive metastore entry is cleared successfully even when the directory is missing.

Written by the indexing model from the issue text.

Assessment

Tech stack
hadoop, java, spark
Domain
databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.