DELETE_PARTITON doesn't raise exception although the target partition doesn't exists
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
My stack is AWS Glue + AWS Glue Catalog + S3.
When I use DELETE_PARTITION, I see a different behavior between 0.10.1 and 0.11.0.
In 0.10.1, when I run DELETE_PARTITION for non-existing partition, it failed(exception raised) because the partition doesn’t exists.
[~shivnarayan] confirmed that the expected behavior is raising exception when DELETE_PARTITION tries to delete non-existing partition.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-4304
- Type: Bug
Contributor guide
No contributing guide indexed for this repository
Research direction
Reproduce DELETE_PARTITION against AWS Glue Catalog and S3 using Hudi 0.10.1 and 0.11.0, comparing behavior for a non-existing partition. Then trace the Java entry point handling the operation and identify the relevant tests. Done means the missing-partition case raises the expected exception consistently with the confirmed behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100