apache / apache/iceberg

Add added-puffin-files write metric

Open
#16,068 2 comments 0 reactions 0 assignees View on GitHub
improvement
Dominant language
Java
Stars
9.2k
Forks
3.5k
Avg merge
2d 11h
Merged PRs (30d)
132

Description

### Feature Request / Improvement

This distinguishes logical delete entries from physical Puffin files for DV-based row-level writes, improving MERGE observability and troubleshooting.

Before this improvement:

Image

After this improvement:

Image

### Query engine

Spark

### Willingness to contribute

- [x] I can contribute this improvement/feature independently
- [ ] I would be willing to contribute this improvement/feature with guidance from the Iceberg community
- [ ] I cannot contribute this improvement/feature at this time

Contributor guide

Open the contributing guide

Research direction

Start by locating the existing write metrics and the Spark row-level write path that handles Puffin files. Compare the current logical delete and physical file counts with the requested added-puffin-files metric, then verify that MERGE observability distinguishes them as shown in the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
data-engineering, observability
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.