apache / apache/pinot

Include the untarred segment size when uploading segment in METADATA mode

Open
#11,194 0 comments 0 reactions 1 assignee Claimed by @snleee View on GitHub
enhancement
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 55m
Merged PRs (30d)
182

Description

Currently there is no way to know the untarred segment size when uploading segment in METADATA mode because controller doesn't download the segment for performance concern. With #11193 we use tarred segment size as an approximate untarred segment size for storage quota check, but we should include the size when uploading the segment.
We can consider always including the untarred segment size for all upload mode because this information should be available on the segment generator side.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.