apache / apache/beam

FileIO shard numbering would be more user-friendly if it were 1-based instead of 0-based

Open
#24,362 2 comments 0 reactions 0 assignees View on GitHub
files improvement io java P3 python
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

### What happened?

When fileio writes several shards, the last shard will have as name "00123-of-00124" which may look like incomplete processing.

The first shard should be "00001-of-XXXXX" and not "00000-of-XXXX", and the last shard should be "00124-of-00-124" (in this case for an example with 124 shards).

### Issue Priority

Priority: 3

### Issue Component

Component: io-py-files

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.