apache / apache/pinot

Segment MetaData mismatch between API's

Open
#10,816 4 comments 0 reactions 1 assignee Claimed by @eaugene View on GitHub
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
1d 21h
Merged PRs (30d)
189

Description

The Creation Time Millis value received for a realtime segment from `/segments//metadata` API is not aligning with the value received from`/segments///metadata` API . I assume they denote the time when the segment started consuming .

Value received for a segment from `/segments//metadata` :
```
{
"segmentName": "segment_name",
"schemaName": null,
"crc": 1641778138,
**"creationTimeMillis": 1685394183377,**
"creationTimeReadable": "2023-05-29T21:03:03:377 UTC",
"timeColumn": "timestamp",
"timeUnit": "SECONDS",
"timeGranularitySec": 1,
"startTimeMillis": 1685307699000,
"startTimeReadable": "2023-05-28T21:01:39.000Z",
"endTimeMillis": 1685394146000,
"endTimeReadable": "2023-05-29T21:02:26.000Z",
"segmentVersion": "v3",
"creatorName": null,
"totalDocs": 1946111,
"custom": {},
"startOffset": "1498385432",
"endOffset": "1500331543",
"columns": [],
"indexes": {},
"star-tree-index": null
},
```

Value received the same segment from `/segments//metadata` :
```
{
"segment.realtime.endOffset": "1500331543",
"segment.start.time": "1685307699000",
"segment.time.unit": "MILLISECONDS",
"segment.flush.threshold.size": "2500000",
"segment.realtime.startOffset": "1498385432",
"segment.end.time": "1685394146000",
"segment.total.docs": "1946111",
"segment.realtime.numReplicas": "2",
**"segment.creation.time": "1685307748436",**
"segment.index.version": "v3",
"segment.crc": "1641778138",
"segment.realtime.status": "DONE",
"segment.download.url": ""
}
```

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.