Review PinotFS ListFile Implementations
Open
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 189
Description
Per https://github.com/apache/incubator-pinot/pull/6002, S3 has a limit on each ListObject call response. I think this policy may also be true for other blob store.
This issue is created to review other PinotFs implementations to ensure the similar issues are not presenting there.
* [ ] AzurePinotFs
* [ ] ADLSGen2PinotFs
* [ ] GcsPinotFs
* [x] HadoopPinotFs
* [x] S3PinotFs
Contributor guide
Assessment
This issue has not been assessed yet.