Avoid retrieving the partition schema of Iceberg repeatedly.
Open
enhancement
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Description
When there are a large number of partitions and files, we repeatedly retrieve the partition schema each time, which is very costly. Internal testing shows that when the number of partitions exceeds ten thousand, this process can take anywhere from several minutes to hours.

Contributor guide
Assessment
This issue has not been assessed yet.