Optimize resource usage during lightning import
Open
type/enhancement
- Dominant language
- Go
- Stars
- 40.5k
- Forks
- 6.2k
- PR merge metrics
- PR metrics pending
Description
## Enhancement
During the current import period, the resource usage of lightning is not balanced, it is spiky
It can be seen from the log: it seems to be pulling a batch of csv files --" compact sst --> pulling a batch of csv -- "compact sst .....
Can the code be optimized? Make resource utilization more fully
Contributor guide
Assessment
This issue has not been assessed yet.