Remove the limit of the incremental ingestion of files so that files can arrive out of order
未關閉
enhancement
- 主要語言
- Scala
- 星號
- 31
- 分支
- 4
- 平均合併
- 1 天 10 分鐘
- 30 天內合併 PR
- 4
描述
## Background
Currently, incremental ingestion requires a monotonically increasing field. But for file-based ingestion we can be smarter and ingest new files by comparing file names in metastore for that day with files at the landing area.
## Feature
Remove the limit of the incremental ingestion of files so that files can arrive out of order.
## Example [Optional]
--
## Proposed Solution [Optional]
--
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。