Remove the limit of the incremental ingestion of files so that files can arrive out of order
未关闭
enhancement
- 主要语言
- Scala
- 星标
- 31
- 派生
- 4
- 平均合并
- 1 天 10 分钟
- 30 天内合并 PR
- 4
描述
## Background
Currently, incremental ingestion requires a monotonically increasing field. But for file-based ingestion we can be smarter and ingest new files by comparing file names in metastore for that day with files at the landing area.
## Feature
Remove the limit of the incremental ingestion of files so that files can arrive out of order.
## Example [Optional]
--
## Proposed Solution [Optional]
--
贡献指南
这个仓库没有索引到贡献指南
评估
这个 Issue 还没有评估数据。