DTStack / DTStack/chunjun

[Question][kafka to hive] kafka读取数据写入hive,什么时候临时文件写到表目录

Open
#1,278 1 comment 0 reactions 0 assignees View on GitHub
question
Dominant language
Java
Stars
4.1k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

### Search before asking

- [x] I had searched in the [issues](https://github.com/DTStack/chunjun/issues) and found no similar question.

- [x] I had googled my question but i didn't get any help.

- [x] I had read the documentation: [ChunJun doc](https://dtstack.github.io/chunjun) but it didn't help me.

### Description

kafka stream to hive, modify maxFileSize=3M, many tmp files are created in pt=date/.data directory, when the process move these tmp file from tmp directory (pt=date/.data) to real (pt=date) directory

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.