ClickHouse / ClickHouse/ClickHouse
clickhouse-client: chunking streaming input
Open
comp-cli
external
feature
- Dominant language
- C++
- Stars
- 49.9k
- Forks
- 9k
- Avg merge
- 21h 32m
- Merged PRs (30d)
- 515
Description
In seems that clickhouse-client waits for stdin streams to terminate before running queries.
**Use case**
Inserting data in a table by streaming input into clickhouse-client. The stream goes on indefinitely.
Example:
```
my_source_of_data | clickhouse-client --query='INSERT INTO logs FORMAT JSONEachRow' --input_format_allow_errors_ratio=1
```
**Describe the solution you'd like**
clickhouse-client could buffer the input up to a configurable amount of space/time e.g. 100KB or 1 second, then run the insert query and go back to buffering more data.
Contributor guide
Assessment
This issue has not been assessed yet.