ClickHouse / ClickHouse/ClickHouse

clickhouse-client: chunking streaming input

Open
#34,846 0 comments 1 reaction 0 assignees View on GitHub
comp-cli external feature
Dominant language
C++
Stars
49.9k
Forks
9k
Avg merge
21h 32m
Merged PRs (30d)
515

Description

In seems that clickhouse-client waits for stdin streams to terminate before running queries.

**Use case**

Inserting data in a table by streaming input into clickhouse-client. The stream goes on indefinitely.

Example:
```
my_source_of_data | clickhouse-client --query='INSERT INTO logs FORMAT JSONEachRow' --input_format_allow_errors_ratio=1
```

**Describe the solution you'd like**

clickhouse-client could buffer the input up to a configurable amount of space/time e.g. 100KB or 1 second, then run the insert query and go back to buffering more data.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.