confluentinc / confluentinc/ksql

Allow to pass group.id to the push query

Open
#8,763 0 comments 0 reactions 1 assignee Claimed by @AlanConfluent View on GitHub
enhancement query-engine
Dominant language
Java
Stars
315
Forks
1k
Avg merge
1d 7h
Merged PRs (30d)
36

Description

**Is your feature request related to a problem? Please describe.**
Hi, I would like to process the "select" query on multiple consumers within the same group (for parallelization).

**Describe the solution you'd like**
Would be nice to pass "group.id" to the PUSH query.
For example:
```
SELECT * FROM WITH (group.id="my-group-id") userEvents EMIT CHANGES;
```

**Describe alternatives you've considered**
I thought of using `kafka-stream-api`, but to be honest it looks like an overhead just to split the jobs into multiple consumers.

**Additional context**
Running multiple observers creates a group-per-query. It makes the parallelization much harder while using push queries.

Thanks for your help!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.