Pinot tooling to test streaming connectivity
Open
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 189
Description
Should have some tooling to test the connectivity to steaming data sources, e.g. Kafka/pulsar/kinesics/etc.
This should on par with existing table streaming configs.
Something like:
Pinot-admin StreamConsumer tail -type kafka-2.0 -config kafka-stream.configs
Contributor guide
Research direction
Start by reviewing the existing table streaming configurations and the proposed Pinot-admin StreamConsumer command. Define what connectivity testing should cover for Kafka and the other named streaming sources, and confirm that the resulting tooling is on par with existing streaming configuration support.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, kafka
- Domain
- cli, devtools, stream-processing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100