Regarding client/consumer for databus
- Dominant language
- Java
- Stars
- 3.7k
- Forks
- 736
- PR merge metrics
- No merged PRs in 30d
Description
Also i want to know is it good way to capture databus change events using Kafka?
Eventually i want to store the change capture events in near real time to Hadoop(HBase).
I want to integrate the components like below. Please advise how Linked in capturing events in hadoop.
Databus --->kafka --->spark streaming-->Hbase.
i see there is component called Lumos.
Regards,
Shanker
Contributor guide
No contributing guide indexed for this repository
Research direction
No files, tests, or entry points are identified. First clarify whether the project supports a Databus-to-Kafka integration and how Lumos relates to the proposed Databus, Spark Streaming, Hadoop, and HBase pipeline. Done would require a decided integration scope and implementation plan.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- hadoop, java, kafka, spark
- Domain
- data-engineering, databases, distributed-systems, stream-processing
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100