ansible-middleware / ansible-middleware/amq_streams

Enable deploy Kafka Connect in distributed mode

Ouverte
#40 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
Langage dominant
Jinja
Étoiles
10
Forks
9
Merge moyen
6 j 1 h
PR mergées (30 j)
2

Description

##### SUMMARY

Kafka Connect cluster can be deployed in two different modes:

* **standalone**, running on a single node. This is the current implementation of the `amq_streams_connect` role.
* **distributed**, running accross more than one worker nodes.

The standalone mode is intended for development, testing or small production environments. However, the distributed mode is more suitable for production environments, distributing the workloads among them.

It should be a good feature allowing to deploy a Kafka Connect cluster using the distributed mode. It should required to:

* Include the `connect-distributed.properties` file to set up the Kafka Cluster
* Identify the boostrap server connection, normally based in a list of different brokers

References:

* [Using Kafka Connect in distributed mode](https://access.redhat.com/documentation/en-us/red_hat_amq_streams/2.4/html-single/using_amq_streams_on_rhel/index#assembly-kafka-connect-distributed-str)

###### BONUS TRACK

The integration against the Kafka cluster (boostrap server connection string) should cover the different authentication mechanisms allowed by the `amq_streams_broker` role (e.g: SASL PLAIN, SASL SCRAM, ...)

##### ISSUE TYPE
- Feature Idea

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.