fluent / fluent/fluent-plugin-kafka

ruby-kafka is no longer maintained and superseded by librdkafka via rdkafka-ruby bindings

Open
#500 5 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Ruby
Stars
307
Forks
178
Avg merge
10h 37m
Merged PRs (30d)
13

Description

### Describe the bug

I just wanted to raise to your attention that based on the official statement from the ruby-kafka repo:

> This library is no longer actively developed and has been superseded by [librdkafka](https://github.com/edenhill/librdkafka) via [rdkafka-ruby](https://github.com/appsignal/rdkafka-ruby/) bindings. While this library may still receive security patches and bug fixes, it is no longer recommended for production usage.

ruby-kafka has some critical errors that can lead to data loss. Even zendesk already switched to it with their other operations.

While I cannot replace it fully (rdkafka and waterdrop maintainer here) in this plugin because of my limited knowledge, I am happy to help you guys out :)

The downside is jruby - which is something that will have to be figured out.

### To Reproduce

To reproduce or rather see, check the `.gemspec`

### Expected behavior

I would expect this library to use one of the maintained and recommended Kafka gem.

### Your Environment

```markdown
Applies to any environment.
```

### Your Configuration

Applies to any config.

### Your Error Log

```shell
Irrelevant.
```

### Additional context

Please close it if you feel this is not a bug and it should be raised as a discussion or something else. From my perspective it is a bug as it poses risk of data loss for the end users.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.