apache / apache/apisix

feat: As a user, I want the kafka-logger plugin supports Apache Kafka 4.x

Open
#12,984 5 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Lua
Stars
17.1k
Forks
2.9k
Avg merge
3d 16h
Merged PRs (30d)
63

Description

### Description

The [Apache Kafka 4.x](https://archive.apache.org/dist/kafka/4.0.0/RELEASE_NOTES.html) drops the support message format magic0 and magic1.

However, kafka-logger's lua-resty-kafka default uses api_version=0 which doesn't work in Apache Kafka 4.x.

Could Apisix kafka-logger set default [API version](https://github.com/doujiang24/lua-resty-kafka?tab=readme-ov-file#choose_api_version
) to 2 and make the API version configurable which could also support the Kafka version less than 0.10.0.0?

Contributor guide

Open the contributing guide

Research direction

Start at the kafka-logger plugin entry point and inspect how it invokes lua-resty-kafka and selects api_version. Check the plugin's existing configuration and tests, then verify that the default works with Apache Kafka 4.x while the setting remains configurable for older Kafka versions.

Written by the indexing model from the issue text.

Assessment

Tech stack
kafka, lua
Domain
api, backend
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
58/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.