aio-libs / aio-libs/aiokafka

Consumer fails when consuming messages compressed with ZSTD at the broker level

Aperta
#843 15 commenti 7 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Python
Stelle
1.4k
Fork
269
Merge medio
1g 1h
PR unite (30g)
6

Descrizione

**Describe the bug**
When consuming messages from a broker where compression has been set at the broker level with ZSTD compression, the Consumer fails with an UnknownError. This does not happen when ZSTD is set at a producer level instead. **This behaviour is observed both in the latest pypi release, as well as in the latest version from the master branch in this repository**

**Expected behaviour**
Consumer should be able to consume messages with ZSTD compression, when its set at a broker level, just the same as when its set at a producer level.

**Environment (please complete the following information):**
- aiokafka version: 0.7.2
- kafka-python version: 2.0.2

**Reproducible example**
When setting up the Broker, add to the server.properties file
```
compression.type=zstd
```

On the contrary, when if compression.type is omitted in the server.properties file and instead you create a producer with zstd compression, it works fine.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.