aio-libs / aio-libs/aiokafka

[QUESTION] How to avoid missing messages between calls to AIOKafkaConsumer.subscribe

Open
#834 3 comments 0 reactions 0 assignees View on GitHub
question
Dominant language
Python
Stars
1.4k
Forks
269
Avg merge
1d 1h
Merged PRs (30d)
6

Description

If we're subscribed to channels "a" and "b" and we want to drop "a" and keep "b", the [docs](https://aiokafka.readthedocs.io/en/stable/api.html#aiokafka.AIOKafkaConsumer.subscribe) for `AIOKafkaConsumer.subscribe` say "Topic subscriptions are not incremental: this list will replace the current assignment (if there is one)" so we would just call `subscribe` to subscribe to "b" only. But is there the possibility that we'll miss a message to "b" in between being subscribed to "a" and "b" and being subscribed to "b"? Is there a way to avoid this?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.