dotnet / dotnet/orleans

EventHub messages ignoring both checkpoint and StreamSequenceToken

Open
#7,380 2 comments 0 reactions 1 assignee Claimed by @benjaminpetit View on GitHub
area-streaming
Dominant language
C#
Stars
10.9k
Forks
2.1k
Avg merge
15h 1m
Merged PRs (30d)
345

Description

We've recently noticed that what is happening on #2935 is happening again. Regardless of the checkpoint being write, all the streams seems to always start from the beginning of the EH causing duplicated messages to arrive on the grain.

Both @jiilaa and myself had the same issues as on that issue.

In my case, I tried to create the following measures to avoid that:

1. Save every single `StreamSequenceToken` to the grain state as soon as I have the message processed.
2. At `OnActivateAsync()`, pass the token to `SubscribeAsync()` (implicit subscription stream).

@benjaminpetit can you have a look on those? I've discussed with @ReubenBond earlier Today and it seems something that is affect again all users of EH.

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.