apache / apache/iggy

Kafka gateway: Kafka-to-Iggy migration guide — dual-write, cutover, decommission

Open
#3,550 0 comments 0 reactions 0 assignees View on GitHub
gateways
Dominant language
Rust
Stars
4.9k
Forks
432
Avg merge
2d 10h
Merged PRs (30d)
173

Description

Part of #3560.

## Summary

Document the four-step migration path for teams moving from Kafka to Iggy via the gateway.

## Steps

1. Deploy Iggy + bridge (sidecar)
2. Dual-write to Kafka and Iggy
3. Consumer cutover (offset mapping / consumer group strategy)
4. Decommission Kafka

## Depends on

- #3539 — Phase 1 documented
- #3544 — Phase 2 for `--group` cutover section (can draft P1 section earlier)

## Scope

- [ ] Architecture diagram (standalone sidecar)
- [ ] Dual-write patterns (app-level vs mirror)
- [ ] Offset / consumer group migration considerations
- [ ] Rollback: stop bridge → clients fail gracefully
- [ ] Operational checklist: monitoring, latency, scaling bridge vs Iggy

## Acceptance criteria

- [ ] Published under `gateways/kafka/docs/` or apache.iggy.org
- [ ] Linked from discussion #3253

## References

- Rollout plan: https://github.com/apache/iggy/discussions/3253#discussioncomment-17181030

Contributor guide

Open the contributing guide

Research direction

Start by reading #3539, #3544, and the rollout plan in discussion #3253, then inspect the existing material under gateways/kafka/docs/. Draft the four-step migration guide covering the listed architecture, dual-write, offset and consumer-group, rollback, and operational topics. Done means it is published under gateways/kafka/docs/ or apache.iggy.org and linked from #3253.

Written by the indexing model from the issue text.

Assessment

Tech stack
kafka
Domain
distributed-systems, documentation
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.