bytedance / bytedance/InfiniStore

Support Client Reconnection on InfiniStore Server Restart

Open
#170 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
437
Forks
44
PR merge metrics
No merged PRs in 30d

Description

Currently, if the InfiniStore server restarts, clients lose connection and are unable to automatically reconnect—even if the server retains the same IP and port. This affects system resilience and availability during routine restarts or failure recoveries.

### Expected Behavior

- The client should detect the disconnection.
- Once the server is back online (same IP/port), the client should attempt to reconnect without requiring manual intervention.

### Use Case
This enhancement is critical for vLLM that rely on InfiniStore where uptime and robustness are important. If we plan to rollout new version of the kv cache server, it doesn't require engine to be restarted.

Contributor guide

Open the contributing guide

Research direction

Start by tracing the client connection lifecycle and how it handles a server disconnect, then examine the connection path for the configured IP and port. Done means the client detects a restart, reconnects automatically when the server returns, and preserves normal operation without manual intervention.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.