Consul Data Directory spikes from ~70% to ~100% disk usage
- Dominant language
- Go
- Stars
- 30.1k
- Forks
- 4.6k
- Avg merge
- 1d 18h
- Merged PRs (30d)
- 39
Description
#### Overview of the Issue
We use Consul as backend storage for Vault HA setup. The data directory suddenly spiked from ~70% to 100% data usage for 2 of the 3 consul nodes even when we try to clean up the space and restart the Consul services.
#### Reproduction Steps
Steps to reproduce this issue, eg:
1. Create a Vault and Consul cluster with 2 Vault servers and 3 Consul servers.
2. Contains ~200 KV pairs
### Operating system and Environment details
RHEL 7, 5GB space for data-dir
Contributor guide
Research direction
Start with the reported three-node Consul and two-node Vault reproduction on RHEL 7, using the 5GB data directory and roughly 200 KV pairs. Investigate what causes the Consul data directory to grow to full capacity despite cleanup and restarts. Done means the growth mechanism is identified and a specific corrective change or documented resolution is verified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- distributed-systems, infrastructure
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100