hashicorp / hashicorp/consul

Consul Data Directory spikes from ~70% to ~100% disk usage

Open
#12,770 6 comments 0 reactions 0 assignees View on GitHub
theme/kv type/question
Dominant language
Go
Stars
30.1k
Forks
4.6k
Avg merge
1d 18h
Merged PRs (30d)
39

Description

#### Overview of the Issue

We use Consul as backend storage for Vault HA setup. The data directory suddenly spiked from ~70% to 100% data usage for 2 of the 3 consul nodes even when we try to clean up the space and restart the Consul services.

#### Reproduction Steps

Steps to reproduce this issue, eg:

1. Create a Vault and Consul cluster with 2 Vault servers and 3 Consul servers.
2. Contains ~200 KV pairs

### Operating system and Environment details

RHEL 7, 5GB space for data-dir

Contributor guide

Open the contributing guide

Research direction

Start with the reported three-node Consul and two-node Vault reproduction on RHEL 7, using the 5GB data directory and roughly 200 KV pairs. Investigate what causes the Consul data directory to grow to full capacity despite cleanup and restarts. Done means the growth mechanism is identified and a specific corrective change or documented resolution is verified.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
distributed-systems, infrastructure
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.