hashicorp / hashicorp/consul

failed to open snapshot: open /srv/consul/raft/snapshots/5-80085657-1602164735964/meta.json: no such file or directory

Open
#12,078 3 comments 0 reactions 0 assignees View on GitHub
theme/internals type/question
Dominant language
Go
Stars
30.1k
Forks
4.6k
Avg merge
1d 18h
Merged PRs (30d)
39

Description

We are getting the below error when trying to save snapshots in Consul Open source version. Our version details are below.

We tried this both from the leader and follower nodes. We haven't restored any consul servers recently. Only thing we did was the regular maintenance (i.e. applying OS patches) + deleting the raft.db as it was grown above 90 GB and restarting the consul services.

As of now the services are running fine and the only issue is we couldn't snapshot them on a regular basis for recovery purposes.

One other thing is the snapshots reference directory # from below output - 5-80085657-1602164735964 changes with every execution and hence we couldn't create directory manually as well. Alse we change the storage directory of snapshop,this problem has not been solved. Thank you !!!
![log](https://user-images.githubusercontent.com/46553454/149487299-f3ffc4b4-c476-4635-8fbd-ee201c8c92cd.png)

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the snapshot failure after deleting raft.db and restarting Consul, using the snapshot directory and missing meta.json path shown in the report. Trace how snapshot directories are created and verify that snapshots complete successfully on both leader and follower nodes without requiring manual directory creation.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.