dragonflydb / dragonflydb/dragonfly

S3 snapshot loading might block

Open
#3,941 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
C++
Stars
31.5k
Forks
1.3k
Avg merge
1d 9h
Merged PRs (30d)
121

Description

**Describe the bug**
Dragonfly tries to find files in my bucket (which exists and it has permissions to), however it never completes loading the files.
The pod is now 5 days old, so likely it should have completed searching for files now ;-)

**To Reproduce**
No route for reproduction known

**Expected behavior**
Dragonfly should not stall upon searching for files. Any aws request should have a deadline and fail eventually if it does not succeed in time. This should then result in a log message printed and the original behavior to be executed (i guess kill the process?).

**Screenshots**
![image](https://github.com/user-attachments/assets/1c6f83bb-1ec1-4486-bcc8-c16ad4345f50)

**Environment (please complete the following information):**
- OS: kubernetes 1.31 on bottlerocket 1.24.0 nodes
- Kernel: # Command: 6.1.109
- Containerized?: Containerd
- Dragonfly Version: 1.23.2

**Reproducible Code Snippet**
No route for reproduction known

**Additional context**
This was upon a node being exchanged by another node and not an initial installation, so the s3 file to be searched for do exist.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.