apple / apple/foundationdb

DiskQueue files can grow infinitely

Open
#1,080 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
C++
Stars
16.7k
Forks
1.6k
Avg merge
1d 20h
Merged PRs (30d)
126

Description

As reported [on the forums](https://forums.foundationdb.org/t/extremely-large-logqueue-file/1049/), there exists some rare bug in which upon recovery, a transaction log can manage to never swap disk queue files, and only append to one file infinitely.

Simulation doesn't have any strong checks that would prevent this sort of behavior, so some should be added to see if simulation manages to reproduce less exaggerated versions of this problem.

Contributor guide

Open the contributing guide

Research direction

Start with the transaction log's disk queue recovery and file-swapping paths, then inspect the simulation checks around them. Try to reproduce a recovery case where one disk queue file only grows; done means simulation detects or prevents unbounded appending and includes a check for the behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.