apple / apple/foundationdb

Storage engine migration is recruiting two storage servers on same processes

Open
#3,894 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
16.7k
Forks
1.6k
Avg merge
1d 20h
Merged PRs (30d)
126

Description

The current migration logic intends to drop / add each storage engine one at a time without both old and new engines overlapping in lifetime, but testing shows this not to be the case.

This is particularly problematic since Redwood and SQLite do not share the same cache budget. While they could, in general it is hard to enforce that all storage engines share the same cache, for example RocksDB would also not share a cache budget with SQLite.

Contributor guide

Open the contributing guide

Research direction

No file, test, or entry point is named. Start by tracing the storage engine migration logic and reproducing the observed overlap between old and new engines; done means migration no longer keeps both engines alive concurrently and avoids conflicting cache budgets.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases, distributed-systems
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.