apache / apache/skywalking

[Feature] Lifecycle support for storing data into S3

Open
#13,989 0 comments 0 reactions 0 assignees View on GitHub
database feature
Dominant language
Java
Stars
25k
Forks
6.6k
Avg merge
9h 32m
Merged PRs (30d)
19

Description

## Summary
Add lifecycle support for storing data into S3, enabling tiered/archival storage of BanyanDB data.

## Task Requirements
1. **Research** — survey potential solutions (S3 storage backends, lifecycle policies, integration approaches with BanyanDB's existing storage model).
2. **PoC** — implement a proof-of-concept for the chosen approach.
3. **Benchmark** — run benchmarks (write/read latency, throughput, cost) before finalizing the design.

## Acceptance Criteria
- Research document comparing candidate solutions.
- Working PoC.
- Benchmark results.
- Final design proposal based on PoC + bench findings.

Contributor guide

Open the contributing guide

Research direction

Start by surveying S3 storage backends, lifecycle policies, and integration approaches with BanyanDB's existing storage model. Produce a comparison document, build a working proof-of-concept, run write/read latency, throughput, and cost benchmarks, and use the findings to complete a final design proposal.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws
Domain
cloud, data
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.