apache / apache/skywalking

[Feature] Export Data Based on Backup S3 Bucket

Open
#12,815 8 comments 0 reactions 0 assignees View on GitHub
database feature
Dominant language
Java
Stars
25k
Forks
6.6k
Avg merge
10h 5m
Merged PRs (30d)
16

Description

### Search before asking

- [X] I had searched in the [issues](https://github.com/apache/skywalking/issues?q=is%3Aissue) and found no similar feature requirement.

### Description

#### Description

This feature relies on the **Backup Agent** functionality outlined in #12876. The backup agent transfers the data to a S3 bucket, the **Export Command LIne** will enable exporting data based on this bucket, allowing users to extract and utilize specific sets of data efficiently.

#### Requirements

1. **Integration with Backup Snapshots**:
- Leverage the S3 bucket created by the **Backup Agent** feature as the data source for export.
- Ensure the export process clean up the snapshot is created for the exportation.

2. **Export Configuration**:
- **Time Range Export**: Allow users to define a specific time range from the snapshot for export.
- **Query-Based Export**: Allow users to filter and export data using specific query criteria (e.g., tags, metrics, identifiers).

3. **Export Formats**:
- Support commonly used data formats like **JSON** and **CSV**.

### Use case

_No response_

### Related issues

_No response_

### Are you willing to submit a pull request to implement this on your own?

- [ ] Yes I am willing to submit a pull request on my own!

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.