vectordotdev / vectordotdev/vector

Officially support `ceph` object storage as possible sink

Open
#1,498 19 comments 9 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

domain: sinks domain: tests needs: approval
Dominant language
Rust
Stars
22.6k
Forks
2.3k
Avg merge
1d 7h
Merged PRs (30d)
146

Description

Ceph is an open source distributed object storage.

Some users might want to use it as a sink for Vector. I think the easiest way to send data to Ceph from Vector would be to use its S3-compatible API (example) via aws_s3 sink.

I wonder does it make sense to add an example of using Ceph with the aws_s3 sink. If so, we probably would need to also add a CI test which would ensure that it actually works.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the aws_s3 sink documentation and the linked Ceph S3 API example. Identify where sink examples and CI tests are maintained; done means documenting a working Ceph-compatible configuration and adding CI coverage that passes against Ceph.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
backend, cloud
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.