vectordotdev / vectordotdev/vector
New `socket` transform
Nobody has claimed this yet.
- Dominant language
- Rust
- Stars
- 22.6k
- Forks
- 2.3k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 146
Description
It might be nice to have an ability to run a transform which would send events (with either ndjson or text encoding) to a socket (unix, tcp, or udp) and read transformed events from the same socket.
Currently this can be achieved using a combination of socket sink and socket source, so this it is more about providing a shortcut for doing this and working examples, which might be helpful for new users.
If we implement this, there could be two examples of using it in the documentation:
- A second instance of Vector as a stream processor;
- A combination of
socatandjqas an example of integrating existing shell scripts with Vector.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the existing socket sink and socket source, then inspect the transform documentation and examples. The work is complete when a socket transform can send and read ndjson or text over unix, TCP, or UDP sockets, with examples for a second Vector instance and for socat with jq.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- networking, stream-processing
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100