redpanda-data / redpanda-data/connect

logger: add mapping support

Open
#3,675 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

ux
Dominant language
Go
Stars
8.8k
Forks
969
Avg merge
1d 13h
Merged PRs (30d)
64

Description

Hello,

I would like to propose adding a new mapping field to the logger component configuration, similar to the existing functionality in metrics (see Metric Mapping documentation).

Motivation:

  • Enable dynamic construction of log fields.
  • Allow conditional formatting and filtering of log messages.

Request:
Add a mapping configuration option in logger that supports bloblang.

Use case:
Log format with GELF.

--
Regards

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the logger component and compare its configuration and behavior with the existing metrics mapping described in the linked Metric Mapping documentation. Determine how a mapping option can support Bloblang for dynamic fields, conditional formatting, and filtering, then verify the logger can produce the requested GELF format.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
stream-processing
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.