open-telemetry / open-telemetry/opentelemetry-python

OTEL Kafka Exporter

Open
#4,828 2 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

feature-request
Dominant language
Python
Stars
2.6k
Forks
1k
Avg merge
4d 15h
Merged PRs (30d)
19

Description

Is your feature request related to a problem?

In some cases it is good to export spans, logs, and metrics direct to Kafka, rather than elsewhere. For example, all your applications could publish to a Kafka cluster/s, with an OpenTelemetry Collector configured to export elsewhere. If you then wanted to change where you wanted to export your telemetry data you would only need to update the configuration for a single deployment

Describe the solution you'd like

Exporters that publish to Kafka. Defaults should match those of the Kafka Receiver from the opentelemetry-collector. For example the default topic for traces would be otlp_spans

Describe alternatives you've considered

No response

Additional Context

No response

Would you like to implement a fix?

Yes

Tip

React with 👍 to help prioritize this issue. Please use comments to provide useful context, avoiding +1 or me too, to help us triage it. Learn more here.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the linked OpenTelemetry Collector Kafka Receiver README and inspect the opentelemetry-python repository for existing exporter entry points. Define the scope for spans, logs, and metrics, including the requested Kafka defaults such as the otlp_spans topic. Done means the requested Kafka exporters are implemented and covered by the repository's tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
kafka, python
Domain
backend, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.