influxdata / influxdata/influxdb-observability

OTLP metric to line protocol: failed to write point for gauge

Open
#276 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
56
Forks
29
Avg merge
12d 13h
Merged PRs (30d)
4

Description

I am tring to get metrics form Pixie telemetry -> Otelp(otel agent ) -> Otel-gateway -> influxDB
os: Ubuntu 22.04
version: influx container 2.3.0-alpine
"2023-08-23T04:03:57.940Z error exporterhelper/queued_retry.go:401 Exporting failed. The error is not retryable. Dropping data. {"kind": "exporter", "data_type": "metrics", "name": "influxdb", "error": "Permanent error: failed to convert OTLP metric to line protocol: failed to write point for gauge: Permanent error: failed to encode point: encoding point 22: invalid tag value service.name=\"\"", "dropped_items": 2570}
go.opentelemetry.io/collector/exporter/exporterhelper.(*retrySender).send
go.opentelemetry.io/collector@v0.71.0/exporter/exporterhelper/queued_retry.go:401
go.opentelemetry.io/collector/exporter/exporterhelper.(*metricsSenderWithObservability).send
go.opentelemetry.io/collector@v0.71.0/exporter/exporterhelper/metrics.go:136
go.opentelemetry.io/collector/exporter/exporterhelper.(*queuedRetrySender).start.func1
go.opentelemetry.io/collector@v0.71.0/exporter/exporterhelper/queued_retry.go:205
go.opentelemetry.io/collector/exporter/exporterhelper/internal.(*boundedMemoryQueue).StartConsumers.func1
go.opentelemetry.io/collector@v0.71.0/exporter/exporterhelper/internal/bounded_memory_queue.go:61"

here is my Otel configuration

receivers:

otlp:
protocols:
grpc:
endpoint: 0.0.0.0:4317
http:
endpoint: 0.0.0.0:4318

processors:
batch:

exporters:
influxdb:
endpoint: http://influxdb2:32702
timeout: 500ms
org:
bucket:
token:
metrics_schema: telegraf-prometheus-v1

service:

pipelines:

traces:
receivers: [otlp]
processors: [batch]
exporters: [influxdb]

metrics:
receivers: [otlp]
processors: [batch]
exporters: [influxdb]

logs:
receivers: [otlp]
processors: [batch]
exporters: [influxdb]

how i can resolve this error? could you please provide some info.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the reported exporter error and the referenced exporterhelper queued_retry.go:401 and metrics.go:136 paths, then trace the OTLP gauge conversion that produces the empty service.name tag. Reproduce the failure with the supplied collector configuration and versions; done means the metric is encoded and written without dropped data or the failure is clearly documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
databases, observability
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.