elastic / elastic/elastic-agent

9.5.3 Elastic Agent Otel Osquery error - failed to index document

Closed
#16,609 1 comment 0 reactions 1 assignee Claimed by @leehinman View on GitHub
bug Team:Elastic-Agent-Control-Plane
Dominant language
Go
Stars
276
Forks
266
Avg merge
1d 23h
Merged PRs (30d)
312

Description

After updating to 9.5.3 faced an issue - all policies that used custom Namespace failed with an error:

```
{"log.level":"error","@timestamp":"2026-09-14T10:59:30.598+0300","message":"failed to index document","service.name":"elastic-otel-collector","otelcol.component.id":"elasticsearch/_agent-component/default","otelcol.signal":"logs","index":"","error.reason":"action [indices:data/write/bulk[s]] is unauthorized for API key id [-xZgj58Btl6UGVtwZxOZ] of user [elastic/fleet-server] on indices [logs-osquery_manager.result-default], this action is granted by the index privileges [create_doc,create,delete,index,write,all]","http.response.status_code":403,"log.origin":{"file.line":425,"file.name":"elasticsearchexporter@v0.157.0/bulkindexer.go","function":"github.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter.flushBulkIndexer"},"resource":{"service.instance.id":"b2ac2694-ed99-41f4-992d-e4f8ebf5d247","service.name":"/opt/Elastic/Agent/data/elastic-agent-9.5.3-0e70ce/components/elastic-otel-collector","service.version":"9.5.3"},"otelcol.component.kind":"exporter","error.type":"security_exception","ecs.version":"1.6.0","log.origin.stack_trace":"github.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter.flushBulkIndexer\n\tgithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter@v0.157.0/bulkindexer.go:425\ngithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter.(*syncBulkIndexerSession).Flush\n\tgithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter@v0.157.0/bulkindexer.go:252\ngithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter.(*sessionList).Flush.func1\n\tgithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter@v0.157.0/exporter.go:667\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.22.0/errgroup/errgroup.go:93","ecs.version":"1.6.0"}
{"log.level":"error","@timestamp":"2026-09-14T10:59:40.801+0300","message":"failed to index document","service.name":"elastic-otel-collector","index":"","error.reason":"action [indices:admin/auto_create] is unauthorized for API key id [-xZgj58Btl6UGVtwZxOZ] of user [elastic/fleet-server] on indices [logs-osquery_manager.action.responses-default], this action is granted by the index privileges [auto_configure,create_index,manage,all]","http.response.status_code":403,"log.origin":{"file.line":425,"file.name":"elasticsearchexporter@v0.157.0/bulkindexer.go","function":"github.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter.flushBulkIndexer"},"otelcol.signal":"logs","error.type":"security_exception","ecs.version":"1.6.0","log.origin.stack_trace":"github.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter.flushBulkIndexer\n\tgithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter@v0.157.0/bulkindexer.go:425\ngithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter.(*syncBulkIndexerSession).Flush\n\tgithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter@v0.157.0/bulkindexer.go:252\ngithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter.(*sessionList).Flush.func1\n\tgithub.com/open-telemetry/opentelemetry-collector-contrib/exporter/elasticsearchexporter@v0.157.0/exporter.go:667\ngolang.org/x/sync/errgroup.(*Group).Go.func1\n\tgolang.org/x/sync@v0.22.0/errgroup/errgroup.go:93","resource":{"service.instance.id":"b2ac2694-ed99-41f4-992d-e4f8ebf5d247","service.name":"/opt/Elastic/Agent/data/elastic-agent-9.5.3-0e70ce/components/elastic-otel-collector","service.version":"9.5.3"},"otelcol.component.id":"elasticsearch/_agent-component/default","otelcol.component.kind":"exporter","ecs.version":"1.6.0"}
```

It was temporarily fixed by using similar approach to that issue: https://github.com/elastic/elastic-agent/issues/16118

Image

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.