elastic / elastic/elastic-agent

error fetching io.pressure in agent logs even when only using prometheus policy

Open
#371 1 comment 0 reactions 0 assignees View on GitHub
bug v8.1.0
Dominant language
Go
Stars
275
Forks
264
Avg merge
1d 20h
Merged PRs (30d)
298

Description

I'm running agent inside docker via this docker-compose configuration https://github.com/matschaffer/elastic-otel-metrics/blob/main/docker-compose.yml#L4-L9

The agent is being enrolled into a "prometheus-otel" polic that I create than only has the prometheus metrics integration.

Here's the full policy:

prometheus-otel.policy.yml

```
id: f028f2d0-c461-11ec-befe-036853398716
revision: 4
outputs:
default:
type: elasticsearch
hosts:
- >-
https://REDACTED.asia-northeast1.gcp.cloud.es.io:443
output_permissions:
default:
_elastic_agent_monitoring:
indices:
- names:
- logs-elastic_agent.apm_server-default
privileges: &ref_0
- auto_configure
- create_doc
- names:
- metrics-elastic_agent.apm_server-default
privileges: *ref_0
- names:
- logs-elastic_agent.auditbeat-default
privileges: *ref_0
- names:
- metrics-elastic_agent.auditbeat-default
privileges: *ref_0
- names:
- logs-elastic_agent-default
privileges: *ref_0
- names:
- metrics-elastic_agent.elastic_agent-default
privileges: *ref_0
- names:
- metrics-elastic_agent.endpoint_security-default
privileges: *ref_0
- names:
- logs-elastic_agent.endpoint_security-default
privileges: *ref_0
- names:
- logs-elastic_agent.filebeat-default
privileges: *ref_0
- names:
- metrics-elastic_agent.filebeat-default
privileges: *ref_0
- names:
- logs-elastic_agent.fleet_server-default
privileges: *ref_0
- names:
- metrics-elastic_agent.fleet_server-default
privileges: *ref_0
- names:
- logs-elastic_agent.heartbeat-default
privileges: *ref_0
- names:
- metrics-elastic_agent.heartbeat-default
privileges: *ref_0
- names:
- logs-elastic_agent.metricbeat-default
privileges: *ref_0
- names:
- metrics-elastic_agent.metricbeat-default
privileges: *ref_0
- names:
- logs-elastic_agent.osquerybeat-default
privileges: *ref_0
- names:
- metrics-elastic_agent.osquerybeat-default
privileges: *ref_0
- names:
- logs-elastic_agent.packetbeat-default
privileges: *ref_0
- names:
- metrics-elastic_agent.packetbeat-default
privileges: *ref_0
_elastic_agent_checks:
cluster:
- monitor
prometheus-otel-docker:
indices:
- names:
- metrics-prometheus.collector-default
privileges: *ref_0
agent:
monitoring:
enabled: true
use_output: default
namespace: default
logs: true
metrics: true
inputs:
- id: prometheus/metrics-prometheus-b0d13fc8-b1c4-4ef9-b1c9-2ae8c2e448a2
name: prometheus-otel-docker
revision: 2
type: prometheus/metrics
use_output: default
meta:
package:
name: prometheus
version: 0.7.0
data_stream:
namespace: default
streams:
- id: >-
prometheus/metrics-prometheus.collector-b0d13fc8-b1c4-4ef9-b1c9-2ae8c2e448a2
data_stream:
dataset: prometheus.collector
type: metrics
metrics_filters.exclude: null
password: ''
period: 10s
hosts:
- 'host.docker.internal:9464'
metricsets:
- collector
ssl.certificate_authorities: null
use_types: true
bearer_token_file: ''
metrics_filters.include: null
rate_counters: true
metrics_path: /metrics
username: ''
fleet:
hosts:
- >-
https://REDACTED.fleet.asia-northeast1.gcp.cloud.es.io:443
```

When I do this the logs are full of this error:

```
{"log.level":"error","@timestamp":"2022-04-26T02:34:20.691Z","log.origin":{"file.name":"metrics/metrics.go","file.line":382},"message":"error getting cgroup stats: error fetching stats for controller io: error fetching IO stats: error fetching io.pressure for path /sys/fs/cgroup:: open /sys/fs/cgroup/io.pressure: no such file or directory","ecs.version":"1.6.0"}
```

I see that `agent.monitoring.enabled` is true, so perhaps something in that code is attempting to fetch cgroup io pressure info?

I'm running on macOS with docker for mac on an intel chipset.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.