Icinga / Icinga/icinga2

Icinga2 CPU utilization went up after updating to 2.13.5 for both Master and Satellite server (EC2 instance on AWS)

Open
#9,531 7 comments 0 reactions 1 assignee View on GitHub

@Prathameshhankare is already working on this.

Since May 2, 2023.

needs feedback
Dominant language
C++
Stars
2.2k
Forks
616
Avg merge
5d 6h
Merged PRs (30d)
10

Description

Describe the bug

After upgrading the Icinga2 master and the satellite server the CPU utilization started to raise. Before the upgrade, the CPU utilization was below 20% avg and now after the upgrade, the CPU utilization is at 40% avg.

I tried looking for logs and I am unable to find the exact reason for the sudden raise in CPU utilization.

Your Environment

`
icinga2 - The Icinga 2 network monitoring daemon (version: r2.13.5-1)

Copyright (c) 2012-2022 Icinga GmbH (https://icinga.com/)
License GPLv2+: GNU GPL version 2 or later https://gnu.org/licenses/gpl2.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.

System information:
Platform: CentOS Linux
Platform version: 7 (Core)
Kernel: Linux
Kernel version: 3.10.0-1160.76.1.el7.x86_64
Architecture: x86_64

Build information:
Compiler: GNU 11.2.1
Build host: runner-hh8q3bz2-project-322-concurrent-0
OpenSSL version: OpenSSL 1.0.2k-fips 26 Jan 2017

Application information:

General paths:
Config directory: /etc/icinga2
Data directory: /var/lib/icinga2
Log directory: /var/log/icinga2
Cache directory: /var/cache/icinga2
Spool directory: /var/spool/icinga2
Run directory: /run/icinga2

Old paths (deprecated):
Installation root: /usr
Sysconf directory: /etc
Run directory (base): /run
Local state directory: /var

Internal paths:
Package data directory: /usr/share/icinga2
State path: /var/lib/icinga2/icinga2.state
Modified attributes path: /var/lib/icinga2/modified-attributes.conf
Objects path: /var/cache/icinga2/icinga2.debug
Vars path: /var/cache/icinga2/icinga2.vars
PID path: /run/icinga2/icinga2.pid
icinga2 feature list
Disabled features: compatlog debuglog elasticsearch gelf icingadb influxdb influxdb2 livestatus opentsdb perfdata statusdata syslog
Enabled features: api checker command graphite ido-mysql mainlog notification
icinga2 daemon -C
[2022-09-29 09:01:07 +0000] information/cli: Icinga application loader (version: r2.13.5-1)
[2022-09-29 09:01:07 +0000] information/cli: Loading configuration file(s).
[2022-09-29 09:01:07 +0000] warning/config: Ignoring directory '/var/lib/icinga2/api/zones/IC-Satellite-Server' for unknown zone 'IC-Satellite-Server'.
[2022-09-29 09:01:07 +0000] warning/config: Ignoring directory '/var/lib/icinga2/api/zones/IT Satellite' for unknown zone 'IT Satellite'.
[2022-09-29 09:01:07 +0000] warning/config: Ignoring directory '/var/lib/icinga2/api/zones/ITALY' for unknown zone 'ITALY'.
[2022-09-29 09:01:07 +0000] warning/config: Ignoring directory '/var/lib/icinga2/api/zones/ITSUPSAT01-Satellite' for unknown zone 'ITSUPSAT01-Satellite'.
[2022-09-29 09:01:07 +0000] information/ConfigItem: Committing config item(s).
[2022-09-29 09:01:07 +0000] information/ApiListener: My API identity: EUAWSICN01
[2022-09-29 09:01:17 +0000] information/WorkQueue: #5 (DaemonUtility::LoadConfigFiles) items: 0, rate: 4.7/s (282/min 282/5min 282/15min);
[2022-09-29 09:01:17 +0000] information/WorkQueue: #6 (GraphiteWriter, graphite) items: 0, rate: 0/s (0/min 0/5min 0/15min);
[2022-09-29 09:01:17 +0000] information/WorkQueue: #8 (ApiListener, RelayQueue) items: 0, rate: 0/s (0/min 0/5min 0/15min);
[2022-09-29 09:01:17 +0000] information/WorkQueue: #9 (ApiListener, SyncQueue) items: 0, rate: 0/s (0/min 0/5min 0/15min);
[2022-09-29 09:01:26 +0000] warning/ApplyRule: Apply rule 'backup-downtime' (in /etc/icinga2/conf.d/downtimes.conf: 5:1-5:52) for type 'ScheduledDowntime' does not match anywhere!
[2022-09-29 09:01:26 +0000] warning/ApplyRule: Apply rule 'ping4' (in /etc/icinga2/conf.d/services.conf: 27:1-27:21) for type 'Service' does not match anywhere!
[2022-09-29 09:01:26 +0000] warning/ApplyRule: Apply rule 'swap' (in /etc/icinga2/conf.d/services.conf: 105:1-105:20) for type 'Service' does not match anywhere!
[2022-09-29 09:01:26 +0000] warning/ApplyRule: Apply rule 'Disk_Windows' (in /var/lib/icinga2/api/packages/director/f1f0f134-fb03-4e57-a651-c5ee155857b1/zones.d/director-global/service_apply.conf: 41:1-41:28) for type 'Service' does not match anywhere!
[2022-09-29 09:01:26 +0000] warning/ApplyRule: Apply rule 'Memcached Service' (in /var/lib/icinga2/api/packages/director/f1f0f134-fb03-4e57-a651-c5ee155857b1/zones.d/director-global/service_apply.conf: 105:1-105:33) for type 'Service' does not match anywhere!
[2022-09-29 09:01:26 +0000] warning/ApplyRule: Apply rule 'MySQL Service' (in /var/lib/icinga2/api/packages/director/f1f0f134-fb03-4e57-a651-c5ee155857b1/zones.d/director-global/service_apply.conf: 149:1-149:29) for type 'Service' does not match anywhere!
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 1 GraphiteWriter.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 1 NotificationComponent.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 1 IdoMysqlConnection.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 1 ExternalCommandListener.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 1 CheckerComponent.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 5 UserGroups.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 7 TimePeriods.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 9 Users.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 20836 Services.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 27 ServiceGroups.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 793 Zones.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 7 NotificationCommands.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 10587 Notifications.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 2044 Hosts.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 1 IcingaApplication.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 103 HostGroups.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 296 Comments.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 1 Downtime.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 790 Endpoints.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 1 FileLogger.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 4 ApiUsers.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 271 CheckCommands.
[2022-09-29 09:01:26 +0000] information/ConfigItem: Instantiated 1 ApiListener.
[2022-09-29 09:01:26 +0000] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars'
[2022-09-29 09:01:26 +0000] information/cli: Finished validating the configuration file(s).
`

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.