Ola,
We are running icinga2 on Debian 8 and last week graphing suddenly stopped. Then when I tried to switch it on in the feature commands via icinga2 web then icinga2 service stopped. I get the following error message “Monitoring backend ‘icinga’ is not running.”.
When I try to start icinga2 service via command line it fails and here is the icinga2 service status
root@hostname:~# systemctl -l status icinga2.service
● icinga2.service - Icinga host/service/network monitoring system
Loaded: loaded (/lib/systemd/system/icinga2.service; enabled)
Drop-In: /etc/systemd/system/icinga2.service.d
└─limits.conf
Active: failed (Result: exit-code) since Thu 2022-12-01 10:12:00 CAT; 8s ago
Process: 19526 ExecStart=/usr/sbin/icinga2 daemon --close-stdio -e ${ICINGA2_ERROR_LOG} (code=exited, status=1/FAILURE)
Process: 19519 ExecStartPre=/usr/lib/icinga2/prepare-dirs /etc/default/icinga2 (code=exited, status=0/SUCCESS)
Main PID: 19526 (code=exited, status=1/FAILURE)
Dec 01 10:11:59 hostname icinga2[19526]: [2022-12-01 10:11:59 +0200] information/ConfigItem: Instantiated 3 TimePeriods.
Dec 01 10:11:59 hostname icinga2[19526]: [2022-12-01 10:11:59 +0200] information/ConfigItem: Instantiated 3 UserGroups.
Dec 01 10:11:59 hostname icinga2[19526]: [2022-12-01 10:11:59 +0200] information/ConfigItem: Instantiated 17 Users.
Dec 01 10:11:59 hostname icinga2[19526]: [2022-12-01 10:11:59 +0200] information/ConfigItem: Instantiated 5366 Services.
Dec 01 10:11:59 hostname icinga2[19526]: [2022-12-01 10:11:59 +0200] information/ConfigItem: Instantiated 63 ServiceGroups.
Dec 01 10:11:59 hostname icinga2[19526]: [2022-12-01 10:11:59 +0200] information/ConfigItem: Instantiated 1 ScheduledDowntime.
Dec 01 10:11:59 hostname icinga2[19526]: [2022-12-01 10:11:59 +0200] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars'
Dec 01 10:11:59 hostname icinga2[19526]: [2022-12-01 10:11:59 +0200] information/cli: Closing console log.
Dec 01 10:12:00 hostname systemd[1]: icinga2.service: main process exited, code=exited, status=1/FAILURE
Dec 01 10:12:00 hostname systemd[1]: Unit icinga2.service entered failed state.
Storage capacity is also fine
root@hostname:~# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/dm-0 94G 74G 20G 80% /
udev 10M 0 10M 0% /dev
tmpfs 13G 1.4G 12G 11% /run
tmpfs 32G 24K 32G 1% /dev/shm
tmpfs 5.0M 0 5.0M 0% /run/lock
tmpfs 32G 0 32G 0% /sys/fs/cgroup
/dev/sda1 269M 74M 177M 30% /boot
/dev/mapper/system-var 466G 303G 163G 66% /var
/dev/mapper/system-home 9.4G 33M 9.3G 1% /home
Here are some of the requested info:
Icinga2 Version
root@hostname:~# icinga2 --version
icinga2 - The Icinga 2 network monitoring daemon (version: r2.12.2-1)
Copyright (c) 2012-2022 Icinga GmbH (https://icinga.com/)
License GPLv2+: GNU GPL version 2 or later <http://gnu.org/licenses/gpl2.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
System information:
Platform: Debian GNU/Linux
Platform version: 8 (jessie)
Kernel: Linux
Kernel version: 3.16.0-11-amd64
Architecture: x86_64
Build information:
Compiler: GNU 4.9.2
Build host: runner-hh8q3bz2-project-298-concurrent-0
OpenSSL version: OpenSSL 1.0.1t 3 May 2016
Application information:
General paths:
Config directory: /etc/icinga2
Data directory: /var/lib/icinga2
Log directory: /var/log/icinga2
Cache directory: /var/cache/icinga2
Spool directory: /var/spool/icinga2
Run directory: /run/icinga2
Old paths (deprecated):
Installation root: /usr
Sysconf directory: /etc
Run directory (base): /run
Local state directory: /var
Internal paths:
Package data directory: /usr/share/icinga2
State path: /var/lib/icinga2/icinga2.state
Modified attributes path: /var/lib/icinga2/modified-attributes.conf
Objects path: /var/cache/icinga2/icinga2.debug
Vars path: /var/cache/icinga2/icinga2.vars
PID path: /run/icinga2/icinga2.pid
root@hostname:~# icinga2 feature list
Disabled features: elasticsearch gelf graphite icingadb influxdb notification opentsdb perfdata statusdata syslog
Enabled features: api checker command compatlog debuglog ido-mysql livestatus mainlog
Icinga Web 2 Version
2.7.6
Git commit
13d357373e025c5550d4320a5f8ac45ad75ff0d7
PHP Version
5.6.40-0+deb8u12
Git commit date
2021-07-27
icinga2 daemon -C is placed in the next comment, as allowable characters were depleted.
Having looked everywhere on the community and other sources on the internet, I am stuck and not too sure what the issue is.
Your kind assistance is highly appreciated.