Hello,
the icinga2.service component is failing just some seconds after the restart of the service.
icinga2.log:
[2022-05-06 15:08:57 +0200] information/FileLogger: 'main-log' started.
[2022-05-06 15:08:57 +0200] information/ApiListener: 'api' started.
[2022-05-06 15:08:57 +0200] information/ApiListener: Copying 3 zone configuration files for zone 'ac-data-hln' to '/var/lib/icinga2/api/zones/ac-data-hln'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-data-hln//_etc/helion_fIP_hosts.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-data-hln//_etc/hln_services.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-data-hln//_etc/hln_templates.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Copying 8 zone configuration files for zone 'ac-citrix-zone' to '/var/lib/icinga2/api/zones/ac-citrix-zone'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-citrix-zone//_etc/DEL_citrix_services.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-citrix-zone//_etc/archive_citrix_hosts.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-citrix-zone//_etc/citrix_hosts.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-citrix-zone//_etc/citrix_hosts.conf.bak
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-citrix-zone//_etc/citrix_hosts.conf.base
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-citrix-zone//_etc/citrix_hosts.conf.sample
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-citrix-zone//_etc/citrix_hv.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/ac-citrix-zone//_etc/citrix_templates.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Copying 10 zone configuration files for zone 'otn-icinga-sat-hedvig' to '/var/lib/icinga2/api/zones/otn-icinga-sat-hedvig'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/HPE-HardwareDetails.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/archived_hedvig_hosts.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/archived_hedvig_services.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/hedvig_custom_commands.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/hedvig_hosts.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/hedvig_hosts_dcc2.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/hedvig_services.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/hedvig_services.conf.save
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/hedvig_templates.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/otn-icinga-sat-hedvig//_etc/testhv.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Copying 7 zone configuration files for zone 'k8s-icinga' to '/var/lib/icinga2/api/zones/k8s-icinga'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/k8s-icinga//_etc/archive_k8s_custom_checks.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/k8s-icinga//_etc/archive_k8s_hosts.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/k8s-icinga//_etc/archive_k8s_services.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/k8s-icinga//_etc/k8s_custom_checks.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/k8s-icinga//_etc/k8s_hosts.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/k8s-icinga//_etc/k8s_services.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/k8s-icinga//_etc/k8s_templates.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Copying 5 zone configuration files for zone 'global-templates' to '/var/lib/icinga2/api/zones/global-templates'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/global-templates//_etc/archive_citrix_custom_commands.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/global-templates//_etc/archive_citrix_services.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/global-templates//_etc/commands.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/global-templates//_etc/services.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/global-templates//_etc/templates.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Copying 2 zone configuration files for zone 'icinga2' to '/var/lib/icinga2/api/zones/icinga2'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/icinga2//_etc/hosts/hosts.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Updating configuration file: /var/lib/icinga2/api/zones/icinga2//_etc/hosts/k8s2_bare_metal.conf
[2022-05-06 15:08:57 +0200] information/ApiListener: Started new listener on '[0.0.0.0]:5665'
[2022-05-06 15:08:57 +0200] information/ApiListener: Reconnecting to endpoint 'otn-ac-ics-hfip.infra.localdomain' via host '[ "otn-ac-ics-hfip.infra.localdomain" ]' and port '5665'
[2022-05-06 15:08:57 +0200] information/ApiListener: Reconnecting to endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain' via host 'otn-icinga-sat-citrix.mon.infra.localdomain' and port '5665'
[2022-05-06 15:08:57 +0200] information/ApiListener: Reconnecting to endpoint 'k8s-icinga.localdomain' via host 'k8s-icinga.localdomain' and port '5665'
[2022-05-06 15:08:57 +0200] information/ApiListener: Reconnecting to endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain' via host 'otn-icinga-sat-hedvig.mon.infra.localdomain' and port '5665'
[2022-05-06 15:08:57 +0200] information/ExternalCommandListener: 'command' started.
[2022-05-06 15:08:57 +0200] warning/ExternalCommandListener: This feature is DEPRECATED and may be removed in future releases. Check the roadmap at https://github.com/Icinga/icinga2/milestones
Context:
(0) Activating object 'command' of type 'ExternalCommandListener'
[2022-05-06 15:08:57 +0200] critical/ApiListener: Cannot connect to host '[ "otn-ac-ics-hfip.infra.localdomain" ]' on port '5665': Host not found (authoritative)
[2022-05-06 15:08:57 +0200] information/DbConnection: 'ido-mysql' started.
[2022-05-06 15:08:57 +0200] critical/ApiListener: Cannot connect to host 'otn-icinga-sat-citrix.mon.infra.localdomain' on port '5665': No route to host
[2022-05-06 15:08:57 +0200] information/InfluxdbWriter: 'influxdb' resumed.
[2022-05-06 15:08:57 +0200] information/NotificationComponent: 'notification' started.
[2022-05-06 15:08:57 +0200] information/CheckerComponent: 'checker' started.
[2022-05-06 15:08:57 +0200] information/ConfigItem: Activated all objects.
[2022-05-06 15:08:57 +0200] information/IdoMysqlConnection: 'ido-mysql' resumed.
[2022-05-06 15:08:57 +0200] information/DbConnection: Resuming IDO connection: ido-mysql
[2022-05-06 15:08:57 +0200] information/IdoMysqlConnection: MySQL IDO instance id: 1 (schema version: '1.14.3')
[2022-05-06 15:08:57 +0200] information/ApiListener: New client connection for identity 'otn-icinga-sat-hedvig.mon.infra.localdomain' to [10.116.219.179]:5665
[2022-05-06 15:08:57 +0200] information/ApiListener: Finished reconnecting to endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain' via host 'otn-icinga-sat-hedvig.mon.infra.localdomain' and port '5665'
[2022-05-06 15:08:57 +0200] information/ApiListener: Sending config updates for endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain' in zone 'otn-icinga-sat-hedvig'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Syncing configuration files for zone 'otn-icinga-sat-hedvig' to endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Syncing configuration files for global zone 'global-templates' to endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Finished sending config file updates for endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain' in zone 'otn-icinga-sat-hedvig'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Syncing runtime objects to endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Finished syncing runtime objects to endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Finished sending runtime config updates for endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain' in zone 'otn-icinga-sat-hedvig'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Sending replay log for endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain' in zone 'otn-icinga-sat-hedvig'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Finished sending replay log for endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain' in zone 'otn-icinga-sat-hedvig'.
[2022-05-06 15:08:57 +0200] information/ApiListener: Finished syncing endpoint 'otn-icinga-sat-hedvig.mon.infra.localdomain' in zone 'otn-icinga-sat-hedvig'.
[2022-05-06 15:08:58 +0200] information/IdoMysqlConnection: Finished reconnecting to 'ido-mysql' database 'icinga_ido' in 0.708441 second(s).
[2022-05-06 15:09:00 +0200] information/ApiListener: New client connection for identity 'otn-icinga-sat-citrix.mon.infra.localdomain' from [10.116.219.65]:33638
[2022-05-06 15:09:00 +0200] information/ApiListener: Sending config updates for endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain' in zone 'ac-citrix-zone'.
[2022-05-06 15:09:00 +0200] information/ApiListener: Syncing configuration files for zone 'ac-citrix-zone' to endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain'.
[2022-05-06 15:09:00 +0200] information/JsonRpcConnection: Received certificate request for CN 'otn-icinga-sat-citrix.mon.infra.localdomain' signed by our CA.
[2022-05-06 15:09:00 +0200] information/JsonRpcConnection: The certificate for CN 'otn-icinga-sat-citrix.mon.infra.localdomain' is valid and uptodate. Skipping automated renewal.
[2022-05-06 15:09:00 +0200] information/ApiListener: Syncing configuration files for global zone 'global-templates' to endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain'.
[2022-05-06 15:09:00 +0200] information/ApiListener: Finished sending config file updates for endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain' in zone 'ac-citrix-zone'.
[2022-05-06 15:09:00 +0200] information/ApiListener: Syncing runtime objects to endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain'.
[2022-05-06 15:09:00 +0200] information/ApiListener: Finished syncing runtime objects to endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain'.
[2022-05-06 15:09:00 +0200] information/ApiListener: Finished sending runtime config updates for endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain' in zone 'ac-citrix-zone'.
[2022-05-06 15:09:00 +0200] information/ApiListener: Sending replay log for endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain' in zone 'ac-citrix-zone'.
[2022-05-06 15:09:00 +0200] information/ApiListener: Finished sending replay log for endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain' in zone 'ac-citrix-zone'.
[2022-05-06 15:09:00 +0200] information/ApiListener: Finished syncing endpoint 'otn-icinga-sat-citrix.mon.infra.localdomain' in zone 'ac-citrix-zone'.
[2022-05-06 15:09:01 +0200] information/ApiListener: New client connection for identity 'otn-ac-ics-hfip.infra.localdomain' from [10.116.219.177]:53236
[2022-05-06 15:09:01 +0200] information/ApiListener: Sending config updates for endpoint 'otn-ac-ics-hfip.infra.localdomain' in zone 'ac-data-hln'.
[2022-05-06 15:09:01 +0200] information/ApiListener: Syncing configuration files for zone 'ac-data-hln' to endpoint 'otn-ac-ics-hfip.infra.localdomain'.
[2022-05-06 15:09:01 +0200] information/JsonRpcConnection: Received certificate request for CN 'otn-ac-ics-hfip.infra.localdomain' signed by our CA.
[2022-05-06 15:09:01 +0200] information/JsonRpcConnection: The certificate for CN 'otn-ac-ics-hfip.infra.localdomain' is valid and uptodate. Skipping automated renewal.
[2022-05-06 15:09:01 +0200] information/ApiListener: Syncing configuration files for global zone 'global-templates' to endpoint 'otn-ac-ics-hfip.infra.localdomain'.
[2022-05-06 15:09:01 +0200] information/ApiListener: Finished sending config file updates for endpoint 'otn-ac-ics-hfip.infra.localdomain' in zone 'ac-data-hln'.
[2022-05-06 15:09:01 +0200] information/ApiListener: Syncing runtime objects to endpoint 'otn-ac-ics-hfip.infra.localdomain'.
[2022-05-06 15:09:01 +0200] information/ApiListener: Finished syncing runtime objects to endpoint 'otn-ac-ics-hfip.infra.localdomain'.
[2022-05-06 15:09:01 +0200] information/ApiListener: Finished sending runtime config updates for endpoint 'otn-ac-ics-hfip.infra.localdomain' in zone 'ac-data-hln'.
[2022-05-06 15:09:01 +0200] information/ApiListener: Sending replay log for endpoint 'otn-ac-ics-hfip.infra.localdomain' in zone 'ac-data-hln'.
[2022-05-06 15:09:01 +0200] information/ApiListener: Finished sending replay log for endpoint 'otn-ac-ics-hfip.infra.localdomain' in zone 'ac-data-hln'.
[2022-05-06 15:09:01 +0200] information/ApiListener: Finished syncing endpoint 'otn-ac-ics-hfip.infra.localdomain' in zone 'ac-data-hln'.
[2022-05-06 15:09:02 +0200] information/JsonRpcConnection: Received certificate request for CN 'otn-icinga-sat-hedvig.mon.infra.localdomain' signed by our CA.
[2022-05-06 15:09:02 +0200] information/JsonRpcConnection: The certificate for CN 'otn-icinga-sat-hedvig.mon.infra.localdomain' is valid and uptodate. Skipping automated renewal.
There is also no startup.log file in /var/log/icinga2
icinga2 --version:
icinga2 - The Icinga 2 network monitoring daemon (version: 2.13.2-1)
Copyright (c) 2012-2022 Icinga GmbH (https://icinga.com/)
License GPLv2+: GNU GPL version 2 or later <https://gnu.org/licenses/gpl2.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
System information:
Platform: Red Hat Enterprise Linux Server
Platform version: 7.9 (Maipo)
Kernel: Linux
Kernel version: 3.10.0-1160.53.1.el7.x86_64
Architecture: x86_64
Build information:
Compiler: GNU 4.8.5
Build host: runner-hh8q3bz2-project-322-concurrent-0
OpenSSL version: OpenSSL 1.0.2k-fips 26 Jan 2017
Application information:
General paths:
Config directory: /etc/icinga2
Data directory: /var/lib/icinga2
Log directory: /var/log/icinga2
Cache directory: /var/cache/icinga2
Spool directory: /var/spool/icinga2
Run directory: /run/icinga2
Old paths (deprecated):
Installation root: /usr
Sysconf directory: /etc
Run directory (base): /run
Local state directory: /var
Internal paths:
Package data directory: /usr/share/icinga2
State path: /var/lib/icinga2/icinga2.state
Modified attributes path: /var/lib/icinga2/modified-attributes.conf
Objects path: /var/cache/icinga2/icinga2.debug
Vars path: /var/cache/icinga2/icinga2.vars
PID path: /run/icinga2/icinga2.pid
systemctl status icinga2
root@icinga2:/var/log/icinga2>>systemctl status icinga2 -l
● icinga2.service - Icinga host/service/network monitoring system
Loaded: loaded (/usr/lib/systemd/system/icinga2.service; enabled; vendor preset: disabled)
Active: failed (Result: exit-code) since Fri 2022-05-06 15:09:02 CEST; 3min 20s ago
Process: 9973 ExecReload=/usr/lib/icinga2/safe-reload /etc/sysconfig/icinga2 (code=exited, status=0/SUCCESS)
Process: 14286 ExecStart=/usr/sbin/icinga2 daemon --close-stdio -e ${ICINGA2_ERROR_LOG} (code=exited, status=139)
Process: 14279 ExecStartPre=/usr/lib/icinga2/prepare-dirs /etc/sysconfig/icinga2 (code=exited, status=0/SUCCESS)
Main PID: 14286 (code=exited, status=139)
Status: "Startup finished."
May 06 15:09:02 icinga2 sudo[14592]: pam_unix(sudo:session): session opened for user root by (uid=0)
May 06 15:09:02 icinga2 icinga2[14323]: Ignoring invalid perfdata for checkable 'otncloud-opsh-if1!ncpa_network_linux' and command 'check_ncpa_network' with value: sent={sent}
Context:
(0) Processing check result for 'otncloud-opsh-if1!ncpa_network_linux'
May 06 15:09:02 icinga2 icinga2[14323]: Ignoring invalid perfdata for checkable 'otncloud-opsh-if1!ncpa_network_linux' and command 'check_ncpa_network' with value: received={received}".format(received=calc_data_recv(),
Context:
(0) Processing check result for 'otncloud-opsh-if1!ncpa_network_linux'
May 06 15:09:02 icinga2 icinga2[14323]: Ignoring invalid perfdata for checkable 'otncloud-opsh-if1!ncpa_network_linux' and command 'check_ncpa_network' with value: sent=calc_data_sent())
Context:
(0) Processing check result for 'otncloud-opsh-if1!ncpa_network_linux'
May 06 15:09:02 icinga2 sudo[14606]: icinga : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/lib64/nagios/plugins/check_ncpa.py -H 10.116.220.162 -M services -q service=ClusSvc,service=MSSQL$cloudDB03 -t xxx
May 06 15:09:02 icinga2 sudo[14606]: pam_unix(sudo:session): session opened for user root by (uid=0)
May 06 15:09:02 icinga2 systemd[1]: icinga2.service: main process exited, code=exited, status=139/n/a
May 06 15:09:02 icinga2 systemd[1]: Unit icinga2.service entered failed state.
May 06 15:09:02 icinga2 systemd[1]: icinga2.service failed.
May 06 15:10:06 icinga2 systemd[1]: Unit icinga2.service cannot be reloaded because it is inactive.
CPU, RAM and storage is fine…
May 6 16:49:06 icinga2 icingacli: USAGE: icingacli [module] <command> [action] [options]
May 6 16:49:06 icinga2 icingacli: Available commands:
May 6 16:49:06 icinga2 icingacli: help Help for modules, commands and actions
May 6 16:49:06 icinga2 icingacli: module List and handle modules
May 6 16:49:06 icinga2 icingacli: version Shows version of Icinga Web 2, loaded modules and PHP
May 6 16:49:06 icinga2 icingacli: web
May 6 16:49:06 icinga2 icingacli: Available modules:
May 6 16:49:06 icinga2 icingacli: company
May 6 16:49:06 icinga2 icingacli: cube
May 6 16:49:06 icinga2 icingacli: director
May 6 16:49:06 icinga2 icingacli: doc
May 6 16:49:06 icinga2 icingacli: grafana
May 6 16:49:06 icinga2 icingacli: incubator
May 6 16:49:06 icinga2 icingacli: ipl
May 6 16:49:06 icinga2 icingacli: monitoring
May 6 16:49:06 icinga2 icingacli: reactbundle
May 6 16:49:06 icinga2 icingacli: setup
May 6 16:49:06 icinga2 icingacli: Global options:
May 6 16:49:06 icinga2 icingacli: --log [t] Log to <t>, either stderr, file or syslog (default: stderr)
May 6 16:49:06 icinga2 icingacli: --log-path <f> Which file to log into in case of --log file
May 6 16:49:06 icinga2 icingacli: --verbose Be verbose
May 6 16:49:06 icinga2 icingacli: --debug Show debug output
May 6 16:49:06 icinga2 icingacli: --help Show help
May 6 16:49:06 icinga2 icingacli: --benchmark Show benchmark summary
May 6 16:49:06 icinga2 icingacli: --watch [s] Refresh output every <s> seconds (default: 5)
May 6 16:49:06 icinga2 icingacli: --version Shows version of Icinga Web 2, loaded modules and PHP
May 6 16:49:06 icinga2 icingacli: Show help on a specific command : icingacli help <command>
May 6 16:49:06 icinga2 icingacli: Show help on a specific module : icingacli help <module>
May 6 16:49:06 icinga2 systemd: icinga-vspheredb.service: main process exited, code=exited, status=3/NOTIMPLEMENTED
May 6 16:49:06 icinga2 systemd: Failed to start Icinga vSphereDB Daemon.
May 6 16:49:06 icinga2 systemd: Unit icinga-vspheredb.service entered failed state.
May 6 16:49:06 icinga2 systemd: icinga-vspheredb.service failed.
May 6 16:49:22 icinga2 systemd: Stopped Icinga vSphereDB Daemon.
May 6 16:50:05 icinga2 systemd: Unit icinga2.service cannot be reloaded because it is inactive.
May 6 16:50:05 icinga2 systemd: Reloading.
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:23] Unknown lvalue 'LockPersonality' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:24] Unknown lvalue 'MemoryDenyWriteExecute' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:28] Unknown lvalue 'ProtectClock' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:29] Unknown lvalue 'ProtectControlGroups' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:31] Unknown lvalue 'ProtectHostname' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:32] Unknown lvalue 'ProtectKernelLogs' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:33] Unknown lvalue 'ProtectKernelModules' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:34] Unknown lvalue 'ProtectKernelTunables' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:35] Unknown lvalue 'ProtectProc' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:37] Unknown lvalue 'RemoveIPC' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:39] Unknown lvalue 'RestrictNamespaces' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:40] Unknown lvalue 'RestrictRealtime' in section 'Service'
May 6 16:50:06 icinga2 systemd: [/usr/lib/systemd/system/grafana-server.service:41] Unknown lvalue 'RestrictSUIDSGID' in section 'Service'
May 6 16:50:06 icinga2 systemd: Started Flexible Branding Service.
May 6 16:50:30 icinga2 systemd: Starting Icinga host/service/network monitoring system...
May 6 16:50:30 icinga2 icinga2: [2022-05-06 16:50:30 +0200] information/cli: Icinga application loader (version: 2.13.2-1)
May 6 16:50:30 icinga2 icinga2: [2022-05-06 16:50:30 +0200] information/cli: Loading configuration file(s).
May 6 16:50:30 icinga2 icinga2: [2022-05-06 16:50:30 +0200] information/ConfigItem: Committing config item(s).
May 6 16:50:30 icinga2 icinga2: [2022-05-06 16:50:30 +0200] information/ApiListener: My API identity: icinga2.localdomain
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] warning/ApplyRule: Apply rule 'vsa_network' (in /etc/icinga2/conf.d/services.conf: 15:1-15:27) for type 'Service' does not match anywhere!
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 1 InfluxdbWriter.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 1 SyslogLogger.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 1 NotificationComponent.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 1 IdoMysqlConnection.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 1 ExternalCommandListener.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 1 CheckerComponent.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 4 Users.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 2 UserGroups.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 8 ServiceGroups.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 3 TimePeriods.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 4334 Services.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 7 Zones.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 4 NotificationCommands.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 34 HostGroups.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 7144 Notifications.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 2 Downtimes.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 1 IcingaApplication.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 854 Hosts.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 5 Endpoints.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 40 Comments.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 1 FileLogger.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 5 ApiUsers.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 295 CheckCommands.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ConfigItem: Instantiated 1 ApiListener.
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars'
May 6 16:50:31 icinga2 icinga2: [2022-05-06 16:50:31 +0200] information/cli: Closing console log.
May 6 16:50:31 icinga2 systemd: Started Icinga host/service/network monitoring system.
May 6 16:50:32 icinga2 icinga2: Cannot connect to host '[ "otn-ac-ics-hfip.infra.localdomain" ]' on port '5665': Host not found (authoritative)
May 6 16:50:32 icinga2 icinga2: Cannot connect to host 'otn-icinga-sat-citrix.mon.infra.localdomain' on port '5665': No route to host
May 6 16:50:32 icinga2 icinga2: This feature is DEPRECATED and may be removed in future releases. Check the roadmap at https://github.com/Icinga/icinga2/milestones#012Context:#012#011(0) Activating object 'command' of type 'ExternalCommandListener'
May 6 16:50:32 icinga2 influxd-systemd-start.sh: [httpd] 127.0.0.1 - icinga [06/May/2022:16:50:32 +0200] "POST /write?db=icinga2&p=%5BREDACTED%5D&precision=s&u=icinga HTTP/1.0 " 204 0 "-" "Icinga/2.13.2-1" e1450bd2-cd4b-11ec-80e5-005056a1d026 44435
May 6 16:50:33 icinga2 influxd-systemd-start.sh: [httpd] 127.0.0.1 - icinga [06/May/2022:16:50:33 +0200] "POST /write?db=icinga2&p=%5BREDACTED%5D&precision=s&u=icinga HTTP/1.0 " 204 0 "-" "Icinga/2.13.2-1" e177eb8b-cd4b-11ec-80e6-005056a1d026 11215
May 6 16:50:33 icinga2 influxd-systemd-start.sh: [httpd] 127.0.0.1 - icinga [06/May/2022:16:50:33 +0200] "POST /write?db=icinga2&p=%5BREDACTED%5D&precision=s&u=icinga HTTP/1.0 " 204 0 "-" "Icinga/2.13.2-1" e1a21a13-cd4b-11ec-80e7-005056a1d026 13271
May 6 16:50:33 icinga2 influxd-systemd-start.sh: [httpd] 127.0.0.1 - icinga [06/May/2022:16:50:33 +0200] "POST /write?db=icinga2&p=%5BREDACTED%5D&precision=s&u=icinga HTTP/1.0 " 204 0 "-" "Icinga/2.13.2-1" e1d00bb8-cd4b-11ec-80e8-005056a1d026 5818
May 6 16:50:36 icinga2 icinga2: Ignoring invalid perfdata for checkable 'otncloud-opsh-wr2!ncpa_network_linux' and command 'check_ncpa_network' with value: sent={sent}#012Context:#012#011(0) Processing check result for 'otncloud-opsh-wr2!ncpa_network_linux'
May 6 16:50:36 icinga2 icinga2: Ignoring invalid perfdata for checkable 'otncloud-opsh-wr2!ncpa_network_linux' and command 'check_ncpa_network' with value: received={received}".format(received=calc_data_recv(),#012Context:#012#011(0) Processing check result for 'otncloud-opsh-wr2!ncpa_network_linux'
May 6 16:50:36 icinga2 icinga2: Ignoring invalid perfdata for checkable 'otncloud-opsh-wr2!ncpa_network_linux' and command 'check_ncpa_network' with value: sent=calc_data_sent())#012Context:#012#011(0) Processing check result for 'otncloud-opsh-wr2!ncpa_network_linux'
May 6 16:50:37 icinga2 kernel: icinga2[23446]: segfault at 48 ip 00000000009e4cee sp 00007f9998f025e0 error 4 in icinga2[400000+df9000]
May 6 16:50:37 icinga2 systemd: icinga2.service: main process exited, code=exited, status=139/n/a
May 6 16:50:37 icinga2 systemd: Unit icinga2.service entered failed state.
May 6 16:50:37 icinga2 systemd: icinga2.service failed.