Hello everyone!
After upgrading the server’s OS from Debian 10 to Debian 12, I’ve been facing an issue with two Nagios plugins: check_apt and a custom plugin that queries a database to check active users. The other plugins appear to be working fine.
check_apt
But then:
custom plugin
It shows 12 users
But then:
Is not sending anything to the database where the plugin output is collected.
What we have tested so far:
1- The plugin works correctly when executed locally as nagios user
sudo -u nagios /usr/lib/nagios/plugins/check_apt
2- Certificates are properly signed by the CA:
icinga2 pki verify --cert / --cacert
3- Firewall allows port 5665 (also there are plugins that work)
4- Reinstalled the node using the wizard.
5- Checked the permissions for the user that queries the database, and they are correct.
Thank you in advance!
Version used :
-
In node:
version: r2.13.6-1 -
In master:
version: r2.13.6-1
Operating System and version:
-
In node:
Debian GNU/Linux 12 (bookworm) -
In master:
Debian GNU/Linux 12 (bookworm)
Enabled features :
- In node:
Disabled features: command compatlog elasticsearch gelf graphite icingadb influxdb influxdb2 livestatus notification opentsdb perfdata statusdata syslog
Enabled features: api checker debuglog mainlog
- In master:
Disabled features: compatlog elasticsearch gelf graphite icingadb influxdb2 livestatus opentsdb perfdata statusdata syslog
Enabled features: api checker command debuglog ido-mysql influxdb mainlog notification
Icinga Web 2 version and modules:
Config validation:
- In node:
[2025-03-25 15:39:43 +0100] information/cli: Icinga application loader (version: r2.13.6-1)
[2025-03-25 15:39:43 +0100] information/cli: Loading configuration file(s).
[2025-03-25 15:39:43 +0100] information/ConfigItem: Committing config item(s).
[2025-03-25 15:39:43 +0100] information/ApiListener: My API identity: xx.xx.net
[2025-03-25 15:39:43 +0100] warning/ApplyRule: Apply rule 'mail-icingaadmin' (in /var/lib/icinga2/api/zones/global-templates/_etc/notifications.conf: 21:1-21:48) for type 'Notification' does not match anywhere!
[2025-03-25 15:39:43 +0100] warning/ApplyRule: Apply rule 'telegram-notification' (in /var/lib/icinga2/api/zones/global-templates/_etc/notifications.conf: 41:1-41:53) for type 'Notification' does not match anywhere!
[2025-03-25 15:39:43 +0100] warning/ApplyRule: Apply rule 'mail-icingaadmin' (in /var/lib/icinga2/api/zones/global-templates/_etc/notifications.conf: 11:1-11:45) for type 'Notification' does not match anywhere!
[2025-03-25 15:39:43 +0100] warning/ApplyRule: Apply rule 'telegram-notification' (in /var/lib/icinga2/api/zones/global-templates/_etc/notifications.conf: 32:1-32:50) for type 'Notification' does not match anywhere!
[2025-03-25 15:39:43 +0100] warning/ApplyRule: Apply rule 'backup-downtime' (in /var/lib/icinga2/api/zones/global-templates/_etc/downtimes.conf: 5:1-5:52) for type 'ScheduledDowntime' does not match anywhere!
[2025-03-25 15:39:43 +0100] warning/ApplyRule: Apply rule 'load-downtime' (in /var/lib/icinga2/api/zones/global-templates/_etc/downtimes.conf: 26:1-26:50) for type 'ScheduledDowntime' does not match anywhere!
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 1 CheckerComponent.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 1 UserGroup.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 3 TimePeriods.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 2 Users.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 6 ServiceGroups.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 4 Zones.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 4 NotificationCommands.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 1 IcingaApplication.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 4 HostGroups.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 2 Endpoints.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 2 FileLoggers.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 3 ApiUsers.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 248 CheckCommands.
[2025-03-25 15:39:43 +0100] information/ConfigItem: Instantiated 1 ApiListener.
[2025-03-25 15:39:43 +0100] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars'
[2025-03-25 15:39:43 +0100] information/cli: Finished validating the configuration file(s).
- In master:
[2025-03-25 15:41:04 +0100] information/cli: Icinga application loader (version: r2.13.6-1)
[2025-03-25 15:41:04 +0100] information/cli: Loading configuration file(s).
[2025-03-25 15:41:04 +0100] information/ConfigItem: Committing config item(s).
[2025-03-25 15:41:04 +0100] information/ApiListener: My API identity: monitor.com
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 1 InfluxdbWriter.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 1 NotificationComponent.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 1 IdoMysqlConnection.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 1 ExternalCommandListener.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 1 CheckerComponent.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 1 UserGroup.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 3 TimePeriods.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 2 Users.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 97 Services.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 6 ServiceGroups.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 44 ScheduledDowntimes.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 67 Zones.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 4 NotificationCommands.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 194 Notifications.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 15 Hosts.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 1 IcingaApplication.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 4 HostGroups.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 1 Comment.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 44 Downtimes.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 66 Endpoints.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 2 FileLoggers.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 3 ApiUsers.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 248 CheckCommands.
[2025-03-25 15:41:04 +0100] information/ConfigItem: Instantiated 1 ApiListener.
[2025-03-25 15:41:04 +0100] information/ScriptGlobal: Dumping variables to file '/var/cache/icinga2/icinga2.vars'
[2025-03-25 15:41:04 +0100] information/cli: Finished validating the configuration file(s).
If you run multiple Icinga 2 instances, the zones.conf file (or icinga2 object list --type Endpoint and icinga2 object list --type Zone) from all affected nodes:
- In node:
/*
* Generated by Icinga 2 node setup commands
* on 2025-03-25 13:39:18 +0100
*/
object Endpoint "monitor.com" {
host = "xx.xx.xx.xx"
port = "5665"
}
object Zone "master" {
endpoints = [ "monitor.com" ]
}
object Endpoint "xx.xx.net" {
}
object Zone "xx.xx.net" {
endpoints = [ "xx.xx.net" ]
parent = "master"
}
object Zone "global-templates" {
global = true
}
object Zone "director-global" {
global = true
}
- In master:
Object 'xx.xx.net' of type 'Endpoint':
% declared in '/etc/icinga2/zones.conf', lines 523:1-523:39
* __name = "xx.xx.net"
* host = ""
* log_duration = 86400
* name = "xx.xx.net"
* package = "_etc"
* port = "5665"
* source_location
* first_column = 1
* first_line = 523
* last_column = 39
* last_line = 523
* path = "/etc/icinga2/zones.conf"
* templates = [ "xx.xx.net" ]
% = modified in '/etc/icinga2/zones.conf', lines 523:1-523:39
* type = "Endpoint"
* zone = ""