Clients not showing up on master. No errors encoutnered. New deployment

Icinga 2
1

Hi community

I am a noob with Icinga so I am sure I am missing something. The installation of the master, and client was flawless. I received no errors, as I wsas able to follow the debaian steps for deployment using your documetnations here Installation - Icinga 2

I am trying a very simple setup in a lab. Basically one master, adn one client. I have completed the node wizard to setup the master, and the node wizard to setup the client. Once completed and all services are restarted I do not get the new client in the icinga web 2. I don’t even get any errors or warnings in the log files whenever I restart the client. Any help here would be much appreciated, as I have now eliminated all errors, and have no clue where to go from here.

I also have full communications between the two hosts, I have been able to telnet on port 5665 in both directions.

  • Version used (icinga2 --version)
    The Icinga 2 network monitoring daemon (version: r2.10.3-1)
  • Operating System and version
    System information:

Platform: Debian GNU/Linux
Platform version: 10 (buster)
Kernel: Linux
Kernel version: 4.19.0-14-cloud-amd64
Architecture: x86_64

Build information:
Compiler: GNU 8.3.0
Build host: anubis

  • Enabled features (icinga2 feature list)

Enabled features: api checker ido-mysql mainlog notification

  • Icinga Web 2 version and modules (System - About)

Icinga Web 2 Version
2.8.2

  • Config validation (icinga2 daemon -C)

[2021-02-24 01:25:48 +0000] information/cli: Icinga application loader (version: r2.10.3-1)
[2021-02-24 01:25:48 +0000] information/cli: Loading configuration file(s).
[2021-02-24 01:25:48 +0000] information/ConfigItem: Committing config item(s).
[2021-02-24 01:25:48 +0000] information/ApiListener: My API identity: icinga-mon.c.vs-it-prod-1564108091670.internal
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 NotificationComponent.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 IdoMysqlConnection.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 CheckerComponent.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 UserGroup.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 3 TimePeriods.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 ScheduledDowntime.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 User.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 4 Zones.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 3 ServiceGroups.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 12 Services.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 2 HostGroups.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 Host.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 2 NotificationCommands.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 13 Notifications.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 IcingaApplication.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 2 Endpoints.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 Downtime.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 FileLogger.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 215 CheckCommands.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 ApiUser.
[2021-02-24 01:25:48 +0000] information/ConfigItem: Instantiated 1 ApiListener.
[2021-02-24 01:25:48 +0000] information/ScriptGlobal: Dumping variables to file ‘/var/cache/icinga2/icinga2.vars’
[2021-02-24 01:25:48 +0000] information/cli: Finished validating the configuration file(s).

  • If you run multiple Icinga 2 instances, the zones.conf file (or icinga2 object list --type Endpoint and icinga2 object list --type Zone) from all affected nodes

Endpoints

Object ‘icinga-mon.c.vs-it-prod-1564108091670.internal’ of type ‘Endpoint’:
% declared in ‘/etc/icinga2/zones.conf’, lines 6:1-6:64

  • __name = “icinga-mon.c.vs-it-prod-1564108091670.internal”
  • host = “10.128.0.10”
    % = modified in ‘/etc/icinga2/zones.conf’, lines 7:2-7:21
  • log_duration = 86400
  • name = “icinga-mon.c.vs-it-prod-1564108091670.internal”
  • package = “_etc”
  • port = “5665”
  • source_location
    • first_column = 1
    • first_line = 6
    • last_column = 64
    • last_line = 6
    • path = “/etc/icinga2/zones.conf”
  • templates = [ “icinga-mon.c.vs-it-prod-1564108091670.internal” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 6:1-6:64
  • type = “Endpoint”
  • zone = “”

Object ‘lin1.c.vs-it-prod-1564108091670.internal’ of type ‘Endpoint’:
% declared in ‘/etc/icinga2/zones.conf’, lines 29:1-29:58

  • __name = “lin1.c.vs-it-prod-1564108091670.internal”
  • host = “10.128.0.11”
    % = modified in ‘/etc/icinga2/zones.conf’, lines 30:3-30:22
  • log_duration = 86400
  • name = “lin1.c.vs-it-prod-1564108091670.internal”
  • package = “_etc”
  • port = “5665”
  • source_location
    • first_column = 1
    • first_line = 29
    • last_column = 58
    • last_line = 29
    • path = “/etc/icinga2/zones.conf”
  • templates = [ “lin1.c.vs-it-prod-1564108091670.internal” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 29:1-29:58
  • type = “Endpoint”
  • zone = “”

Zones

Object ‘icinga-mon.c.vs-it-prod-1564108091670.internal’ of type ‘Endpoint’:
% declared in ‘/etc/icinga2/zones.conf’, lines 6:1-6:64

  • __name = “icinga-mon.c.vs-it-prod-1564108091670.internal”
  • host = “10.128.0.10”
    % = modified in ‘/etc/icinga2/zones.conf’, lines 7:2-7:21
  • log_duration = 86400
  • name = “icinga-mon.c.vs-it-prod-1564108091670.internal”
  • package = “_etc”
  • port = “5665”
  • source_location
    • first_column = 1
    • first_line = 6
    • last_column = 64
    • last_line = 6
    • path = “/etc/icinga2/zones.conf”
  • templates = [ “icinga-mon.c.vs-it-prod-1564108091670.internal” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 6:1-6:64
  • type = “Endpoint”
  • zone = “”

Object ‘lin1.c.vs-it-prod-1564108091670.internal’ of type ‘Endpoint’:
% declared in ‘/etc/icinga2/zones.conf’, lines 29:1-29:58

  • __name = “lin1.c.vs-it-prod-1564108091670.internal”
  • host = “10.128.0.11”
    % = modified in ‘/etc/icinga2/zones.conf’, lines 30:3-30:22
  • log_duration = 86400
  • name = “lin1.c.vs-it-prod-1564108091670.internal”
  • package = “_etc”
  • port = “5665”
  • source_location
    • first_column = 1
    • first_line = 29
    • last_column = 58
    • last_line = 29
    • path = “/etc/icinga2/zones.conf”
  • templates = [ “lin1.c.vs-it-prod-1564108091670.internal” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 29:1-29:58
  • type = “Endpoint”
  • zone = “”
    root@icinga-mon:/etc/icinga2# ^C
    root@icinga-mon:/etc/icinga2# ^C
    root@icinga-mon:/etc/icinga2# ^C
    root@icinga-mon:/etc/icinga2# icinga2 object list --type zone
    Object ‘director-global’ of type ‘Zone’:
    % declared in ‘/etc/icinga2/zones.conf’, lines 18:1-18:29
  • __name = “director-global”
  • endpoints = null
  • global = true
    % = modified in ‘/etc/icinga2/zones.conf’, lines 19:2-19:14
  • name = “director-global”
  • package = “_etc”
  • parent = “”
  • source_location
    • first_column = 1
    • first_line = 18
    • last_column = 29
    • last_line = 18
    • path = “/etc/icinga2/zones.conf”
  • templates = [ “director-global” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 18:1-18:29
  • type = “Zone”
  • zone = “”

Object ‘lin1.c.vs-it-prod-1564108091670.internal’ of type ‘Zone’:
% declared in ‘/etc/icinga2/zones.conf’, lines 22:1-22:54

  • __name = “lin1.c.vs-it-prod-1564108091670.internal”
  • endpoints = [ “lin1.c.vs-it-prod-1564108091670.internal” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 23:3-23:60
  • global = false
  • name = “lin1.c.vs-it-prod-1564108091670.internal”
  • package = “_etc”
  • parent = “master”
    % = modified in ‘/etc/icinga2/zones.conf’, lines 25:3-25:19
  • source_location
    • first_column = 1
    • first_line = 22
    • last_column = 54
    • last_line = 22
    • path = “/etc/icinga2/zones.conf”
  • templates = [ “lin1.c.vs-it-prod-1564108091670.internal” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 22:1-22:54
  • type = “Zone”
  • zone = “”

Object ‘master’ of type ‘Zone’:
% declared in ‘/etc/icinga2/zones.conf’, lines 10:1-10:20

  • __name = “master”
  • endpoints = [ “icinga-mon.c.vs-it-prod-1564108091670.internal” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 11:2-11:65
  • global = false
  • name = “master”
  • package = “_etc”
  • parent = “”
  • source_location
    • first_column = 1
    • first_line = 10
    • last_column = 20
    • last_line = 10
    • path = “/etc/icinga2/zones.conf”
  • templates = [ “master” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 10:1-10:20
  • type = “Zone”
  • zone = “”

Object ‘global-templates’ of type ‘Zone’:
% declared in ‘/etc/icinga2/zones.conf’, lines 14:1-14:30

  • __name = “global-templates”
  • endpoints = null
  • global = true
    % = modified in ‘/etc/icinga2/zones.conf’, lines 15:2-15:14
  • name = “global-templates”
  • package = “_etc”
  • parent = “”
  • source_location
    • first_column = 1
    • first_line = 14
    • last_column = 30
    • last_line = 14
    • path = “/etc/icinga2/zones.conf”
  • templates = [ “global-templates” ]
    % = modified in ‘/etc/icinga2/zones.conf’, lines 14:1-14:30
  • type = “Zone”
  • zone = “”

Logs when I restart the client, forcing a reconnect to the master.

[2021-02-24 02:27:20 +0000] information/WorkQueue: #5 (IdoMysqlConnection, ido-mysql) items: 6, rate: 2.98333/s (179/min 931/5min 36114/15min);
[2021-02-24 02:27:25 +0000] warning/TlsStream: TLS stream was disconnected.
[2021-02-24 02:27:25 +0000] warning/JsonRpcConnection: API client disconnected for identity ‘lin1.c.vs-it-prod-1564108091670.internal’
[2021-02-24 02:27:25 +0000] warning/ApiListener: Removing API client for endpoint ‘lin1.c.vs-it-prod-1564108091670.internal’. 0 API clients left.
[2021-02-24 02:27:25 +0000] information/ApiListener: New client connection for identity ‘lin1.c.vs-it-prod-1564108091670.internal’ from [10.128.0.11]:37036
[2021-02-24 02:27:25 +0000] information/ApiListener: Sending config updates for endpoint ‘lin1.c.vs-it-prod-1564108091670.internal’ in zone ‘lin1.c.vs-it-prod-1564108091670.internal’.
[2021-02-24 02:27:25 +0000] information/ApiListener: Finished sending config file updates for endpoint ‘lin1.c.vs-it-prod-1564108091670.internal’ in zone ‘lin1.c.vs-it-prod-1564108091670.internal’.
[2021-02-24 02:27:25 +0000] information/ApiListener: Syncing runtime objects to endpoint ‘lin1.c.vs-it-prod-1564108091670.internal’.
[2021-02-24 02:27:25 +0000] information/ApiListener: Finished syncing runtime objects to endpoint ‘lin1.c.vs-it-prod-1564108091670.internal’.
[2021-02-24 02:27:25 +0000] information/ApiListener: Finished sending runtime config updates for endpoint ‘lin1.c.vs-it-prod-1564108091670.internal’ in zone ‘lin1.c.vs-it-prod-1564108091670.internal’.
[2021-02-24 02:27:25 +0000] information/ApiListener: Sending replay log for endpoint ‘lin1.c.vs-it-prod-1564108091670.internal’ in zone ‘lin1.c.vs-it-prod-1564108091670.internal’.
[2021-02-24 02:27:25 +0000] information/ApiListener: Finished sending replay log for endpoint ‘lin1.c.vs-it-prod-1564108091670.internal’ in zone ‘lin1.c.vs-it-prod-1564108091670.internal’.
[2021-02-24 02:27:25 +0000] information/ApiListener: Finished syncing endpoint ‘lin1.c.vs-it-prod-1564108091670.internal’ in zone ‘lin1.c.vs-it-prod-1564108091670.internal’.
[2021-02-24 02:27:26 +0000] information/JsonRpcConnection: Received certificate request for CN ‘lin1.c.vs-it-prod-1564108091670.internal’ signed by our CA.
[2021-02-24 02:27:26 +0000] information/JsonRpcConnection: The certificate for CN ‘lin1.c.vs-it-prod-1564108091670.internal’ is valid and uptodate. Skipping automated renewal.
[2021-02-24 02:27:30 +0000] information/WorkQueue: #5 (IdoMysqlConnection, ido-mysql) items: 8, rate: 3.01667/s (181/min 933/5min 36112/15min);
[2021-02-24 02:27:40 +0000] information/WorkQueue: #5 (IdoMysqlConnection, ido-mysql) items: 6, rate: 3.01667/s (181/min 933/5min 36114/15min);

2

Hi @techninja80

It looks like you created the zones and endpoints correctly, but you didn’t create a host object for the new client/agent. This doc entry may help.

Kind regards

2 Likes
3

Thanks, mate. You were spot on. The host is up and alive, thank you for putting me in the right direction. Again many thanks.

1 Like