Hi all,
I’ve been looking at this problem for hours now and just cannot find what is wrong.
I have a master and a satellite. In the satellite’s location are a Linux and Windows machine. The satellite, Linux and Windows machine all have a ping 4 service defined. Alle three of them are marked overdue, although all three machines are marked Up.
The master and the machines in the master’s location are working as expected.
Can someone please point me in the right direction?
Kind regards,
Ralph
Hi & welcome Ralph,
please share the host & service config of the problematic checks.
Otherwise this would be just wild guesswork 
Hi log1c,
Thanks for the reply. I’m using director, so I’ll do my very best to provide the info. I get the host info (from the master) with the icinga2 object list command:
Master:
Object 'icinga2-master.gbmeubelen.nl' of type 'Host':
% declared in '/etc/icinga2/conf.d/hosts.conf', lines 18:1-18:20
* __name = "icinga2-master.gbmeubelen.nl"
* action_url = ""
* address = "127.0.0.1"
% = modified in '/etc/icinga2/conf.d/hosts.conf', lines 23:3-23:23
* address6 = "::1"
% = modified in '/etc/icinga2/conf.d/hosts.conf', lines 24:3-24:18
* check_command = "hostalive"
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 19:3-19:29
* check_interval = 60
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 16:3-16:21
* check_period = ""
* check_timeout = null
* command_endpoint = ""
* display_name = "icinga2-master.gbmeubelen.nl"
* enable_active_checks = true
* enable_event_handler = true
* enable_flapping = false
* enable_notifications = true
* enable_passive_checks = true
* enable_perfdata = true
* event_command = ""
* flapping_ignore_states = null
* flapping_threshold = 0
* flapping_threshold_high = 30
* flapping_threshold_low = 25
* groups = [ ]
* icon_image = ""
* icon_image_alt = ""
* max_check_attempts = 3
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 15:3-15:24
* name = "icinga2-master.gbmeubelen.nl"
* notes = ""
* notes_url = ""
* package = "_etc"
* retry_interval = 30
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 17:3-17:22
* source_location
* first_column = 1
* first_line = 18
* last_column = 20
* last_line = 18
* path = "/etc/icinga2/conf.d/hosts.conf"
* templates = [ "icinga2-master.gbmeubelen.nl", "generic-host" ]
% = modified in '/etc/icinga2/conf.d/hosts.conf', lines 18:1-18:20
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 14:1-14:28
* type = "Host"
* vars
* disks
* disk
% = modified in '/etc/icinga2/conf.d/hosts.conf', lines 39:3-41:3
* disk /
% = modified in '/etc/icinga2/conf.d/hosts.conf', lines 42:3-44:3
* disk_partitions = "/"
* http_vhosts
* http
% = modified in '/etc/icinga2/conf.d/hosts.conf', lines 30:3-32:3
* http_uri = "/"
* notification
* mail
% = modified in '/etc/icinga2/conf.d/hosts.conf', lines 47:3-50:3
* groups = [ "icingaadmins" ]
* os = "Linux"
% = modified in '/etc/icinga2/conf.d/hosts.conf', lines 27:3-27:19
* volatile = false
* zone = ""
Satellite:
Object 'icinga2-satellite-GE2.gbmeubelen.nl' of type 'Host':
% declared in '/etc/icinga2/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/hosts.conf', lines 1:0-1:48
* __name = "icinga2-satellite-GE2.gbmeubelen.nl"
* action_url = ""
* address = "10.92.20.74"
% = modified in '/etc/icinga2/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/hosts.conf', lines 4:3-4:25
* address6 = ""
* check_command = "hostalive"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 2:5-2:31
* check_interval = 300
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 4:5-4:23
* check_period = ""
* check_timeout = null
* command_endpoint = ""
* display_name = "icinga2-satellite-GE2.gbmeubelen.nl"
* enable_active_checks = true
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 7:5-7:31
* enable_event_handler = true
* enable_flapping = false
* enable_notifications = true
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 6:5-6:31
* enable_passive_checks = false
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 8:5-8:33
* enable_perfdata = true
* event_command = ""
* flapping_ignore_states = null
* flapping_threshold = 0
* flapping_threshold_high = 30
* flapping_threshold_low = 25
* groups = [ ]
* icon_image = ""
* icon_image_alt = ""
* max_check_attempts = 3
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 3:5-3:28
* name = "icinga2-satellite-GE2.gbmeubelen.nl"
* notes = ""
* notes_url = ""
* package = "_etc"
* retry_interval = 60
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 5:5-5:23
* source_location
* first_column = 0
* first_line = 1
* last_column = 48
* last_line = 1
* path = "/etc/icinga2/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/hosts.conf"
* templates = [ "icinga2-satellite-GE2.gbmeubelen.nl", "linux-agent-GE2", "linux-agent", "linux-host", "standard-host" ]
% = modified in '/etc/icinga2/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/hosts.conf', lines 1:0-1:48
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/host_templates.conf', lines 38:1-38:31
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 28:44-28:70
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 17:43-17:68
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 1:45-1:73
* type = "Host"
* vars
* os = "linux"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 20:5-20:21
* volatile = false
* zone = "icinga2-satellite-GE2.gbmeubelen.nl"
And one of the machines in the satellite zone:
Object 'BackupServerGE2.gbmeubelen.nl' of type 'Host':
% declared in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/hosts.conf', lines 1:0-1:42
* __name = "BackupServerGE2.gbmeubelen.nl"
* action_url = ""
* address = "10.92.20.20"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/hosts.conf', lines 4:5-4:27
* address6 = ""
* check_command = "hostalive"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 2:5-2:31
* check_interval = 300
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 4:5-4:23
* check_period = ""
* check_timeout = null
* command_endpoint = ""
* display_name = "BackupServerGE2.gbmeubelen.nl"
* enable_active_checks = true
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 7:5-7:31
* enable_event_handler = true
* enable_flapping = false
* enable_notifications = true
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 6:5-6:31
* enable_passive_checks = false
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 8:5-8:33
* enable_perfdata = true
* event_command = ""
* flapping_ignore_states = null
* flapping_threshold = 0
* flapping_threshold_high = 30
* flapping_threshold_low = 25
* groups = [ ]
* icon_image = ""
* icon_image_alt = ""
* max_check_attempts = 3
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 3:5-3:28
* name = "BackupServerGE2.gbmeubelen.nl"
* notes = ""
* notes_url = ""
* package = "director"
* retry_interval = 60
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 5:5-5:23
* source_location
* first_column = 0
* first_line = 1
* last_column = 42
* last_line = 1
* path = "/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/hosts.conf"
* templates = [ "BackupServerGE2.gbmeubelen.nl", "linux-agent-GE2", "linux-agent", "linux-host", "standard-host" ]
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/hosts.conf', lines 1:0-1:42
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-satellite-GE2.gbmeubelen.nl/host_templates.conf', lines 38:1-38:31
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 28:44-28:70
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 17:43-17:68
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 1:45-1:73
* type = "Host"
* vars
* os = "linux"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/icinga2-master.gbmeubelen.nl/host_templates.conf', lines 20:5-20:21
* volatile = false
* zone = "icinga2-satellite-GE2.gbmeubelen.nl"
This is the services for the satellite itself:
Object 'icinga2-satellite-GE2.gbmeubelen.nl!ping4' of type 'Service':
% declared in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
* __name = "icinga2-satellite-GE2.gbmeubelen.nl!ping4"
* action_url = ""
* check_command = "ping4"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 29:3-29:25
* check_interval = 60
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 28:3-28:21
* check_period = ""
* check_timeout = null
* command_endpoint = ""
* display_name = "ping4"
* enable_active_checks = true
* enable_event_handler = true
* enable_flapping = false
* enable_notifications = true
* enable_passive_checks = true
* enable_perfdata = true
* event_command = ""
* flapping_ignore_states = null
* flapping_threshold = 0
* flapping_threshold_high = 30
* flapping_threshold_low = 25
* groups = [ ]
* host_name = "icinga2-satellite-GE2.gbmeubelen.nl"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
* icon_image = ""
* icon_image_alt = ""
* max_check_attempts = 5
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 27:3-27:24
* name = "ping4"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
* notes = ""
* notes_url = ""
* package = "_etc"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
* retry_interval = 30
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 29:3-29:22
* source_location
* first_column = 1
* first_line = 26
* last_column = 21
* last_line = 26
* path = "/etc/icinga2/conf.d/services.conf"
* templates = [ "ping4", "generic-service" ]
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 26:1-26:34
* type = "Service"
* vars = null
* volatile = false
* zone = "icinga2-satellite-GE2.gbmeubelen.nl"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
And this of the machine in the satellite zone:
Object 'BackupFromGE2.gbmeubelen.nl!ping4' of type 'Service':
% declared in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
* __name = "BackupFromGE2.gbmeubelen.nl!ping4"
* action_url = ""
* check_command = "ping4"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 29:3-29:25
* check_interval = 60
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 28:3-28:21
* check_period = ""
* check_timeout = null
* command_endpoint = ""
* display_name = "ping4"
* enable_active_checks = true
* enable_event_handler = true
* enable_flapping = false
* enable_notifications = true
* enable_passive_checks = true
* enable_perfdata = true
* event_command = ""
* flapping_ignore_states = null
* flapping_threshold = 0
* flapping_threshold_high = 30
* flapping_threshold_low = 25
* groups = [ ]
* host_name = "BackupFromGE2.gbmeubelen.nl"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
* icon_image = ""
* icon_image_alt = ""
* max_check_attempts = 5
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 27:3-27:24
* name = "ping4"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
* notes = ""
* notes_url = ""
* package = "_etc"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
* retry_interval = 30
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 29:3-29:22
* source_location
* first_column = 1
* first_line = 26
* last_column = 21
* last_line = 26
* path = "/etc/icinga2/conf.d/services.conf"
* templates = [ "ping4", "generic-service" ]
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
% = modified in '/etc/icinga2/conf.d/templates.conf', lines 26:1-26:34
* type = "Service"
* vars = null
* volatile = false
* zone = "icinga2-master.gbmeubelen.nl"
% = modified in '/etc/icinga2/conf.d/services.conf', lines 26:1-26:21
I hope this is the info you requested. As said, newbee…
If I need to provide more info, please let me know.
Thanks for your help!
Kind regards,
Ralph.
One extra remark,
the windows machine in de satellite zone has a disk-windows service defined and that one seems to be working fine:
Object 'ms-mkt-cs1.gbmeubelen.nl!Windows disksX:' of type 'Service':
% declared in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf', lines 1:0-1:64
* __name = "ms-mkt-cs1.gbmeubelen.nl!Windows disksX:"
* action_url = ""
* check_command = "disk-windows"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_templates.conf', lines 11:5-11:34
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf', lines 4:5-4:34
* check_interval = 300
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_templates.conf', lines 3:5-3:23
* check_period = ""
* check_timeout = null
* command_endpoint = "ms-mkt-cs1.gbmeubelen.nl"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_templates.conf', lines 12:5-12:32
* display_name = "Windows disksX:"
* enable_active_checks = true
* enable_event_handler = true
* enable_flapping = false
* enable_notifications = true
* enable_passive_checks = true
* enable_perfdata = true
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_templates.conf', lines 5:5-5:26
* event_command = ""
* flapping_ignore_states = null
* flapping_threshold = 0
* flapping_threshold_high = 30
* flapping_threshold_low = 25
* groups = [ ]
* host_name = "ms-mkt-cs1.gbmeubelen.nl"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf', lines 1:0-1:64
* icon_image = ""
* icon_image_alt = ""
* max_check_attempts = 3
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_templates.conf', lines 2:5-2:28
* name = "Windows disksX:"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf', lines 1:0-1:64
* notes = ""
* notes_url = ""
* package = "director"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf', lines 1:0-1:64
* retry_interval = 60
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_templates.conf', lines 4:5-4:23
* source_location
* first_column = 0
* first_line = 1
* last_column = 64
* last_line = 1
* path = "/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf"
* templates = [ "Windows disksX:", "dir-disk-windows", "dir-generic-service", "host var overrides (Director)" ]
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf', lines 1:0-1:64
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_templates.conf', lines 8:1-8:35
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_templates.conf', lines 1:0-1:37
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/001-director-basics.conf', lines 28:3-28:43
* type = "Service"
* vars
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/001-director-basics.conf', lines 41:7-41:51
* disk_win_path = "X:"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf', lines 6:5-6:31
* win_disks = [ "c" ]
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf', lines 7:5-7:28
* volatile = false
* zone = "icinga2-satellite-GE2.gbmeubelen.nl"
% = modified in '/var/lib/icinga2/api/packages/director/cf0be6b5-9898-4095-ac88-30eb75d92269/zones.d/director-global/service_apply.conf', lines 1:0-1:64
hi, you should share your configfiles, they are a lot easier to read.
is your checker feature enabled on the satelites?
Hi Rafael,
thank you. This is de config on the satellite:
root@icinga2-satellite-GE2:~# icinga2 feature list
Disabled features: command compatlog debuglog elasticsearch gelf graphite icingadb influxdb influxdb2 journald livestatus notification opentsdb perfdata syslog
Enabled features: api checker mainlog
I would be happy to share the config files, but I’m using Director, so could you please point me in the right direction on where to find these files? I’m under the impression that /etc/icinga2/… does not contain all the data…
Regards,
Ralph.
/var/lib/icinga2/api/… this folder is under programdata in windows. If you use the agents as satelites, i find it quite hard to configure zones with the director. I always configure the zones on the satelites and master for myself. Where i define the master zone, his satellitezone and the globla zones. I’am pretty sure this was official best practise a while ago, but i can be wrong. If you run the director kickstart wizard afterwards, director will learn about the new satellite.
You can use the “Preview” tab there to view the rendered config.
Correct. Only the config master should have configuration under /etc/icinga2/zones.d or /etc/icinga2/conf.d
see: Technical Concepts - Icinga 2
@Ralph please check the markdown guide for future posts to improve readability. You might also want to remove sensitive information (like fqdns) from your post.
Correct. Defining the master/satellite/global zones in the zones.conf files on the respective systems is the way to go.
Doing that in the Director can lead to problems.
As to the problem:
Both are service config from the default conf.d/services.conf file. This is basically just an example check file.
Recommendation would be to not use any of the default configs under conf.d (the icinga2 node wizard should disable the import of those files by default) and define them in the Director or move the file to the zones.d/<satellite zone> directory, that should work.
Hi Log1c,
Thank you very much! Removing the apply for the conf.d/services.conf file and moving it to director:
zones.d/director-global/service_apply.conf
apply Service "Ping4" {
check_command = "ping4"
max_check_attempts = "3"
check_interval = 5m
retry_interval = 1m
enable_perfdata = true
assign where host.address
import DirectorOverrideTemplate
}
did the trick!
Thank you very much. Learning every day…
Kind regards,
Ralph.