are there any guidelines or benchmarks regarding server resources (cpu, ram) relative to the number of hosts/services being monitored. e.g. zone with satellites having X cpu, Y ram should be able to handle A hosts and/or B services.
we are looking to set up a new environment using reduced server resource in favor of more horizontal scaling of satellite zones but need some help determining “right-sizing” the resources. i.e. we want more, smaller satellites, but how small?
our current environment:
Ubuntu 16.04.6 LTS (Xenial Xerus)
12 zones with 2 satellites (24 total)
total hosts = 18824
total services = 164013
zones are checking anywhere from a max 2011/18070 host/service with “middle” between 1820/16400 and 1643/13336 to a minimum 1246/10794 (new zone to scale/rebalance)
load on satellites ranges from high 9’s to low 3’s but typically in the 6-8 range and does not appear to hamper monitoring.
in addition, the new environment will not use the icingaweb dashboard and only 1 master. other than ‘single point of failure’ are there other considerations/cautions for a single master with multiple satellite zones?