Hi,
like many of us these days, we had to migrate our main workload from vmware to hyperv because of the known license politics of broadcom. So far so good. To monitor our new hyperV cluster we went with icinga for windows and the hyperv plugins and api enbaled. While migrating more and more VMs everything looked really fine, until the magic number of physical available cores were passed. We have hyperthreading enabled, so we got 256 Logical Cores out of 128 physical cores. All ifw checks run fast and smooth till the 129th logical core is used. Then all ifw checks get real slow, run into timeouts and even afte pushing the timeout and checkinterval from 3m to 5m, still Checks rum into timeout. Somehow it seems the ifw api is not able to handle hyperthreading threads in the root os, although the load on the hyperv host is only 28%.
Has anyone a hint where to look at when using hyperV and icinga for windows?
Give as much information as you can, e.g.
*** Icinga for Windows output (Show-Icinga)**
Icinga for Windows environment:
Environment configuration:
PowerShell Root => C:\Program Files\WindowsPowerShell\Modules
Icinga for Windows Service Path => C:\Program Files\icinga-framework-service
Icinga for Windows Service User => .\icinga
Icinga for Windows Service Pid => 11376
Icinga for Windows JEA Pid => 16212
Icinga Agent Path => C:\Program Files\ICINGA2
Icinga Agent User => icinga
Defined Default User => \icinga
Icinga Managed User => True
PowerShell Version => 5.1.20348.2652
Operating System => Microsoft Windows Server 2022 Datacenter
Operating System Version => 10.0.20348
JEA Context => IcingaForWindows
JEA Session File => C:\Program Files\WindowsPowerShell\Modules\icinga-powershell-framework\RoleCapabilities\IcingaForWindows.psrc
Api Check Forwarder => True
Debug Mode => False
Icinga for Windows Certificate:
Issuer => CN=Icinga CA
Subject => CN=<hostname.fqdn>
List of configured background daemons on this system:
Start-IcingaServiceCheckDaemon
No arguments defined
Start-IcingaWindowsRESTApi
No arguments defined
List of configured background service checks on this system:
=> Collect Metrics Over Time - Icinga for Windows
No background service checks configured
List of configured repositories on this system. The list order matches the apply order:
Icinga Stable
CloneSource =>
Enabled => True
LocalPath =>
Order => 0
RemotePath => https://packages.icinga.com/IcingaForWindows/stable/ifw.repo.json
UseSCP => False
Installed components on this system:
Component Version Available
agent 2.14.2 2.14.2
apichecks 1.2.0 1.2.0
cluster 1.3.0 1.3.0
framework 1.12.3 1.12.3
hyperv 1.3.0 1.3.0
inventory 1.2.0 1.2.0
plugins 1.12.0 1.12.0
restapi 1.2.0 1.2.0
service 1.2.0 1.2.0
*** Version used (icinga2 --version)**
icinga2 - The Icinga 2 network monitoring daemon (version: r2.14.2-1)
Copyright (c) 2012-2024 Icinga GmbH (https://icinga.com/)
License GPLv2+: GNU GPL version 2 or later https://gnu.org/licenses/gpl2.html
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
System information:
Platform: SLES
Platform version: 15-SP5
Kernel: Linux
Kernel version: 5.14.21-150500.55.73-default
Architecture: x86_64
Build information:
Compiler: GNU 7.5.0
Build host: unknown
OpenSSL version: OpenSSL 1.1.1l-fips 24 Aug 2021 SUSE release 150500.17.34.1
Application information:
General paths:
Config directory: /etc/icinga2
Data directory: /var/lib/icinga2
Log directory: /var/log/icinga2
Cache directory: /var/cache/icinga2
Spool directory: /var/spool/icinga2
Run directory: /run/icinga2
Old paths (deprecated):
Installation root: /usr
Sysconf directory: /etc
Run directory (base): /run
Local state directory: /var
Internal paths:
Package data directory: /usr/share/icinga2
State path: /var/lib/icinga2/icinga2.state
Modified attributes path: /var/lib/icinga2/modified-attributes.conf
Objects path: /var/cache/icinga2/icinga2.debug
Vars path: /var/cache/icinga2/icinga2.vars
PID path: /run/icinga2/icinga2.pid
-
Operating System and version
SLES 15 SP5 -
Enabled features (
icinga2 feature list)
Enabled features: api checker command compatlog icingadb ido-mysql influxdb2 mainlog notification -
Icinga Web 2 version and modules (System - About)
|Icinga Web 2 Version |2.12.1|
|—|—|
|Git Commit |cd2daeb2cb8537c633d343a29eb76c54cd2ebbf2|
|PHP-Version |8.1.29|