About every 4-6 weeks, Icinga Web 2 UI informs us that the backend is not running. I check systemctl and icinga2 is running, with very few children (should have dozens and dozens of plugins running), and a disconnect message in the mysql logs.
In every case, a systemctl restart icinga2 fixes it.
I read through troubleshooting, and to turn on debug I have to do a restart. But since that fixes it, that doesn’t help at all. Also Debug logs about 15M a minute, so it is not practical to leave it running 24/7.
So, questions.
Is there an API or CLI way to turn on debugging?
Is there something else I can do to debug the situation as it happens?