Got a packet bigger than 'max_allowed_packet' bytes" when executing query occouring regulary


We’re having an issue where every so often we get the following error message dumped in the logs, with the query added after it:

[2020-10-15 08:57:16 +0100] critical/IdoMysqlConnection: Error “Got a packet bigger than ‘max_allowed_packet’ bytes” when executing query

Our database is hosted on a Galera cluster, and the max_allowed_packet size for that is set to 128MB. We have also set this on the client side. It seems that the packets Icinga is trying to send are much less than this, in the order of like 5-10MB.

We’ve noticed this happening more frequently the more often the icinga2 daemon is reloaded - but we can’t really just stop reloading the daemon!

I’ve tried stopping and starting the process and deleting /var/lib/icinga2/icinga2.state with no success.

Has anyone else had a similar issue and been able to solve it? What could we do to stop this please?