Notifications sent during scheduled downtime

After a bit more searching, I suspect this might be the cause: Scheduled downtime in with HA masters

We have a HA solution, with accept_config = false on primary master.