[00:06:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 6.48, 4.32, 2.67
[01:46:49] <icinga-miraheze>	 RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK
[01:50:49] <icinga-miraheze>	 PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical]
[03:01:29] <icinga-miraheze>	 RECOVERY - mon141 Backups Grafana on mon141 is OK: FILE_AGE OK: /var/log/grafana-backup.log is 72 seconds old and 92 bytes
[04:28:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.40, 2.93, 3.71
[04:32:10] <icinga-miraheze>	 RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 3.31, 2.57, 3.34
[04:49:48] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.72, 3.58, 3.46
[04:51:46] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.17, 3.84, 3.57
[04:53:44] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.26, 3.65, 3.54
[04:55:42] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.72, 4.04, 3.69
[05:13:23] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.01, 3.73, 3.95
[05:15:21] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.24, 3.79, 3.94
[05:19:17] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 2.73, 3.60, 3.87
[05:21:15] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.03, 3.76, 3.90
[05:23:13] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.54, 3.63, 3.83
[05:27:08] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.37, 3.91, 3.89
[05:29:06] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 2.92, 3.65, 3.81
[05:35:00] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.56, 4.01, 3.88
[05:36:58] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.07, 3.80, 3.83
[05:46:47] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.81, 4.17, 3.94
[05:50:43] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 2.28, 3.50, 3.75
[05:54:38] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.18, 3.54, 3.69
[06:04:28] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.56, 3.72, 3.76
[06:10:21] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.16, 3.99, 3.87
[06:12:19] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.51, 3.82, 3.83
[06:14:17] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.87, 4.08, 3.91
[06:16:15] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.39, 3.93, 3.89
[06:18:13] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.24, 4.02, 3.92
[07:26:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.44, 2.94, 4.00
[07:27:51] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query.
[07:30:10] <icinga-miraheze>	 RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 1.00, 1.94, 3.35
[07:57:51] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query pt.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[08:06:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 7.52, 4.54, 2.62
[09:23:04] <icinga-miraheze>	 PROBLEM - wiki.litek.top - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.litek.top' expires in 15 day(s) (Fri 27 Oct 2023 08:58:10 GMT +0000).
[10:57:51] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query.
[11:48:11] <icinga-miraheze>	 PROBLEM - www.widedata.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.widedata.org could not be found
[11:57:51] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'}
[12:13:26] <icinga-miraheze>	 PROBLEM - www.widedata.org - LetsEncrypt on sslhost is CRITICAL: connect to address www.widedata.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket
[12:16:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.29, 2.81, 3.83
[12:18:22] <botifico>	 [02mw-config] 07OAuthority opened pull request 03#5327: T11184 - 13https://github.com/miraheze/mw-config/pull/5327
[12:19:30] <miraheze-github>	 miraheze/mw-config - OAuthority the build passed.
[12:24:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.60, 3.59, 3.70
[12:26:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.52, 3.57, 3.68
[12:28:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.87, 3.97, 3.81
[15:22:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 0.70, 1.71, 3.67
[15:24:10] <icinga-miraheze>	 RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 1.30, 1.50, 3.35
[16:06:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 9.54, 5.33, 3.04
[17:36:48] <botifico>	 [02mw-config] 07The-Voidwalker closed pull request 03#5326: "obsence" -> "obscene" in wiki request responses - 13https://github.com/miraheze/mw-config/pull/5326
[17:38:07] <botifico>	 [02mw-config] 07The-Voidwalker closed pull request 03#5320: Multiple tasks: Configure LinkTargetParentClass for some wikis - 13https://github.com/miraheze/mw-config/pull/5320
[17:39:00] <MirahezeLSBot>	 !log [@mwtask141] starting deploy of {'config': True} to all
[17:39:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:39:09] <MirahezeLSBot>	 !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 9s
[17:39:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:39:21] <botifico>	 [02mw-config] 07The-Voidwalker closed pull request 03#5313: Change benpediawiki's custom language and add one for sonaponawiki (T11042 and T11202) - 13https://github.com/miraheze/mw-config/pull/5313
[17:41:26] <icinga-miraheze>	 RECOVERY - www.widedata.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.widedata.org' will expire on Mon 04 Dec 2023 23:26:23 GMT +0000.
[17:41:36] <botifico>	 [02mw-config] 07The-Voidwalker commented on pull request 03#5308: T11177 - ping rc with abuse filter hits - 13https://github.com/miraheze/mw-config/pull/5308#issuecomment-1758175319
[17:41:39] <botifico>	 [02mw-config] 07The-Voidwalker closed pull request 03#5308: T11177 - ping rc with abuse filter hits - 13https://github.com/miraheze/mw-config/pull/5308
[17:43:05] <botifico>	 [02mw-config] 07The-Voidwalker closed pull request 03#5259: Update isvwiki to CC BY-SA 4.0 - 13https://github.com/miraheze/mw-config/pull/5259
[17:43:06] <botifico>	 [02miraheze/mw-config] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/88e8ed8ffe9b...56e16f4acce9
[17:43:09] <botifico>	 [02miraheze/mw-config] 07thelevking 0356e16f4 - Update isvwiki to CC BY-SA 4.0 (#5259)
[17:44:54] <botifico>	 [02mw-config] 07The-Voidwalker reviewed pull request 03#5266 commit - 13https://github.com/miraheze/mw-config/pull/5266#discussion_r1355464214
[17:45:31] <botifico>	 [02mw-config] 07The-Voidwalker edited pull request 03#5327: T11184 - $wgGalleryOptions for whentheycrywiki - 13https://github.com/miraheze/mw-config/pull/5327
[17:45:49] <botifico>	 [02mw-config] 07The-Voidwalker closed pull request 03#5327: T11184 - $wgGalleryOptions for whentheycrywiki - 13https://github.com/miraheze/mw-config/pull/5327
[17:45:52] <botifico>	 [02miraheze/mw-config] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/56e16f4acce9...61db10e84c46
[17:45:55] <botifico>	 [02miraheze/mw-config] 07OAuthority 0361db10e - T11184 - $wgGalleryOptions for whentheycrywiki (#5327)
[17:56:42] <MirahezeLSBot>	 !log [@test131] starting deploy of {'config': True} to all
[17:56:43] <MirahezeLSBot>	 !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 1s
[17:56:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:56:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:07:20] <icinga-miraheze>	 PROBLEM - en.religiononfire.mar.in.ua - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'en.religiononfire.mar.in.ua' expires in 15 day(s) (Fri 27 Oct 2023 17:50:02 GMT +0000).
[18:09:24] <MirahezeLSBot>	 !log [@mwtask141] starting deploy of {'config': True} to all
[18:09:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:09:41] <MirahezeLSBot>	 !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 16s
[18:09:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:10:30] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/711af7744c7c...b59c6da0a2dc
[18:10:32] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 03b59c6da - Bot: Update SSL cert for en.religiononfire.mar.in.ua
[18:12:57] <icinga-miraheze>	 PROBLEM - uk.religiononfire.mar.in.ua - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'uk.religiononfire.mar.in.ua' expires in 15 day(s) (Fri 27 Oct 2023 17:44:36 GMT +0000).
[18:16:11] <icinga-miraheze>	 RECOVERY - www.widedata.org - reverse DNS on sslhost is OK: SSL OK - www.widedata.org reverse DNS resolves to cp24.miraheze.org - NS RECORDS OK
[18:16:42] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b59c6da0a2dc...e019b81675dd
[18:16:44] <botifico>	 [02miraheze/ssl] 07MirahezeSSLBot 03e019b81 - Bot: Update SSL cert for uk.religiononfire.mar.in.ua
[18:17:27] <icinga-miraheze>	 PROBLEM - puppetdb121 APT on puppetdb121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected.
[18:19:28] <icinga-miraheze>	 PROBLEM - puppetdb121 APT on puppetdb121 is CRITICAL: APT CRITICAL: 81 packages available for upgrade (35 critical updates).
[18:42:47] <icinga-miraheze>	 RECOVERY - uk.religiononfire.mar.in.ua - LetsEncrypt on sslhost is OK: OK - Certificate 'uk.religiononfire.mar.in.ua' will expire on Tue 09 Jan 2024 17:16:33 GMT +0000.
[19:05:59] <icinga-miraheze>	 RECOVERY - en.religiononfire.mar.in.ua - LetsEncrypt on sslhost is OK: OK - Certificate 'en.religiononfire.mar.in.ua' will expire on Tue 09 Jan 2024 17:09:58 GMT +0000.
[20:42:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.46, 2.92, 3.96
[20:46:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 5.12, 3.85, 4.07
[20:52:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.80, 3.82, 3.99
[20:54:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.40, 4.11, 4.08
[20:57:51] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query.
[21:17:29] <botifico>	 [02mw-config] 07ugochimobi synchronize pull request 03#5266: Cleanup - 13https://github.com/miraheze/mw-config/pull/5266
[21:18:37] <miraheze-github>	 miraheze/mw-config - ugochimobi the build passed.
[21:27:51] <icinga-miraheze>	 PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'}
[22:24:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.20, 3.73, 3.99
[22:26:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.27, 4.10, 4.11
[22:53:19] <icinga-miraheze>	 PROBLEM - os131 Current Load on os131 is CRITICAL: CRITICAL - load average: 4.57, 3.55, 2.40
[22:55:17] <icinga-miraheze>	 RECOVERY - os131 Current Load on os131 is OK: OK - load average: 2.52, 3.14, 2.39
[23:44:10] <icinga-miraheze>	 PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 0.77, 2.33, 3.98
[23:47:23] <icinga-miraheze>	 PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 10.69, 8.56, 5.49
[23:48:10] <icinga-miraheze>	 RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 0.59, 1.40, 3.22
[23:49:23] <icinga-miraheze>	 RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 3.85, 6.86, 5.24