[00:20:30] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [00:50:19] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp24.miraheze.org - CNAME OK [00:51:05] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1014177799 secs [01:24:34] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.45, 2.61, 3.91 [01:26:34] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.55, 3.31, 4.00 [01:28:34] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.31, 3.34, 3.93 [01:30:34] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.50, 3.74, 4.00 [03:15:05] PROBLEM - ns1 NTP time on ns1 is CRITICAL: NTP CRITICAL: Offset 0.5024572909 secs [03:46:15] PROBLEM - decyclopedia.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for decyclopedia.tk could not be found [04:05:33] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 5.10, 2.90, 1.52 [04:11:33] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 0.68, 1.77, 1.52 [04:13:33] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.53, 1.37, 1.40 [04:47:43] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query zulaclub.net. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:16:51] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp25.miraheze.org - CNAME OK [05:41:40] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [06:11:41] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [07:41:33] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 3.29, 1.85, 0.93 [08:03:34] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 0.61, 1.25, 1.92 [08:07:33] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.24, 0.70, 1.53 [08:17:33] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 4.96, 2.65, 1.88 [08:21:33] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.40, 1.57, 1.64 [09:50:34] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.10, 2.71, 3.95 [09:54:34] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.21, 3.03, 3.75 [09:56:34] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.90, 3.34, 3.78 [09:58:34] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.20, 3.68, 3.85 [10:00:34] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.27, 3.65, 3.83 [10:02:34] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.06, 3.91, 3.91 [11:16:51] [02miraheze/IncidentReporting] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/IncidentReporting/compare/5978039f7b41...f5713cabea44 [11:16:52] [02miraheze/IncidentReporting] 07translatewiki 03f5713ca - Localisation updates from https://translatewiki.net. [11:16:53] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/33faf70467c7...3aceccbb8bf4 [11:16:55] [02miraheze/MirahezeMagic] 07translatewiki 033aceccb - Localisation updates from https://translatewiki.net. [11:23:47] miraheze/IncidentReporting - translatewiki the build passed. [11:31:21] miraheze/MirahezeMagic - translatewiki the build passed. [11:49:02] [02mw-config] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config [11:49:03] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/908d5034b603 [11:49:05] [02miraheze/mw-config] 07paladox 03908d503 - Set wgParserEnableLegacyMediaDOM to false on all 1.40+ wikis [11:49:19] [02mw-config] 07paladox closed pull request 03#5334: Set wgParserEnableLegacyMediaDOM to false on all 1.40+ wikis - 13https://github.com/miraheze/mw-config/pull/5334 [11:49:20] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/b3fc771cb622...e1865070881c [11:49:21] [02miraheze/mw-config] 07paladox 03e186507 - Set wgParserEnableLegacyMediaDOM to false on all 1.40+ wikis (#5334) [11:49:24] [02mw-config] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/mw-config [11:49:25] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-5 [11:50:22] miraheze/mw-config - paladox the build passed. [11:55:53] !log [@test131] starting deploy of {'config': True} to all [11:55:54] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [11:55:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:56:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:09:43] !log [@mwtask141] starting deploy of {'config': True} to all [12:09:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:09:52] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 9s [12:09:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:57:50] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 788 bytes in 0.379 second response time [12:59:48] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.199 second response time [13:44:49] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/93414042a71b...133bcb8ada43 [13:44:52] [02miraheze/mediawiki] 07paladox 03133bcb8 - Update PageForms [13:45:00] !log [paladox@test131] starting deploy of {'config': True, 'world': True, 'l10n': True} to all [13:45:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:46:57] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 772 bytes in 0.282 second response time [13:47:14] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/e7849bb9c9ea...a5c52a2be2bb [13:47:15] [02miraheze/mediawiki] 07paladox 03a5c52a2 - Update PageForms [13:47:37] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 4.11, 3.07, 2.45 [13:48:52] !log [paladox@test131] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [13:48:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:49:18] !log [paladox@mwtask141] starting deploy of {'config': True, 'world': True, 'l10n': True} to all [13:49:20] !log [paladox@mwtask141] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [13:49:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:49:26] !log [paladox@mwtask141] starting deploy of {'config': True, 'world': True, 'l10n': True} to all [13:49:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:49:30] !log [paladox@test131] starting deploy of {'config': True, 'world': True, 'l10n': True} to all [13:49:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:49:37] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 3.23, 2.98, 2.49 [13:49:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:54:33] !log [paladox@test131] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [13:54:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:11:47] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 11.62, 8.88, 7.02 [14:13:47] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 7.25, 8.25, 7.03 [14:36:36] !log [paladox@mwtask141] finished deploy of {'config': True, 'world': True, 'l10n': True} to all - SUCCESS in 2829s [14:36:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:03:05] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.075643152 secs [16:15:05] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1093372703 secs [17:14:02] PROBLEM - cp25 APT on cp25 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [17:16:03] PROBLEM - cp25 APT on cp25 is CRITICAL: APT CRITICAL: 72 packages available for upgrade (32 critical updates). [17:33:35] PROBLEM - swiftobject111 APT on swiftobject111 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [17:35:38] PROBLEM - swiftobject111 APT on swiftobject111 is CRITICAL: APT CRITICAL: 83 packages available for upgrade (29 critical updates). [17:47:05] PROBLEM - ns1 NTP time on ns1 is CRITICAL: NTP CRITICAL: Offset 0.5317879319 secs [18:52:33] [02mediawiki] 07paladox commented on pull request 03#16876: bump extensions/PageForms from `a46d1df` to `52cbc14` - 13https://github.com/miraheze/mediawiki/pull/16876#issuecomment-1765093202 [18:52:34] [02mediawiki] 07paladox closed pull request 03#16876: bump extensions/PageForms from `a46d1df` to `52cbc14` - 13https://github.com/miraheze/mediawiki/pull/16876 [18:52:36] [02mediawiki] 07dependabot[bot] commented on pull request 03#16876: bump extensions/PageForms from `a46d1df` to `52cbc14` - 13https://github.com/miraheze/mediawiki/pull/16876#issuecomment-1765093275 [18:52:39] [02miraheze/mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_39/extensions/PageForms-52cbc14 [18:52:42] [02mediawiki] 07paladox deleted branch 03dependabot/submodules/REL1_39/extensions/PageForms-52cbc14 - 13https://github.com/miraheze/mediawiki [18:56:47] !log [paladox@test131] starting deploy of {'config': True, 'world': True, 'l10n': True} to all [18:56:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:57:01] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.918 second response time [19:15:29] !log [paladox@test131] finished deploy of {'config': True, 'world': True, 'l10n': True} to all - SUCCESS in 1122s [19:15:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:56:39] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.85, 7.57, 6.30 [21:58:38] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.98, 6.76, 6.15 [23:04:49] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 16.34, 10.94, 5.83 [23:10:49] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 1.34, 6.78, 5.97 [23:18:48] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [23:22:48] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical]