[00:02:13] <icinga-miraheze>	 PROBLEM - buildabearwiki.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'buildabearwiki.info' expires in 14 day(s) (Sat 08 Mar 2025 11:49:05 PM GMT +0000).
[00:02:24] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/4fe06eb463a4d57cd622f9950cdd24ceee4e92fc
[00:02:24] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 034fe06eb Bot: Update SSL cert for buildabearwiki.info
[00:06:39] <icinga-miraheze>	 PROBLEM - roll-of-arms.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'roll-of-arms.com' expires in 14 day(s) (Sat 08 Mar 2025 11:49:41 PM GMT +0000).
[00:06:50] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/713ef25d1d841e05e82d11b4dbb5cfe90870693a
[00:06:50] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03713ef25 Bot: Update SSL cert for roll-of-arms.com
[00:11:28] <icinga-miraheze>	 PROBLEM - removededm.com - LetsEncrypt on sslhost is CRITICAL: No address associated with hostnameHTTP CRITICAL - Unable to open TCP socket
[00:13:32] <icinga-miraheze>	 RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 51415MiB (11% inode=99%);
[00:21:54] <icinga-miraheze>	 RECOVERY - knifepointhorror.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'knifepointhorror.wiki' will expire on Thu 22 May 2025 10:54:26 PM GMT +0000.
[00:23:24] <icinga-miraheze>	 PROBLEM - iol.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'iol.wiki' expires in 14 day(s) (Sun 09 Mar 2025 12:04:46 AM GMT +0000).
[00:23:35] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/76c0b364b60b06b844fa1422dcbe32e751b54423
[00:23:35] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 0376c0b36 Bot: Update SSL cert for iol.wiki
[00:31:37] <icinga-miraheze>	 RECOVERY - buildabearwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'buildabearwiki.info' will expire on Thu 22 May 2025 11:03:48 PM GMT +0000.
[00:36:14] <icinga-miraheze>	 RECOVERY - roll-of-arms.com - LetsEncrypt on sslhost is OK: OK - Certificate 'roll-of-arms.com' will expire on Thu 22 May 2025 11:08:14 PM GMT +0000.
[00:37:58] <icinga-miraheze>	 PROBLEM - royal-wiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'royal-wiki.org' expires in 14 day(s) (Sun 09 Mar 2025 12:08:28 AM GMT +0000).
[00:38:10] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/eef4f45651b5b1d01aca28dca6237716de1e763b
[00:38:10] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03eef4f45 Bot: Update SSL cert for royal-wiki.org
[00:41:18] <icinga-miraheze>	 RECOVERY - removededm.com - LetsEncrypt on sslhost is OK: OK - Certificate 'removededm.com' will expire on Thu 24 Apr 2025 12:08:29 PM GMT +0000.
[00:45:08] <icinga-miraheze>	 PROBLEM - squareenixwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'squareenixwiki.com' expires in 14 day(s) (Sun 09 Mar 2025 12:28:04 AM GMT +0000).
[00:45:19] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/dd7d3b6c6520ad2e6e8639a3c895045a3a4aba3a
[00:45:19] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03dd7d3b6 Bot: Update SSL cert for squareenixwiki.com
[00:53:18] <icinga-miraheze>	 RECOVERY - iol.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'iol.wiki' will expire on Thu 22 May 2025 11:25:00 PM GMT +0000.
[01:07:12] <icinga-miraheze>	 RECOVERY - royal-wiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'royal-wiki.org' will expire on Thu 22 May 2025 11:39:34 PM GMT +0000.
[01:13:52] <icinga-miraheze>	 RECOVERY - squareenixwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'squareenixwiki.com' will expire on Thu 22 May 2025 11:46:44 PM GMT +0000.
[01:25:32] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 49794MiB (10% inode=99%);
[01:31:04] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03config 13https://github.com/miraheze/CreateWiki/commit/caaddf2dba271bf9264ae0f05a620ab3b7e64e71
[01:31:05] <MacFanBot>	 02CreateWiki/03config 07CosmicAlpha 03caaddf2 Don't use for now
[01:33:47] <MacFanBot>	 [02CreateWiki] 07Universal-Omega retitled PR #669: "Add a CreateWiki MultiConfig class" ➜ "Add a CreateWikiConfig service" 13https://github.com/miraheze/CreateWiki/pull/669
[01:34:05] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03config 13https://github.com/miraheze/CreateWiki/commit/79d3810814b65db03d13cb3b6a4b726d2b8d9f81
[01:34:05] <MacFanBot>	 02CreateWiki/03config 07CosmicAlpha 0379d3810 Remove (for now)
[01:36:03] <MacFanBot>	 [02CreateWiki] 07Universal-Omega created 03databaseutils (+3 new commits) 13https://github.com/miraheze/CreateWiki/compare/391502a5b5f3^...15dc5b583a45
[01:36:05] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03391502a Expand usage of CreateWikiDatabaseUtils
[01:36:06] <MacFanBot>	 02CreateWiki/03databaseutils 07github-actions 03ea6e15b CI: lint code to MediaWiki standards…
[01:36:07] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 0315dc5b5 Update
[01:36:08] <MacFanBot>	 [02CreateWiki] 07Universal-Omega reopened pull request #663: Expand usage of CreateWikiDatabaseUtils (03master...03databaseutils) 13https://github.com/miraheze/CreateWiki/pull/663
[01:37:31] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/8cd4fcc1fdd0fad0ad631f2ef76f165d85600218
[01:37:31] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 038cd4fcc Remove
[01:46:22] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[01:49:47] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[02:20:40] <MacFanBot>	 [02CreateWiki] 07Universal-Omega created 03svgo (+1 new commit) 13https://github.com/miraheze/CreateWiki/commit/6cd94d175efc
[02:20:40] <MacFanBot>	 02CreateWiki/03svgo 07CosmicAlpha 036cd94d1 Add svgo
[02:22:08] <MacFanBot>	 [02CreateWiki] 07Universal-Omega opened pull request #672: Add svgo (03master...03svgo) 13https://github.com/miraheze/CreateWiki/pull/672
[02:22:15] <MacFanBot>	 [02CreateWiki] 07coderabbitai[bot] commented on pull request #672: --- […] 13https://github.com/miraheze/CreateWiki/pull/672#issuecomment-2675949418
[02:31:12] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build has errored.
[02:32:48] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03svgo 13https://github.com/miraheze/CreateWiki/commit/1e0dd7bed0063c4482575b4162969e985eee45db
[02:32:48] <MacFanBot>	 02CreateWiki/03svgo 07CosmicAlpha 031e0dd7b Update to 3.3.2
[02:34:09] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03svgo 13https://github.com/miraheze/CreateWiki/commit/fcb072a46c534e07931569944b00d44e23707efb
[02:34:09] <MacFanBot>	 02CreateWiki/03svgo 07CosmicAlpha 03fcb072a Fix
[02:44:19] <icinga-miraheze>	 PROBLEM - icclopedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'icclopedia.org' expires in 14 day(s) (Sun 09 Mar 2025 02:26:09 AM GMT +0000).
[02:44:31] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/6ac72c8f59a9913d8301370287cbb544c437dac7
[02:44:31] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 036ac72c8 Bot: Update SSL cert for icclopedia.org
[02:46:13] <MacFanBot>	 [02CreateWiki] 07Universal-Omega closed pull request #671: eslint: enable and fix no-jquery/no-global-selector (03master...03fix-eslint-no-jquery/no-global-selector) 13https://github.com/miraheze/CreateWiki/pull/671
[02:46:16] <MacFanBot>	 [02CreateWiki] 07Universal-Omega 04deleted 03fix-eslint-no-jquery/no-global-selector at 036b9c976 13https://github.com/miraheze/CreateWiki/commit/6b9c976
[02:46:33] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[02:52:59] <icinga-miraheze>	 PROBLEM - acuralegendwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'acuralegendwiki.org' expires in 14 day(s) (Sun 09 Mar 2025 02:34:56 AM GMT +0000).
[02:53:12] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/4209fffaa71f35c0d2604a7b9e2c3734064a44b3
[02:53:12] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 034209fff Bot: Update SSL cert for acuralegendwiki.org
[03:22:01] <icinga-miraheze>	 RECOVERY - acuralegendwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'acuralegendwiki.org' will expire on Fri 23 May 2025 01:54:36 AM GMT +0000.
[03:42:19] <icinga-miraheze>	 RECOVERY - icclopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'icclopedia.org' will expire on Fri 23 May 2025 01:45:55 AM GMT +0000.
[04:06:42] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.06, 16.22, 10.29
[04:10:42] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 18.62, 18.83, 12.77
[04:53:31] <icinga-miraheze>	 PROBLEM - mon181 Current Load on mon181 is CRITICAL: LOAD CRITICAL - total load average: 7.40, 14.43, 8.15
[04:57:24] <icinga-miraheze>	 RECOVERY - mon181 Current Load on mon181 is OK: LOAD OK - total load average: 0.31, 6.68, 6.37
[05:12:19] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.66, 18.74, 13.72
[05:34:14] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.78, 23.87, 22.59
[05:42:13] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 7.44, 15.02, 19.05
[05:50:10] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.61, 22.93, 21.25
[05:52:09] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.57, 23.47, 21.68
[05:54:09] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.86, 23.92, 22.06
[06:00:07] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.67, 23.73, 22.66
[06:04:06] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.71, 23.96, 22.95
[06:06:06] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.61, 23.44, 22.86
[06:20:03] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.71, 23.01, 22.77
[06:22:02] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 18.41, 20.83, 21.98
[06:28:01] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 17.20, 17.68, 20.15
[07:12:50] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 30.87, 19.82, 12.92
[07:40:43] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 6.17, 18.34, 22.32
[07:42:43] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 4.78, 13.83, 20.20
[08:26:42] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 28.94, 18.79, 13.10
[08:30:42] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 18.37, 21.95, 15.92
[08:32:42] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 7.72, 16.80, 14.76
[08:44:14] <icinga-miraheze>	 PROBLEM - looneypyramids.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'looneypyramids.wiki' expires in 14 day(s) (Sun 09 Mar 2025 08:29:55 AM GMT +0000).
[08:44:27] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/e4eee6fda87b64d01410cd9304f2df6f8cf84bb4
[08:44:27] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03e4eee6f Bot: Update SSL cert for looneypyramids.wiki
[09:05:36] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 20.88, 19.92, 16.83
[09:07:35] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 19.36, 19.80, 17.17
[09:12:34] <icinga-miraheze>	 PROBLEM - landofliberos.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'landofliberos.com' expires in 14 day(s) (Sun 09 Mar 2025 08:42:53 AM GMT +0000).
[09:12:46] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/239a1267805e1f35f37f152d0067bd87eb33fff7
[09:12:46] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03239a126 Bot: Update SSL cert for landofliberos.com
[09:29:30] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 29.15, 18.25, 14.79
[09:42:14] <icinga-miraheze>	 RECOVERY - looneypyramids.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'looneypyramids.wiki' will expire on Fri 23 May 2025 07:45:51 AM GMT +0000.
[09:42:21] <icinga-miraheze>	 RECOVERY - landofliberos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'landofliberos.com' will expire on Fri 23 May 2025 08:14:10 AM GMT +0000.
[09:57:23] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.14, 23.98, 23.08
[10:01:22] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 26.52, 24.92, 23.64
[10:09:20] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.46, 23.49, 23.65
[10:13:19] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 25.37, 24.40, 23.96
[10:21:18] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 22.63, 23.57, 23.82
[10:25:17] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.99, 23.85, 23.82
[10:29:16] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 13.91, 19.75, 22.31
[10:33:15] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 10.59, 15.07, 19.80
[10:57:09] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.49, 17.94, 15.59
[10:59:08] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.98, 19.16, 16.33
[11:01:08] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 26.40, 21.30, 17.43
[11:05:07] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 14.37, 20.34, 18.09
[11:09:04] <icinga-miraheze>	 PROBLEM - webkinzguide.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'webkinzguide.com' expires in 14 day(s) (Sun 09 Mar 2025 11:01:02 AM GMT +0000).
[11:09:16] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/d358b345771240cb5b245bef6210b2ff9bc113c0
[11:09:16] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03d358b34 Bot: Update SSL cert for webkinzguide.com
[11:42:42] <icinga-miraheze>	 PROBLEM - dkpedia.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dkpedia.com' expires in 14 day(s) (Sun 09 Mar 2025 11:38:22 AM GMT +0000).
[11:42:56] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/c517ae17e44df49303b721275256078a95e6554e
[11:42:56] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03c517ae1 Bot: Update SSL cert for dkpedia.com
[12:07:11] <icinga-miraheze>	 PROBLEM - solaswiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'solaswiki.org' expires in 14 day(s) (Sun 09 Mar 2025 11:41:38 AM GMT +0000).
[12:07:22] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/d490a0a3a1cf29e75200f14cf2b222976b1082d5
[12:07:22] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03d490a0a Bot: Update SSL cert for solaswiki.org
[12:08:13] <icinga-miraheze>	 RECOVERY - webkinzguide.com - LetsEncrypt on sslhost is OK: OK - Certificate 'webkinzguide.com' will expire on Fri 23 May 2025 10:10:40 AM GMT +0000.
[12:10:06] <icinga-miraheze>	 PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 23.42, 16.03, 8.57
[12:12:05] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 18.43, 9.96, 5.07
[12:12:06] <icinga-miraheze>	 RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 17.74, 17.20, 9.95
[12:14:05] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 5.95, 8.71, 5.26
[12:15:23] <icinga-miraheze>	 PROBLEM - mwtask181 jobrunner.wikitide.net HTTPS on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9006: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received
[12:15:46] <icinga-miraheze>	 PROBLEM - mwtask181 jobrunner-high.wikitide.net HTTPS on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9006: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received
[12:16:28] <icinga-miraheze>	 PROBLEM - mwtask181 SSH on mwtask181 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[12:16:48] <icinga-miraheze>	 PROBLEM - mwtask181 mathoid on mwtask181 is CRITICAL: connect to address 10.0.18.106 and port 10044: Connection refused
[12:17:00] <icinga-miraheze>	 PROBLEM - mwtask181 MediaWiki Rendering on mwtask181 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[12:17:02] <icinga-miraheze>	 PROBLEM - mwtask181 videoscaler.wikitide.net HTTPS on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 9006: cURL returned 28 - Operation timed out after 10000 milliseconds with 0 bytes received
[12:17:51] <icinga-miraheze>	 PROBLEM - mwtask181 Puppet on mwtask181 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[12:18:03] <icinga-miraheze>	 PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[12:18:18] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 102.56, 58.37, 27.52
[12:19:12] <icinga-miraheze>	 PROBLEM - mwtask181 HTTPS on mwtask181 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received
[12:19:29] <icinga-miraheze>	 PROBLEM - mwtask181 PowerDNS Recursor on mwtask181 is CRITICAL: CRITICAL - Plugin timed out while executing system call
[12:21:32] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 27167MiB (5% inode=99%);
[12:21:55] <icinga-miraheze>	 PROBLEM - mwtask181 conntrack_table_size on mwtask181 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[12:23:29] <icinga-miraheze>	 RECOVERY - mwtask181 APT on mwtask181 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[12:23:31] <icinga-miraheze>	 RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 21 minutes ago with 0 failures
[12:23:35] <icinga-miraheze>	 RECOVERY - mwtask181 PowerDNS Recursor on mwtask181 is OK: DNS OK: 0.066 seconds response time. wikitide.net returns 2602:294:0:b13::110,38.46.223.205
[12:23:44] <icinga-miraheze>	 RECOVERY - mwtask181 jobrunner.wikitide.net HTTPS on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 168 bytes in 0.011 second response time
[12:23:53] <icinga-miraheze>	 RECOVERY - mwtask181 conntrack_table_size on mwtask181 is OK: OK: nf_conntrack is 0 % full
[12:24:14] <icinga-miraheze>	 RECOVERY - mwtask181 jobrunner-high.wikitide.net HTTPS on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 168 bytes in 0.012 second response time
[12:24:38] <icinga-miraheze>	 RECOVERY - mwtask181 SSH on mwtask181 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u5 (protocol 2.0)
[12:24:48] <icinga-miraheze>	 RECOVERY - mwtask181 mathoid on mwtask181 is OK: TCP OK - 0.000 second response time on 10.0.18.106 port 10044
[12:25:10] <icinga-miraheze>	 RECOVERY - mwtask181 videoscaler.wikitide.net HTTPS on mwtask181 is OK: HTTP OK: HTTP/1.1 204 No Content - 168 bytes in 0.010 second response time
[12:25:15] <icinga-miraheze>	 RECOVERY - mwtask181 HTTPS on mwtask181 is OK: HTTP OK: HTTP/2 404 - Status line output matched "HTTP/2 404" - 3955 bytes in 0.254 second response time
[12:25:28] <icinga-miraheze>	 RECOVERY - mwtask181 MediaWiki Rendering on mwtask181 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.783 second response time
[12:33:37] <icinga-miraheze>	 PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 23.66, 18.39, 12.52
[12:33:41] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 20.62, 17.38, 11.85
[12:34:05] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 12.57, 9.69, 7.10
[12:35:41] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 19.17, 17.97, 12.75
[12:36:05] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 10.97, 10.01, 7.53
[12:36:22] <icinga-miraheze>	 RECOVERY - solaswiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'solaswiki.org' will expire on Fri 23 May 2025 11:08:47 AM GMT +0000.
[12:37:37] <icinga-miraheze>	 RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 15.33, 17.52, 13.64
[12:38:05] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 15.95, 12.39, 8.72
[12:41:22] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 3.06, 8.14, 21.86
[12:41:37] <icinga-miraheze>	 PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 23.59, 21.04, 15.99
[12:42:06] <icinga-miraheze>	 PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 22.30, 18.78, 14.14
[12:42:15] <icinga-miraheze>	 RECOVERY - dkpedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dkpedia.com' will expire on Fri 23 May 2025 10:44:18 AM GMT +0000.
[12:43:21] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 4.07, 6.94, 19.76
[12:43:37] <icinga-miraheze>	 PROBLEM - mw183 Current Load on mw183 is CRITICAL: LOAD CRITICAL - total load average: 25.06, 22.45, 17.12
[12:43:41] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 22.05, 20.49, 16.08
[12:45:37] <icinga-miraheze>	 PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 23.12, 22.53, 17.80
[12:46:05] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 4.93, 10.17, 9.94
[12:48:06] <icinga-miraheze>	 RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 17.37, 19.89, 16.27
[12:49:37] <icinga-miraheze>	 RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 16.50, 19.01, 17.51
[12:49:41] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 18.69, 19.12, 17.05
[12:50:46] <icinga-miraheze>	 PROBLEM - cp37 Varnish Backends on cp37 is CRITICAL: 2 backends are down. mw182 mw183
[12:51:19] <icinga-miraheze>	 PROBLEM - cp36 Varnish Backends on cp36 is CRITICAL: 1 backends are down. mw173
[12:52:46] <icinga-miraheze>	 RECOVERY - cp37 Varnish Backends on cp37 is OK: All 29 backends are healthy
[12:53:20] <icinga-miraheze>	 RECOVERY - cp36 Varnish Backends on cp36 is OK: All 29 backends are healthy
[12:55:43] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is CRITICAL: LOAD CRITICAL - total load average: 24.04, 20.40, 17.54
[12:57:01] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is CRITICAL: LOAD CRITICAL - total load average: 24.58, 14.68, 11.14
[12:57:41] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 21.60, 20.15, 18.21
[12:57:43] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.18, 20.93, 18.09
[12:59:00] <icinga-miraheze>	 [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[13:01:20] <icinga-miraheze>	 PROBLEM - mw183 Current Load on mw183 is WARNING: LOAD WARNING - total load average: 23.34, 21.53, 19.35
[13:01:43] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 18.70, 20.26, 18.54
[13:03:15] <icinga-miraheze>	 RECOVERY - mw183 Current Load on mw183 is OK: LOAD OK - total load average: 12.95, 19.40, 18.90
[13:03:41] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 8.97, 18.00, 18.35
[13:04:57] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 1.86, 8.54, 10.09
[13:09:00] <icinga-miraheze>	 [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[13:49:54] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 6.88, 6.96, 5.97
[13:53:52] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.06, 7.72, 6.51
[13:59:48] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 6.32, 7.36, 6.80
[14:03:45] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.69, 7.84, 7.10
[14:05:44] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 6.22, 7.54, 7.10
[14:07:43] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.29, 7.91, 7.28
[14:09:41] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.02, 7.72, 7.30
[14:11:40] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.56, 8.14, 7.51
[14:15:37] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.46, 7.82, 7.53
[14:18:09] <MacFanBot>	 [02ssl] 07Friskygote opened pull request #824: T13264: Redirect capoeirawiki to capoeirawiki.org (07miraheze:03master...07Friskygote:03T13264) 13https://github.com/miraheze/ssl/pull/824
[14:19:48] <Frisk>	 ok, TIL that branch doesn't support merging rip
[14:20:22] <Frisk>	 or maybe I don't understand this error message
[14:20:46] <RhinosF1>	 Frisk: oh ignore that error
[14:20:58] <RhinosF1>	 GitHub is being confusing and dumb
[14:21:10] <Frisk>	 looool, never had that happen before
[14:21:43] <Frisk>	 I mean, I understand what this message is supposed to be for, because I did repos on GitHub before, but in this case it seems super strange, blame the octopus then I guess
[14:25:32] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 19.86, 9.55, 7.92
[14:27:30] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 6.14, 7.91, 7.52
[14:41:21] <icinga-miraheze>	 RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 5.52, 5.86, 6.52
[14:50:47] <MacFanBot>	 [02ssl] 07coderabbitai[bot] commented on pull request #824: A new redirect configuration for **capoeirawiki** has been introduced in the `redirects.yaml` file. The update adds an entry specifying the URL, redirect destination, SSL certificate identifier, certificate authority, HSTS policy, and a flag to […] 13https://github.com/miraheze/ssl/pull/824#issuecomment-2676245350
[14:50:49] <MacFanBot>	 [02ssl] 07coderabbitai[bot] left a review on pull request #824: **Actionable comments posted: 0** […] 13https://github.com/miraheze/ssl/pull/824#pullrequestreview-2634847494
[15:21:00] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.36, 7.20, 6.57
[15:23:22] <icinga-miraheze>	 PROBLEM - wiki.nowchess.org - Cloudflare on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket
[15:24:57] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.93, 7.51, 6.81
[15:26:56] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.52, 7.56, 6.92
[15:44:44] <icinga-miraheze>	 RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 5.60, 6.47, 6.78
[15:48:58] <icinga-miraheze>	 PROBLEM - crashspyrowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'crashspyrowiki.com' expires in 14 day(s) (Sun 09 Mar 2025 03:37:17 PM GMT +0000).
[15:56:35] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.77, 7.12, 6.82
[15:58:33] <icinga-miraheze>	 RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 4.91, 6.38, 6.59
[16:00:20] <icinga-miraheze>	 PROBLEM - metroidpedia.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'metroidpedia.com' expires in 14 day(s) (Sun 09 Mar 2025 03:37:37 PM GMT +0000).
[16:00:31] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/a1b081c53cbb3a29a6206aa7cdefba4abb7eec54
[16:00:33] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03a1b081c Bot: Update SSL cert for metroidpedia.com
[16:04:28] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.69, 7.60, 7.00
[16:08:26] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.61, 7.80, 7.24
[16:10:24] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.07, 7.83, 7.31
[16:10:33] <icinga-miraheze>	 PROBLEM - rarewarewiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'rarewarewiki.com' expires in 14 day(s) (Sun 09 Mar 2025 03:52:46 PM GMT +0000).
[16:14:22] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.07, 7.84, 7.47
[16:16:21] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.78, 8.19, 7.64
[16:20:18] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.60, 7.93, 7.65
[16:22:16] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 10.69, 9.02, 8.09
[16:30:00] <icinga-miraheze>	 RECOVERY - metroidpedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'metroidpedia.com' will expire on Fri 23 May 2025 03:01:56 PM GMT +0000.
[16:51:02] <icinga-miraheze>	 PROBLEM - apeirology.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'apeirology.com' expires in 14 day(s) (Sun 09 Mar 2025 04:22:02 PM GMT +0000).
[16:51:14] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/c4aa0dac1e99f2b286f911869e8a63d3d6b9d0ed
[16:51:14] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03c4aa0da Bot: Update SSL cert for apeirology.com
[16:51:22] <icinga-miraheze>	 RECOVERY - wiki.nowchess.org - Cloudflare on sslhost is OK: OK - Certificate 'wiki.nowchess.org' will expire on Thu 27 Mar 2025 10:29:41 PM GMT +0000.
[17:20:29] <icinga-miraheze>	 RECOVERY - apeirology.com - LetsEncrypt on sslhost is OK: OK - Certificate 'apeirology.com' will expire on Fri 23 May 2025 03:52:38 PM GMT +0000.
[17:24:05] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 7.44, 7.45, 7.96
[17:24:49] <MacFanBot>	 [02CreateWiki] 07Universal-Omega merged pull request #672: Add svgo (03master...03svgo) 13https://github.com/miraheze/CreateWiki/pull/672
[17:24:49] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03master 13https://github.com/miraheze/CreateWiki/commit/98ac88bc8fc381ddab41840e2fec6f7007dc748c
[17:24:50] <MacFanBot>	 02CreateWiki/03master 07CosmicAlpha 0398ac88b Add svgo (#672)
[17:24:52] <MacFanBot>	 [02CreateWiki] 07Universal-Omega 04deleted 03svgo at 03fcb072a 13https://github.com/miraheze/CreateWiki/commit/fcb072a
[17:26:05] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.33, 7.61, 7.95
[17:27:29] <icinga-miraheze>	 PROBLEM - freedomplanetwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'freedomplanetwiki.com' expires in 14 day(s) (Sun 09 Mar 2025 05:01:39 PM GMT +0000).
[17:27:40] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/26eb22271379f288b571d72cef66e1b223ad4be8
[17:27:41] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 0326eb222 Bot: Update SSL cert for freedomplanetwiki.com
[17:28:05] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 6.38, 7.08, 7.71
[17:29:01] <MacFanBot>	 [02CreateWiki] 07Universal-Omega merged pull request #669: Add a CreateWikiConfig service (03master...03config) 13https://github.com/miraheze/CreateWiki/pull/669
[17:29:01] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03master 13https://github.com/miraheze/CreateWiki/commit/b4524a5e60f471079243ec3779aabc9780ac6aa3
[17:29:03] <MacFanBot>	 02CreateWiki/03master 07CosmicAlpha 03b4524a5 Add a CreateWikiConfig service (#669)
[17:29:05] <MacFanBot>	 [02CreateWiki] 07Universal-Omega 04deleted 03config at 0379d3810 13https://github.com/miraheze/CreateWiki/commit/79d3810
[17:30:50] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/a10ae86cd51bbbf2c49e1c513564521f2a2e165f
[17:30:50] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03a10ae86 Merge branch 'master' into databaseutils
[17:34:31] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/b3b5f9be7997c9c3e469152b5a646787db801b1b
[17:34:31] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03b3b5f9b Update
[17:36:05] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 8.38, 7.68, 7.68
[17:36:40] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/e3ecb1774d3afa68cc77edc65d1175c86ca2c1fc
[17:36:40] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03e3ecb17 Update
[17:38:04] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/c4d5e00bb176433e99e7bd1df8024f9be35f77d1
[17:38:04] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03c4d5e00 Remove
[17:38:05] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 6.88, 7.40, 7.58
[17:38:36] <icinga-miraheze>	 PROBLEM - ncuwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ncuwiki.com' expires in 14 day(s) (Sun 09 Mar 2025 05:24:06 PM GMT +0000).
[17:38:48] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/0971cadd6c68360fcf3813982e2cd74728f00f4d
[17:38:48] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 030971cad Bot: Update SSL cert for ncuwiki.com
[17:40:57] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[17:46:45] <MacFanBot>	 [02ssl] 07MacFan4000 merged 07Friskygote's pull request #824: T13264: Redirect capoeirawiki to capoeirawiki.org (07miraheze:03master...07Friskygote:03T13264) 13https://github.com/miraheze/ssl/pull/824
[17:46:45] <MacFanBot>	 [02ssl] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/a371be9a4a89d855718bccb42f45ed3cea5e24a6
[17:46:47] <MacFanBot>	 02ssl/03master 07Frisk 03a371be9 T13264: Redirect capoeirawiki to capoeirawiki.org (#824)…
[17:49:58] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/2cf161f65f0cb5667d8ea4a04b741b8246e69301
[17:49:58] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 032cf161f Update
[17:50:25] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[17:50:55] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/637bd1e07598f0caf1d98074262128721a15ffc7
[17:50:55] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03637bd1e Update
[17:54:10] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/c2dbee9080cf75df1405c2d147367bb491121e5c
[17:54:10] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03c2dbee9 Update
[17:56:55] <icinga-miraheze>	 RECOVERY - freedomplanetwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'freedomplanetwiki.com' will expire on Fri 23 May 2025 04:29:05 PM GMT +0000.
[17:57:26] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build has errored.
[18:00:05] <icinga-miraheze>	 RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 4.28, 5.93, 6.69
[18:00:38] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/645db63c620db6b246827dbbdc768e980da7a2fa
[18:00:39] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03645db63 Update
[18:01:17] <MacFanBot>	 [02mw-config] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/348ae48b3532a7d098c0471dba8a048d34bb3b7b
[18:01:17] <MacFanBot>	 02mw-config/03master 07MacFan4000 03348ae48 new date
[18:01:37] <MirahezeLSBot>	 !log [macfan@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[18:01:39] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:01:59] <MirahezeLSBot>	 !log [macfan@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 22s
[18:02:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:02:08] <miraheze-github>	 miraheze/mw-config - MacFan4000 the build passed.
[18:02:20] <icinga-miraheze>	 [Grafana] FIRING: The mediawiki job queue has more than 2000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[18:02:58] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/1eda1a797fc2c82d9eb0d5b8dcd4bc28ea821536
[18:02:58] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 031eda1a7 Update
[18:07:42] <icinga-miraheze>	 RECOVERY - ncuwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'ncuwiki.com' will expire on Fri 23 May 2025 04:40:12 PM GMT +0000.
[18:12:18] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/bff50c1466de17eafa7811122b9778c17f6415ef
[18:12:18] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03bff50c1 Update
[18:17:57] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/ca6de859da86c5ec3a2e0c68db38d580ef262323
[18:17:57] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03ca6de85 Update
[18:19:46] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/e8876d4f58de53ef406098fad3f65b60a2c79114
[18:19:46] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03e8876d4 Update
[18:20:50] <icinga-miraheze>	 PROBLEM - creativecommons.id - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'creativecommons.id' expires in 14 day(s) (Sun 09 Mar 2025 06:07:09 PM GMT +0000).
[18:21:03] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/97513037a08aff0f4325099fee7ebe183888497c
[18:21:03] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 039751303 Bot: Update SSL cert for creativecommons.id
[18:21:35] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/616b933cb23bb85e766c113f5ba1939058b3e39e
[18:21:35] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03616b933 Update
[18:22:08] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/0e43ee5d0179c929c1105a2321557b7c53548800
[18:22:08] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 030e43ee5 Update
[18:23:53] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/66fd60e6f91f772fc022c982ca73a5095d62d5ce
[18:23:53] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 0366fd60e Update
[18:26:50] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/7d7a8d82405b5806828823e5f96ff70b4525b41b
[18:26:50] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 037d7a8d8 Add
[18:28:03] <icinga-miraheze>	 PROBLEM - matomo151 HTTPS on matomo151 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 7 - Failed to connect to matomo151.wikitide.net port 443 after 0 ms: Couldn't connect to server
[18:28:57] <icinga-miraheze>	 PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 4.13, 8.76, 7.35
[18:29:32] <icinga-miraheze>	 PROBLEM - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is WARNING: WARNING - NGINX Error Rate is 43%
[18:30:55] <icinga-miraheze>	 RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 1.75, 6.42, 6.66
[18:32:09] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/f6a48ae6647db2fc0a046b6ec7b0255d2345a26a
[18:32:09] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03f6a48ae Update
[18:34:03] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/cd1086c4f5d22e7e46514a04d0b1df51c964f64c
[18:34:03] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03cd1086c Update
[18:34:55] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/4a51ccc9752fdc219eaec42a3d08018c6e9644c9
[18:34:55] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 034a51ccc Update
[18:35:22] <icinga-miraheze>	 RECOVERY - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is OK: OK - NGINX Error Rate is 38%
[18:38:07] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build has errored.
[18:40:29] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/bbe1cb2cd9786be3018ba74e1b92861c17d30400
[18:40:29] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03bbe1cb2 Fix
[18:50:02] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/040a2c88648274940f4ab3ebd6169f4b1bd3a2c6
[18:50:03] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03040a2c8 Update
[18:50:35] <MacFanBot>	 [02CreateWiki] 07Universal-Omega pushed 1 new commit to 03databaseutils 13https://github.com/miraheze/CreateWiki/commit/fe68a56be98b5364192f15688dabdbb4fabbcbf0
[18:50:35] <MacFanBot>	 02CreateWiki/03databaseutils 07CosmicAlpha 03fe68a56 Update
[18:50:51] <icinga-miraheze>	 RECOVERY - creativecommons.id - LetsEncrypt on sslhost is OK: OK - Certificate 'creativecommons.id' will expire on Fri 23 May 2025 05:22:27 PM GMT +0000.
[18:51:12] <icinga-miraheze>	 PROBLEM - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is WARNING: WARNING - NGINX Error Rate is 41%
[18:54:40] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.08, 18.49, 13.38
[18:54:46] <icinga-miraheze>	 RECOVERY - matomo151 HTTPS on matomo151 is OK: HTTP OK: HTTP/2 200 - 553 bytes in 2.809 second response time
[18:55:05] <icinga-miraheze>	 RECOVERY - cp36 HTTP 4xx/5xx ERROR Rate on cp36 is OK: OK - NGINX Error Rate is 2%
[18:57:28] <icinga-miraheze>	 PROBLEM - cp36 Disk Space on cp36 is WARNING: DISK WARNING - free space: / 9702MiB (10% inode=98%);
[19:00:39] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.85, 22.52, 16.83
[19:03:15] <miraheze-github>	 miraheze/CreateWiki - Universal-Omega the build passed.
[19:04:39] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 8.15, 17.70, 16.44
[20:23:12] <MacFanBot>	 [02mw-config] 07OAuthority pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/91d21cc71d2946e625270d1f3513e436d4b41675
[20:23:12] <MacFanBot>	 02mw-config/03master 07Luke 0391d21cc Fix sitenotice typo
[20:24:09] <miraheze-github>	 miraheze/mw-config - OAuthority the build passed.
[21:06:07] <icinga-miraheze>	 PROBLEM - mwtask151 Current Load on mwtask151 is WARNING: LOAD WARNING - total load average: 22.66, 16.04, 10.35
[21:10:07] <icinga-miraheze>	 RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 19.47, 19.11, 12.99
[21:13:46] <MirahezeLSBot>	 !log [oa@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all
[21:14:07] <MirahezeLSBot>	 !log [oa@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 21s
[22:02:20] <icinga-miraheze>	 [Grafana] FIRING: The mediawiki job queue has more than 2000 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[22:25:55] <icinga-miraheze>	 RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 55259MiB (12% inode=99%);
[22:26:04] <MirahezeLSBot>	 !log [void@cp37] delete old nginx logs and manually trigger logrotate to compress logs
[22:26:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:49:59] <icinga-miraheze>	 PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 30.27, 21.17, 12.42
[22:55:59] <icinga-miraheze>	 PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 14.36, 23.17, 16.66
[22:57:59] <icinga-miraheze>	 RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 13.74, 19.33, 16.00
[22:59:51] <icinga-miraheze>	 PROBLEM - gielinorgames.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'gielinorgames.wiki' expires in 14 day(s) (Sun 09 Mar 2025 10:35:49 PM GMT +0000).
[23:00:03] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/b822fea79d54d216a62d5df21098e1f1e7bce35c
[23:00:03] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03b822fea Bot: Update SSL cert for gielinorgames.wiki
[23:09:59] <icinga-miraheze>	 PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 29.21, 20.90, 16.14
[23:17:59] <icinga-miraheze>	 PROBLEM - mwtask171 Current Load on mwtask171 is WARNING: LOAD WARNING - total load average: 12.21, 22.90, 19.95
[23:19:59] <icinga-miraheze>	 RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 5.60, 17.11, 18.20
[23:28:53] <icinga-miraheze>	 RECOVERY - gielinorgames.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'gielinorgames.wiki' will expire on Fri 23 May 2025 10:01:26 PM GMT +0000.
[23:29:59] <icinga-miraheze>	 PROBLEM - mwtask171 Current Load on mwtask171 is CRITICAL: LOAD CRITICAL - total load average: 28.81, 21.48, 18.28
[23:37:59] <icinga-miraheze>	 RECOVERY - mwtask171 Current Load on mwtask171 is OK: LOAD OK - total load average: 5.53, 17.79, 19.05