[00:15:15] <icinga-miraheze>	 RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 50731MiB (11% inode=99%);
[00:45:15] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 49843MiB (10% inode=99%);
[05:46:20] <icinga-miraheze>	 PROBLEM - changeprop151 Current Load on changeprop151 is CRITICAL: LOAD CRITICAL - total load average: 59.47, 39.07, 17.33
[05:52:20] <icinga-miraheze>	 RECOVERY - changeprop151 Current Load on changeprop151 is OK: LOAD OK - total load average: 1.24, 12.63, 12.14
[12:08:40] <icinga-miraheze>	 PROBLEM - cp37 Varnish Backends on cp37 is CRITICAL: 1 backends are down. mw161
[12:09:38] <icinga-miraheze>	 PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 22.13, 14.54, 7.88
[12:10:35] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.63, 15.79, 8.72
[12:10:35] <icinga-miraheze>	 PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 22.81, 15.33, 8.32
[12:11:38] <icinga-miraheze>	 RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 15.41, 14.99, 8.90
[12:12:15] <icinga-miraheze>	 PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 20.41, 16.33, 9.45
[12:12:35] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 16.50, 16.36, 9.84
[12:12:35] <icinga-miraheze>	 RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 16.04, 15.84, 9.41
[12:12:40] <icinga-miraheze>	 RECOVERY - cp37 Varnish Backends on cp37 is OK: All 29 backends are healthy
[12:14:09] <icinga-miraheze>	 RECOVERY - mw184 Current Load on mw184 is OK: LOAD OK - total load average: 20.13, 17.46, 10.66
[12:15:49] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.03, 19.02, 11.81
[12:16:35] <icinga-miraheze>	 PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 23.17, 19.62, 12.41
[12:17:08] <icinga-miraheze>	 PROBLEM - mw153 Current Load on mw153 is WARNING: LOAD WARNING - total load average: 22.43, 18.27, 11.43
[12:17:38] <icinga-miraheze>	 PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 23.76, 19.76, 12.81
[12:18:00] <icinga-miraheze>	 PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 23.35, 19.84, 12.90
[12:18:22] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 11.31, 8.52, 4.68
[12:19:08] <icinga-miraheze>	 RECOVERY - mw153 Current Load on mw153 is OK: LOAD OK - total load average: 17.18, 17.83, 12.12
[12:19:38] <icinga-miraheze>	 RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 20.38, 20.19, 13.83
[12:19:49] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 17.54, 18.72, 13.45
[12:19:55] <icinga-miraheze>	 RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 19.56, 19.83, 13.69
[12:20:22] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 8.29, 8.46, 5.14
[12:23:07] <icinga-miraheze>	 PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 23.36, 21.62, 15.35
[12:23:43] <icinga-miraheze>	 PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 23.73, 21.77, 15.82
[12:24:31] <icinga-miraheze>	 PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 23.31, 20.84, 15.38
[12:24:40] <icinga-miraheze>	 PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 23.16, 21.22, 15.84
[12:25:01] <icinga-miraheze>	 RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 15.39, 18.91, 15.06
[12:25:30] <icinga-miraheze>	 PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 22.48, 21.08, 15.99
[12:25:37] <icinga-miraheze>	 RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 17.58, 19.71, 15.74
[12:26:31] <icinga-miraheze>	 RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 14.79, 18.42, 15.16
[12:26:35] <icinga-miraheze>	 RECOVERY - mw184 Current Load on mw184 is OK: LOAD OK - total load average: 18.13, 20.37, 16.18
[12:26:38] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 20.72, 19.86, 15.90
[12:28:32] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 14.63, 18.35, 15.85
[12:32:22] <icinga-miraheze>	 PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 21.39, 20.23, 17.16
[12:32:35] <icinga-miraheze>	 RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 19.37, 20.18, 17.71
[12:33:38] <icinga-miraheze>	 PROBLEM - mw172 Current Load on mw172 is WARNING: LOAD WARNING - total load average: 22.49, 20.76, 17.69
[12:34:14] <icinga-miraheze>	 PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 20.56, 20.66, 17.91
[12:36:00] <icinga-miraheze>	 [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[12:36:18] <icinga-miraheze>	 PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 22.88, 21.31, 18.36
[12:36:28] <icinga-miraheze>	 PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 23.56, 21.78, 18.44
[12:36:35] <icinga-miraheze>	 PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 21.39, 20.68, 18.50
[12:38:20] <icinga-miraheze>	 PROBLEM - changeprop151 Current Load on changeprop151 is CRITICAL: LOAD CRITICAL - total load average: 17.08, 20.08, 10.87
[12:38:22] <icinga-miraheze>	 PROBLEM - mw161 Current Load on mw161 is CRITICAL: LOAD CRITICAL - total load average: 24.12, 22.57, 19.13
[12:38:35] <icinga-miraheze>	 RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 15.35, 18.96, 18.16
[12:39:57] <icinga-miraheze>	 PROBLEM - mw184 Current Load on mw184 is CRITICAL: LOAD CRITICAL - total load average: 24.04, 22.80, 19.73
[12:40:18] <icinga-miraheze>	 PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 23.17, 22.79, 19.62
[12:41:38] <icinga-miraheze>	 RECOVERY - mw172 Current Load on mw172 is OK: LOAD OK - total load average: 17.53, 20.07, 18.83
[12:41:52] <icinga-miraheze>	 PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 23.32, 22.96, 20.15
[12:41:54] <icinga-miraheze>	 RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 20.02, 20.19, 18.66
[12:42:22] <icinga-miraheze>	 PROBLEM - db171 Current Load on db171 is WARNING: LOAD WARNING - total load average: 10.86, 9.71, 7.34
[12:42:35] <icinga-miraheze>	 PROBLEM - mw171 Current Load on mw171 is WARNING: LOAD WARNING - total load average: 23.45, 21.13, 19.22
[12:43:16] <icinga-miraheze>	 RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 13.99, 19.54, 19.28
[12:44:20] <icinga-miraheze>	 RECOVERY - changeprop151 Current Load on changeprop151 is OK: LOAD OK - total load average: 4.36, 13.25, 11.34
[12:44:22] <icinga-miraheze>	 RECOVERY - db171 Current Load on db171 is OK: LOAD OK - total load average: 8.12, 9.33, 7.50
[12:44:35] <icinga-miraheze>	 RECOVERY - mw171 Current Load on mw171 is OK: LOAD OK - total load average: 19.41, 20.39, 19.19
[12:45:41] <icinga-miraheze>	 RECOVERY - mw184 Current Load on mw184 is OK: LOAD OK - total load average: 8.48, 17.87, 18.92
[12:45:49] <icinga-miraheze>	 RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 9.55, 18.47, 18.97
[12:46:18] <icinga-miraheze>	 RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 7.80, 18.19, 19.06
[12:51:00] <icinga-miraheze>	 [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1
[13:47:15] <icinga-miraheze>	 PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 27164MiB (5% inode=99%);
[14:42:54] <icinga-miraheze>	 PROBLEM - encyclopediarobotica.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'encyclopediarobotica.org' expires in 14 day(s) (Sun 09 Feb 2025 02:29:45 PM GMT +0000).
[14:43:05] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/fb2f26b35554fc7ad9fd5e9feb9128ac0102bb7b
[14:43:05] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03fb2f26b Bot: Update SSL cert for encyclopediarobotica.org
[15:02:19] <icinga-miraheze>	 PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 139.91 ms
[15:06:21] <icinga-miraheze>	 RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 140.38 ms
[15:14:58] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/d4c40dd2e5746d87b513fc29e23900c8d8ea352b
[15:14:58] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03d4c40dd Bot: Update SSL cert for encyclopediarobotica.org
[15:19:17] <MacFanBot>	 [02ssl] 07MacFan4000 pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/ea9dc5091fbdcb944987ebc8bdca98640e2ae8a6
[15:19:17] <MacFanBot>	 02ssl/03master 07MacFan4000 03ea9dc50 remove wiki.dragonsmp.pro (expired)
[15:26:22] <MacFanBot>	 [02mw-config] 07AgentIsai pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/f525471eb3f63de039248929bd5cefaa2457f726
[15:26:22] <MacFanBot>	 02mw-config/03master 07Agent Isai 03f525471 Fix image size and missing style
[15:27:20] <miraheze-github>	 miraheze/mw-config - AgentIsai the build passed.
[15:28:34] <icinga-miraheze>	 PROBLEM - changeprop151 Current Load on changeprop151 is WARNING: LOAD WARNING - total load average: 15.84, 13.02, 7.36
[15:30:30] <icinga-miraheze>	 RECOVERY - changeprop151 Current Load on changeprop151 is OK: LOAD OK - total load average: 6.30, 11.22, 7.43
[15:40:20] <icinga-miraheze>	 PROBLEM - changeprop151 Current Load on changeprop151 is CRITICAL: LOAD CRITICAL - total load average: 8.61, 16.70, 11.32
[15:40:54] <icinga-miraheze>	 RECOVERY - encyclopediarobotica.org - LetsEncrypt on sslhost is OK: OK - Certificate 'encyclopediarobotica.org' will expire on Fri 25 Apr 2025 01:44:30 PM GMT +0000.
[15:42:20] <icinga-miraheze>	 RECOVERY - changeprop151 Current Load on changeprop151 is OK: LOAD OK - total load average: 5.25, 12.63, 10.47
[15:54:09] <icinga-miraheze>	 PROBLEM - changeprop151 Current Load on changeprop151 is CRITICAL: LOAD CRITICAL - total load average: 13.51, 19.68, 13.99
[15:56:09] <icinga-miraheze>	 PROBLEM - changeprop151 Current Load on changeprop151 is WARNING: LOAD WARNING - total load average: 3.75, 14.06, 12.63
[15:58:09] <icinga-miraheze>	 RECOVERY - changeprop151 Current Load on changeprop151 is OK: LOAD OK - total load average: 2.46, 10.27, 11.42
[16:04:18] <icinga-miraheze>	 PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 139.91 ms
[16:06:16] <icinga-miraheze>	 RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 139.96 ms
[16:40:28] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.65, 19.27, 12.63
[16:48:25] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 10.70, 17.66, 15.06
[16:56:21] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.57, 18.14, 15.47
[17:04:18] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.34, 22.70, 18.75
[17:06:18] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 14.13, 20.00, 18.29
[17:20:09] <icinga-miraheze>	 PROBLEM - changeprop151 Current Load on changeprop151 is CRITICAL: LOAD CRITICAL - total load average: 22.93, 13.26, 7.59
[17:22:09] <icinga-miraheze>	 RECOVERY - changeprop151 Current Load on changeprop151 is OK: LOAD OK - total load average: 6.06, 9.96, 7.06
[17:32:25] <icinga-miraheze>	 PROBLEM - www.durawiki.com - Cloudflare on sslhost is CRITICAL: No address associated with hostnameHTTP CRITICAL - Unable to open TCP socket
[17:34:06] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.02, 18.25, 15.28
[17:36:06] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 21.94, 19.48, 16.10
[17:42:03] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 9.97, 17.99, 16.94
[18:06:53] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is WARNING: LOAD WARNING - total load average: 23.26, 20.11, 16.60
[18:10:52] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 16.74, 19.54, 17.26
[18:14:50] <icinga-miraheze>	 PROBLEM - mwtask181 Current Load on mwtask181 is CRITICAL: LOAD CRITICAL - total load average: 24.50, 22.01, 18.77
[18:16:49] <icinga-miraheze>	 RECOVERY - mwtask181 Current Load on mwtask181 is OK: LOAD OK - total load average: 15.05, 20.00, 18.47
[22:12:39] <icinga-miraheze>	 PROBLEM - binrayarchives.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'binrayarchives.com' expires in 14 day(s) (Sun 09 Feb 2025 09:53:22 PM GMT +0000).
[22:12:50] <MacFanBot>	 [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/c16d677d5b99b92fc77059502f212b06658620ed
[22:12:51] <MacFanBot>	 02ssl/03master 07WikiTideSSLBot 03c16d677 Bot: Update SSL cert for binrayarchives.com
[22:41:18] <icinga-miraheze>	 RECOVERY - binrayarchives.com - LetsEncrypt on sslhost is OK: OK - Certificate 'binrayarchives.com' will expire on Fri 25 Apr 2025 09:14:14 PM GMT +0000.