[00:05:54] PROBLEM - os141 PowerDNS Recursor on os141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:06:13] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 6.50, 3.87, 1.91 [00:06:18] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.24, 3.59, 3.22 [00:06:45] PROBLEM - mw134 Current Load on mw134 is WARNING: WARNING - load average: 10.62, 9.98, 8.13 [00:07:13] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 4 backends are down. mw132 mw141 mw142 mw143 [00:07:33] PROBLEM - mw143 Current Load on mw143 is CRITICAL: CRITICAL - load average: 12.59, 9.70, 5.80 [00:07:51] RECOVERY - os141 PowerDNS Recursor on os141 is OK: DNS OK: 1.599 second response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [00:08:18] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 12.44, 10.10, 6.46 [00:08:43] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 12.74, 10.78, 9.55 [00:08:44] RECOVERY - mw134 Current Load on mw134 is OK: OK - load average: 8.87, 9.89, 8.34 [00:09:21] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 16.04, 12.10, 7.64 [00:09:24] PROBLEM - cp35 Varnish Backends on cp35 is CRITICAL: 2 backends are down. mw142 mw134 [00:09:33] RECOVERY - mw143 Current Load on mw143 is OK: OK - load average: 7.02, 8.64, 5.89 [00:09:36] PROBLEM - cp25 Varnish Backends on cp25 is CRITICAL: 2 backends are down. mw142 mw134 [00:09:56] PROBLEM - cp24 Varnish Backends on cp24 is CRITICAL: 2 backends are down. mw142 mw134 [00:10:15] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.98, 10.50, 9.46 [00:10:18] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 4.74, 8.33, 6.27 [00:10:35] PROBLEM - db131 Current Load on db131 is CRITICAL: CRITICAL - load average: 11.73, 7.62, 4.93 [00:10:44] PROBLEM - os131 Current Load on os131 is CRITICAL: LOAD CRITICAL - total load average: 6.88, 4.64, 2.70 [00:11:18] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 7.47, 10.24, 7.51 [00:12:15] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 8.19, 9.95, 9.40 [00:12:33] PROBLEM - db131 Current Load on db131 is WARNING: WARNING - load average: 6.60, 7.36, 5.19 [00:13:55] RECOVERY - cp24 Varnish Backends on cp24 is OK: All 15 backends are healthy [00:14:18] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 10.02, 11.27, 8.06 [00:15:12] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 5.12, 8.84, 7.69 [00:15:13] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 15 backends are healthy [00:15:22] RECOVERY - cp35 Varnish Backends on cp35 is OK: All 15 backends are healthy [00:15:31] RECOVERY - cp25 Varnish Backends on cp25 is OK: All 15 backends are healthy [00:16:07] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 1.79, 3.47, 2.90 [00:16:18] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 6.30, 9.39, 7.76 [00:16:33] RECOVERY - db131 Current Load on db131 is OK: OK - load average: 3.92, 5.79, 5.06 [00:18:09] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 1.97, 3.01, 2.80 [00:18:12] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 2.62, 3.54, 3.62 [00:18:27] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 2.82, 3.71, 3.13 [00:18:43] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 9.48, 11.40, 11.08 [00:22:18] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 2.68, 3.23, 3.06 [00:24:12] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.86, 3.77, 3.64 [00:26:11] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.42, 3.54, 3.57 [00:28:10] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.11, 3.65, 3.60 [00:30:09] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.31, 3.51, 3.55 [00:30:43] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 9.92, 9.60, 10.16 [00:38:03] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.59, 10.11, 9.49 [00:40:02] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 12.34, 11.32, 10.03 [00:41:30] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 13.53, 11.50, 10.59 [00:41:50] PROBLEM - os131 Current Load on os131 is CRITICAL: LOAD CRITICAL - total load average: 6.56, 4.44, 3.36 [00:43:01] PROBLEM - db131 Current Load on db131 is CRITICAL: CRITICAL - load average: 8.98, 7.43, 5.72 [00:43:25] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 9.72, 11.26, 10.65 [00:44:01] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.29, 11.19, 10.35 [00:44:06] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.55, 3.95, 3.71 [00:44:58] PROBLEM - db131 Current Load on db131 is WARNING: WARNING - load average: 6.51, 7.33, 5.91 [00:46:00] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 7.12, 9.85, 9.97 [00:46:55] RECOVERY - db131 Current Load on db131 is OK: OK - load average: 4.37, 6.28, 5.69 [00:47:16] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 7.93, 9.56, 10.10 [00:48:04] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 2.75, 3.63, 3.66 [00:49:45] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 2.02, 3.51, 3.51 [00:51:44] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 1.76, 2.92, 3.30 [00:53:14] PROBLEM - ping6 on cp25 is CRITICAL: PING CRITICAL - Packet loss = 100% [00:53:31] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 4 datacenters are down: 51.195.201.140/cpweb, 51.89.139.24/cpweb, 51.222.14.30/cpweb, 51.222.12.133/cpweb [00:54:04] PROBLEM - Host cp25 is DOWN: PING CRITICAL - Packet loss = 100% [00:54:33] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 5.02, 4.51, 3.53 [00:55:30] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:56:01] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.91, 3.08, 3.37 [00:56:07] RECOVERY - Host cp25 is UP: PING OK - Packet loss = 0%, RTA = 9.80 ms [00:57:17] RECOVERY - ping6 on cp25 is OK: PING OK - Packet loss = 0%, RTA = 9.40 ms [01:00:18] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.51, 3.84, 3.61 [01:04:11] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.33, 3.85, 3.64 [01:06:08] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.27, 3.30, 3.47 [01:09:54] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.90, 3.79, 3.50 [01:10:08] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.18, 3.12, 3.38 [01:11:53] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.33, 3.81, 3.53 [01:15:52] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.69, 4.00, 3.69 [01:16:43] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.84, 9.95, 9.06 [01:18:43] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 6.81, 8.83, 8.76 [01:23:48] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.57, 3.03, 3.34 [01:34:27] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 11.00, 11.59, 7.64 [01:36:27] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 6.70, 9.51, 7.34 [03:14:27] PROBLEM - mail121 Current Load on mail121 is WARNING: LOAD WARNING - total load average: 1.90, 1.28, 0.70 [03:16:27] RECOVERY - mail121 Current Load on mail121 is OK: LOAD OK - total load average: 0.42, 0.92, 0.63 [04:18:53] [02mw-config] 07pisceskaze synchronize pull request 03#5347: Removal of $wgCitizenEnableSearch and $wgMultiBoilerplateDiplaySpecialPage - 13https://github.com/miraheze/mw-config/pull/5347 [05:44:29] PROBLEM - mail121 Current Load on mail121 is CRITICAL: LOAD CRITICAL - total load average: 4.84, 2.60, 1.18 [05:46:27] PROBLEM - mail121 Current Load on mail121 is WARNING: LOAD WARNING - total load average: 1.18, 1.99, 1.13 [05:48:27] RECOVERY - mail121 Current Load on mail121 is OK: LOAD OK - total load average: 0.30, 1.37, 1.00 [06:47:09] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [07:16:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [09:14:28] PROBLEM - mail121 Current Load on mail121 is WARNING: LOAD WARNING - total load average: 1.71, 1.28, 0.64 [09:16:27] RECOVERY - mail121 Current Load on mail121 is OK: LOAD OK - total load average: 0.33, 0.90, 0.58 [10:46:28] PROBLEM - mail121 Current Load on mail121 is CRITICAL: LOAD CRITICAL - total load average: 5.26, 3.71, 1.74 [10:52:27] RECOVERY - mail121 Current Load on mail121 is OK: LOAD OK - total load average: 0.10, 1.42, 1.36 [11:32:37] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.003008544445 secs [12:36:20] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.13, 3.24, 2.79 [12:39:24] PROBLEM - mem141 NTP time on mem141 is WARNING: NTP WARNING: Offset 0.1050597429 secs [12:40:18] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 3.33, 3.38, 2.96 [12:42:43] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 11.74, 10.53, 9.18 [12:43:10] PROBLEM - swiftproxy131 NTP time on swiftproxy131 is WARNING: NTP WARNING: Offset 0.1062000394 secs [12:44:43] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 12.09, 11.17, 9.58 [12:44:48] PROBLEM - mail121 Current Load on mail121 is CRITICAL: LOAD CRITICAL - total load average: 6.10, 2.55, 1.16 [12:45:27] RECOVERY - mem141 NTP time on mem141 is OK: NTP OK: Offset 0.09405767918 secs [12:46:43] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.17, 10.87, 9.67 [12:47:16] RECOVERY - swiftproxy131 NTP time on swiftproxy131 is OK: NTP OK: Offset 0.0975908339 secs [12:48:42] PROBLEM - mail121 Current Load on mail121 is WARNING: LOAD WARNING - total load average: 0.50, 1.77, 1.19 [12:50:39] RECOVERY - mail121 Current Load on mail121 is OK: LOAD OK - total load average: 0.38, 1.27, 1.07 [12:50:43] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 8.50, 9.43, 9.36 [13:18:02] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.84, 3.11, 2.74 [13:20:01] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 5.52, 3.63, 2.95 [13:22:00] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.30, 3.43, 2.96 [13:23:59] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.49, 3.13, 2.91 [14:14:39] PROBLEM - mail121 Current Load on mail121 is WARNING: LOAD WARNING - total load average: 1.93, 1.39, 0.73 [14:16:36] RECOVERY - mail121 Current Load on mail121 is OK: LOAD OK - total load average: 0.58, 1.11, 0.70 [14:21:47] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.81, 3.11, 2.83 [14:24:37] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1018612683 secs [14:25:47] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 3.01, 3.09, 2.88 [14:39:18] [02mw-config] 07redbluegreenhat opened pull request 03#5350: T11069: Add $wgPageImagesLeadSectionOnly to ManageWikiSettings - 13https://github.com/miraheze/mw-config/pull/5350 [14:40:27] miraheze/mw-config - redbluegreenhat the build passed. [14:46:28] PROBLEM - mail121 Current Load on mail121 is CRITICAL: LOAD CRITICAL - total load average: 3.33, 2.46, 1.19 [14:48:27] PROBLEM - mail121 Current Load on mail121 is WARNING: LOAD WARNING - total load average: 0.63, 1.79, 1.10 [14:50:27] RECOVERY - mail121 Current Load on mail121 is OK: LOAD OK - total load average: 0.13, 1.23, 0.98 [15:02:32] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.93, 3.54, 2.81 [15:04:03] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.09, 9.43, 8.35 [15:06:03] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 9.06, 9.03, 8.32 [15:06:31] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.12, 3.58, 3.04 [15:12:29] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.85, 4.03, 3.36 [15:14:28] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.01, 3.64, 3.31 [15:16:27] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.23, 3.32, 3.24 [15:16:27] PROBLEM - mail121 Current Load on mail121 is WARNING: LOAD WARNING - total load average: 1.80, 1.72, 1.04 [15:18:27] RECOVERY - mail121 Current Load on mail121 is OK: LOAD OK - total load average: 0.40, 1.22, 0.94 [16:05:35] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [16:07:18] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.75, 3.59, 2.35 [16:09:18] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 3.08, 3.32, 2.40 [16:12:59] PROBLEM - www.pomologia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.pomologia.org' expires in 15 day(s) (Sun 12 Nov 2023 15:51:58 GMT +0000). [16:13:23] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/16f2a051b992...b4f7bb09f1fd [16:13:26] [02miraheze/ssl] 07MirahezeSSLBot 03b4f7bb0 - Bot: Update SSL cert for www.pomologia.org [16:16:42] PROBLEM - mail121 Current Load on mail121 is CRITICAL: LOAD CRITICAL - total load average: 1.94, 2.04, 1.04 [16:18:39] RECOVERY - mail121 Current Load on mail121 is OK: LOAD OK - total load average: 0.26, 1.36, 0.90 [16:35:56] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.13, 3.15, 2.71 [16:37:55] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 3.28, 3.09, 2.74 [16:39:52] PROBLEM - puppet141 APT on puppet141 is CRITICAL: APT CRITICAL: 4 packages available for upgrade (4 critical updates). [16:42:00] RECOVERY - www.pomologia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'www.pomologia.org' will expire on Thu 25 Jan 2024 15:13:08 GMT +0000. [16:46:50] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.30, 3.96, 3.21 [16:50:48] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 2.79, 3.78, 3.34 [16:56:45] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.83, 3.24, 3.26 [17:09:06] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [17:12:57] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [17:30:35] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [18:46:41] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 10.72, 9.35, 8.50 [18:48:40] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 10.03, 9.64, 8.71 [18:48:50] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.35, 3.46, 3.09 [18:52:51] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.14, 3.53, 3.18 [18:54:50] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.79, 3.22, 3.11 [19:24:37] PROBLEM - ns1 NTP time on ns1 is CRITICAL: NTP CRITICAL: Offset 0.5150221288 secs [19:30:36] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [19:32:34] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.44, 3.25, 2.90 [19:34:33] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 2.37, 2.89, 2.82 [19:50:36] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [20:23:25] PROBLEM - cloud14 Puppet on cloud14 is UNKNOWN: NRPE: Unable to read output [20:38:43] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 11.25, 9.97, 7.95 [20:42:43] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 12.76, 11.28, 8.95 [20:44:43] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 6.82, 9.56, 8.61 [20:46:50] [02miraheze/mediawiki] 07The-Voidwalker pushed 031 commit to 03REL1_40 [+0/-0/±5] 13https://github.com/miraheze/mediawiki/compare/750664125a41...fbba282f6c9f [20:46:53] [02miraheze/mediawiki] 07paladox 03fbba282 - Fix infinite recursion with wgAutopromote when using blocked [20:47:50] !log [void@mwtask141] starting deploy of {'world': True} to all [20:48:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:51:24] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [20:53:22] !log [void@mwtask141] finished deploy of {'world': True} to all - SUCCESS in 332s [20:53:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:35:33] PROBLEM - mw143 Current Load on mw143 is CRITICAL: CRITICAL - load average: 16.80, 9.81, 6.12 [21:36:16] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:36:30] PROBLEM - mwtask141 Puppet on mwtask141 is WARNING: WARNING: Puppet is currently disabled, message: Testing --void, last run 27 minutes ago with 0 failures [21:36:30] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 17.56, 10.89, 6.97 [21:37:33] RECOVERY - mw143 Current Load on mw143 is OK: OK - load average: 6.44, 8.18, 5.98 [21:38:13] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.348 second response time [21:38:28] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 8.05, 9.56, 6.95 [21:52:18] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 15.61, 8.77, 6.20 [21:52:27] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 17.69, 10.46, 7.69 [21:53:29] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 13.03, 10.61, 9.30 [21:54:18] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 8.23, 8.76, 6.54 [21:55:28] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 9.54, 10.53, 9.45 [21:56:27] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 7.93, 11.29, 8.83 [21:58:18] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 6.49, 10.41, 8.00 [21:58:27] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 5.27, 9.08, 8.31 [21:59:27] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 8.00, 10.00, 9.56 [22:00:18] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 5.38, 8.53, 7.59 [22:00:31] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.62, 3.45, 2.76 [22:02:30] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 3.27, 3.35, 2.81 [22:15:20] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 11.42, 9.89, 9.24 [22:17:19] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 6.64, 8.99, 9.02 [23:03:03] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 14.16, 7.39, 3.35 [23:09:03] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 1.77, 7.17, 5.01 [23:11:03] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.34, 4.85, 4.42 [23:26:29] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [23:27:32] !log [void@mwtask141] starting deploy of {'world': True} to all [23:27:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:48] !log [void@mwtask141] finished deploy of {'world': True} to all - SUCCESS in 256s [23:31:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log