[00:01:30] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 37.02, 15.14, 6.21 [00:03:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.62, 3.27, 2.93 [00:05:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.36, 4.07, 3.27 [00:08:12] [02puppet] 07redbluegreenhat commented on pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121#issuecomment-1382973318 [00:09:13] PROBLEM - cp23 SSH on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:09:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.29, 3.62, 3.31 [00:09:36] PROBLEM - cp23 PowerDNS Recursor on cp23 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:10:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.57, 4.19, 3.35 [00:10:44] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1938377619 secs [00:10:52] [02MirahezeMagic] 07AgentIsai opened pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [00:11:09] RECOVERY - cp23 SSH on cp23 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [00:11:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.02, 3.13, 3.15 [00:11:33] RECOVERY - cp23 PowerDNS Recursor on cp23 is OK: DNS OK: 1.502 second response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [00:12:16] [02puppet] 07redbluegreenhat edited a comment on pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121#issuecomment-1382973318 [00:14:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.86, 3.97, 3.50 [00:14:35] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 15.63, 7.30, 3.47 [00:16:27] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.67, 3.37, 3.32 [00:19:21] miraheze/MirahezeMagic - AgentIsai the build passed. [00:19:49] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [00:20:20] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [00:20:34] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.42, 2.83, 2.71 [00:22:20] miraheze/MirahezeMagic - AgentIsai the build has errored. [00:22:38] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.09229490161 secs [00:22:50] miraheze/MirahezeMagic - AgentIsai the build has errored. [00:24:32] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [00:26:03] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.45, 5.04, 4.04 [00:28:32] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [00:33:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.56, 3.67, 3.85 [00:37:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.81, 2.41, 3.31 [00:37:57] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.19, 3.56, 3.13 [00:41:47] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.89, 3.05, 3.04 [00:43:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.38, 1.85, 3.94 [00:45:17] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [00:47:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.89, 1.19, 3.18 [00:54:48] miraheze/MirahezeMagic - AgentIsai the build passed. [00:58:38] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.205966264 secs [01:04:39] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.003886252642 secs [01:05:59] [02MirahezeMagic] 07AgentIsai synchronize pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392 [01:06:51] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.08, 1.51, 0.94 [01:14:51] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.87, 1.93, 1.42 [01:14:58] miraheze/MirahezeMagic - AgentIsai the build passed. [01:20:51] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.05, 1.93, 1.57 [01:26:06] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.73, 6.59, 4.12 [01:29:08] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.08, 2.68, 1.82 [01:31:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.78, 3.44, 2.23 [01:33:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.12, 2.62, 2.08 [01:35:42] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.86, 3.53, 3.99 [01:42:51] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.65, 1.98, 1.96 [01:43:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.37, 2.46, 3.37 [01:44:53] [02MirahezeMagic] 07Universal-Omega commented on pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392#issuecomment-1383020526 [01:48:51] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.31, 2.08, 2.01 [01:50:51] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.73, 1.97, 1.98 [01:55:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.86, 3.44, 3.37 [01:57:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.26, 3.37, 3.35 [02:01:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.68, 3.61, 2.69 [02:03:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.12, 2.99, 2.57 [02:06:52] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.05, 1.92, 1.90 [02:07:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.31, 6.30, 4.09 [02:15:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.84, 3.27, 3.55 [02:17:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.19, 2.56, 3.26 [02:20:53] [02MirahezeMagic] 07AgentIsai commented on pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392#issuecomment-1383029492 [02:22:51] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.00, 1.65, 1.89 [02:26:32] [02MirahezeMagic] 07Universal-Omega commented on pull request 03#392: Create community portals on wiki creation - 13https://github.com/miraheze/MirahezeMagic/pull/392#issuecomment-1383031293 [02:29:08] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.51, 3.65, 2.06 [02:30:51] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.74, 1.18, 1.59 [02:31:09] [02mw-config] 07AgentIsai opened pull request 03#5069: Minor tweaks to Sitenotice - 13https://github.com/miraheze/mw-config/pull/5069 [02:32:05] miraheze/mw-config - AgentIsai the build passed. [02:33:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.53, 3.49, 2.40 [02:35:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.76, 2.53, 2.18 [02:49:03] [02mw-config] 07AgentIsai synchronize pull request 03#5069: Minor tweaks to Sitenotice - 13https://github.com/miraheze/mw-config/pull/5069 [02:50:07] miraheze/mw-config - AgentIsai the build passed. [02:53:01] [02mw-config] 07Universal-Omega reviewed pull request 03#5069 commit - 13https://github.com/miraheze/mw-config/pull/5069#discussion_r1070487343 [02:53:13] [02mw-config] 07Universal-Omega reviewed pull request 03#5069 commit - 13https://github.com/miraheze/mw-config/pull/5069#discussion_r1070487343 [02:53:20] [02mw-config] 07Universal-Omega reviewed pull request 03#5069 commit - 13https://github.com/miraheze/mw-config/pull/5069#discussion_r1070487343 [02:56:19] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 11.56, 5.79, 3.91 [02:56:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=hkrailwiki /home/reception/wikibackups1812/hkrailwiki.xml (START) [02:57:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:38] [02mw-config] 07AgentIsai synchronize pull request 03#5069: Minor tweaks to Sitenotice - 13https://github.com/miraheze/mw-config/pull/5069 [02:57:43] [02mw-config] 07AgentIsai reviewed pull request 03#5069 commit - 13https://github.com/miraheze/mw-config/pull/5069#discussion_r1070487909 [02:58:39] miraheze/mw-config - AgentIsai the build passed. [03:00:57] [02mw-config] 07Universal-Omega reviewed pull request 03#5069 commit - 13https://github.com/miraheze/mw-config/pull/5069#discussion_r1070488508 [03:01:26] [02mw-config] 07Universal-Omega reviewed pull request 03#5069 commit - 13https://github.com/miraheze/mw-config/pull/5069#discussion_r1070488628 [03:05:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.80, 3.87, 3.99 [03:07:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.96, 3.93, 3.07 [03:07:54] [02mw-config] 07AgentIsai reviewed pull request 03#5069 commit - 13https://github.com/miraheze/mw-config/pull/5069#discussion_r1070489635 [03:09:28] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.75, 3.11, 2.86 [03:11:09] [02mw-config] 07Universal-Omega reviewed pull request 03#5069 commit - 13https://github.com/miraheze/mw-config/pull/5069#discussion_r1070490248 [03:15:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.30, 2.78, 3.37 [03:17:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.22, 4.10, 3.22 [03:19:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.75, 3.20, 3.00 [03:25:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.33, 5.64, 4.18 [03:26:37] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=hkrailwiki /home/reception/wikibackups1812/hkrailwiki.xml (END - exit=0) [03:26:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=hkrailwiki (START) [03:26:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:26:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:31:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.63, 4.88, 3.49 [03:31:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.79, 3.28, 3.60 [03:37:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.41, 3.03, 3.39 [03:39:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.87, 3.96, 3.86 [03:41:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.83, 3.39, 3.48 [03:43:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.80, 2.67, 3.35 [03:43:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.18, 2.99, 3.32 [03:46:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=hkrailwiki (END - exit=0) [03:46:42] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hkrailwiki --missing (START) [03:46:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:46:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:46:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hkrailwiki --missing (END - exit=0) [03:46:56] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=hkrailwiki --active --update (END - exit=0) [03:46:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:47:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:11:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.42, 4.13, 3.28 [04:19:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.18, 3.95, 3.67 [04:21:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.91, 4.00, 3.69 [04:23:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.21, 3.30, 3.47 [04:25:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.67, 3.08, 3.37 [04:29:08] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.08, 2.81, 1.74 [04:33:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.94, 2.85, 2.05 [04:34:07] [02mw-config] 07AgentIsai reviewed pull request 03#5069 commit - 13https://github.com/miraheze/mw-config/pull/5069#discussion_r1070498907 [04:36:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 2.35, 4.15, 3.83 [04:36:44] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.26, 3.65, 2.95 [04:38:24] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.24, 3.64, 3.69 [04:44:09] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.07, 3.68, 3.65 [04:46:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.46, 3.37, 3.53 [04:48:00] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.57, 2.79, 3.31 [04:52:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.15, 3.44, 3.75 [04:56:28] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/11b2d87c2a86...f25cf1070ffb [04:56:30] [02miraheze/mw-config] 07Universal-Omega 03f25cf10 - Add learn more button to site notice [04:56:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.51, 5.62, 4.41 [04:57:18] !log [@test131] starting deploy of {'config': True} to all [04:57:19] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 1s [04:57:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:57:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:57:34] miraheze/mw-config - Universal-Omega the build passed. [04:57:54] !log [universalomega@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [04:57:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:58:01] !log [universalomega@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [04:58:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:59:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.69, 2.72, 3.31 [05:04:20] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.94, 3.55, 3.94 [05:08:01] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [05:09:23] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.46, 3.81, 3.42 [05:10:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.02, 3.60, 3.84 [05:11:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.74, 3.07, 3.20 [05:12:01] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.72, 3.41, 3.75 [05:17:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.93, 2.83, 3.33 [05:23:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.36, 4.13, 3.70 [05:25:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.84, 3.81, 3.62 [05:27:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.34, 4.05, 3.74 [05:29:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.69, 3.61, 3.62 [05:31:08] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.23, 3.76, 2.17 [05:31:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.61, 3.97, 3.72 [05:31:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.99, 4.31, 3.60 [05:33:44] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.75, 3.90, 3.52 [05:35:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.79, 3.90, 2.60 [05:35:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.37, 5.41, 4.10 [05:36:31] RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [05:37:08] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.65, 4.46, 2.95 [05:37:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.48, 3.14, 3.54 [05:39:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.80, 3.99, 2.96 [05:39:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.48, 2.79, 3.38 [05:41:25] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.45, 3.79, 3.78 [05:43:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.85, 2.78, 2.75 [05:45:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.52, 2.39, 3.19 [05:55:38] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.87, 4.55, 3.49 [06:01:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.67, 3.64, 3.01 [06:03:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.11, 3.14, 2.89 [06:07:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.49, 3.74, 3.23 [06:09:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.45, 2.95, 3.00 [06:11:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.13, 3.21, 3.95 [06:15:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.29, 2.23, 3.38 [06:25:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 15.16, 6.81, 4.51 [06:29:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.41, 3.64, 2.18 [06:31:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.26, 2.88, 2.09 [06:31:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.94, 3.71, 3.88 [06:35:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.70, 2.65, 3.40 [06:59:08] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.43, 2.92, 1.85 [07:01:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.22, 2.82, 1.97 [07:02:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.70, 2.76, 2.29 [07:04:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.08, 2.64, 2.29 [07:07:55] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.21, 4.22, 3.09 [07:09:50] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.89, 3.48, 2.96 [07:11:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.26, 3.50, 3.03 [07:11:45] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.59, 2.84, 2.78 [07:15:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.78, 3.46, 3.22 [07:17:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.82, 3.07, 3.11 [07:23:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.20, 4.06, 3.55 [07:25:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.59, 3.23, 3.31 [07:56:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.02, 3.39, 2.81 [08:01:50] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.25, 3.40, 3.10 [08:31:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.60, 3.56, 2.86 [08:33:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.86, 2.55, 2.58 [08:55:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.64, 4.55, 2.78 [09:01:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.53, 3.52, 2.93 [09:03:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.96, 2.84, 2.75 [09:11:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.43, 5.35, 3.60 [09:13:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.98, 3.90, 3.28 [09:15:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.33, 3.08, 3.06 [09:25:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.05, 5.34, 3.68 [09:31:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.97, 3.27, 3.41 [09:33:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.68, 2.41, 3.08 [10:22:19] PROBLEM - db121 Backups SQL on db121 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864134 seconds old and 48 bytes [10:58:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 1.87, 4.25, 3.07 [11:00:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.86, 3.15, 2.81 [11:03:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.76, 3.53, 2.10 [11:07:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.07, 3.70, 2.54 [11:09:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.22, 3.76, 2.70 [11:11:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.21, 3.25, 2.64 [11:27:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.71, 3.17, 2.23 [11:31:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.40, 3.00, 2.48 [11:38:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.10, 5.21, 3.13 [11:42:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.81, 3.67, 3.01 [11:43:58] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.87, 2.83, 2.78 [11:58:29] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.24, 3.67, 2.61 [11:59:08] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.12, 3.38, 1.95 [12:00:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.30, 2.80, 2.41 [12:01:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.70, 3.83, 2.32 [12:03:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.33, 2.90, 2.16 [12:09:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.80, 3.58, 2.51 [12:13:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.52, 2.91, 2.52 [12:27:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.35, 4.46, 2.79 [12:29:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 3.29, 2.56 [13:08:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.41, 3.29, 2.29 [13:10:06] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.26, 3.06, 2.34 [13:25:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.65, 3.80, 2.49 [13:27:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.19, 3.02, 2.36 [14:07:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.01, 2.97, 2.11 [14:09:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.67, 3.19, 2.32 [14:22:02] [02puppet] 07redbluegreenhat synchronize pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121 [14:22:05] [02puppet] 07redbluegreenhat closed pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121 [14:24:17] [02puppet] 07redbluegreenhat commented on pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121#issuecomment-1383164105 [14:25:43] [02puppet] 07redbluegreenhat synchronize pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121 [14:25:45] [02puppet] 07redbluegreenhat reopened pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121 [14:26:11] [02puppet] 07redbluegreenhat commented on pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121#issuecomment-1383164537 [14:26:54] [02puppet] 07redbluegreenhat edited a comment on pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121#issuecomment-1383164105 [14:28:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.98, 4.29, 2.87 [14:30:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.97, 3.40, 2.72 [14:33:41] [02puppet] 07paladox reviewed pull request 03#3121 commit - 13https://github.com/miraheze/puppet/pull/3121#discussion_r1070608654 [14:35:18] [02puppet] 07redbluegreenhat opened pull request 03#3123: Do not cache OAuth2 requests - 13https://github.com/miraheze/puppet/pull/3123 [14:38:06] [02puppet] 07redbluegreenhat reviewed pull request 03#3121 commit - 13https://github.com/miraheze/puppet/pull/3121#discussion_r1070609443 [14:38:58] [02puppet] 07paladox reviewed pull request 03#3121 commit - 13https://github.com/miraheze/puppet/pull/3121#discussion_r1070609572 [14:39:50] [02puppet] 07redbluegreenhat edited pull request 03#3123: Do not cache OAuth2 requests - 13https://github.com/miraheze/puppet/pull/3123 [14:44:23] [02puppet] 07redbluegreenhat reviewed pull request 03#3121 commit - 13https://github.com/miraheze/puppet/pull/3121#discussion_r1070610423 [14:49:23] [02puppet] 07redbluegreenhat synchronize pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121 [14:50:45] [02puppet] 07redbluegreenhat edited pull request 03#3123: Do not cache OAuth2 requests - 13https://github.com/miraheze/puppet/pull/3123 [14:55:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.74, 4.79, 3.28 [14:56:16] [02puppet] 07paladox closed pull request 03#3121: T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download - 13https://github.com/miraheze/puppet/pull/3121 [14:56:19] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/ccbaf2398631...b071f9cfc51f [14:56:21] [02miraheze/puppet] 07redbluegreenhat 03b071f9c - T10285: Set Content-Disposition header on static.miraheze.org requests containing ?download (#3121) [15:03:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.01, 3.69, 3.60 [15:05:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.29, 2.83, 3.29 [15:09:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.96, 3.47, 2.60 [15:11:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.46, 2.69, 2.42 [15:12:53] [02puppet] 07redbluegreenhat commented on pull request 03#3123: Do not cache OAuth2 requests - 13https://github.com/miraheze/puppet/pull/3123#issuecomment-1383176858 [15:18:59] [02puppet] 07redbluegreenhat closed pull request 03#3123: Do not cache OAuth2 requests - 13https://github.com/miraheze/puppet/pull/3123 [15:25:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.89, 4.07, 3.08 [15:31:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.24, 3.78, 3.42 [15:33:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.15, 2.87, 3.13 [15:40:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.50, 3.63, 2.70 [15:41:02] !log xomniwiki(db142): ALTER TABLE /*$wgDBprefix*/searchindex ADD FULLTEXT si_title (si_title), ADD FULLTEXT si_text (si_text); [15:41:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:42:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.91, 3.51, 2.75 [15:43:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.86, 3.47, 3.09 [15:43:39] [02puppet] 07RhinosF1 commented on pull request 03#3123: Do not cache OAuth2 requests - 13https://github.com/miraheze/puppet/pull/3123#issuecomment-1383183598 [15:44:03] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.66, 3.82, 2.95 [15:45:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.54, 3.72, 3.24 [15:45:58] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.93, 3.08, 2.79 [15:47:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.23, 3.14, 3.08 [15:50:35] [02puppet] 07redbluegreenhat commented on pull request 03#3123: Do not cache OAuth2 requests - 13https://github.com/miraheze/puppet/pull/3123#issuecomment-1383185028 [15:50:35] !log sudo -u www-data php findBadBlobs.php --wiki xomniwiki --revisions 13651 --mark "known bad" [15:50:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:56:08] !log sudo -u www-data php findBadBlobs.php --wiki xomniwiki --revisions 13634,13632,13633,13635,13636,13637,13638,13639,13640,13641,13642,13643,13644,13645,13646,13647,13648,13649,13650,13653,14751 --mark "known bad" [15:56:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:27:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.31, 4.83, 3.35 [16:29:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.91, 3.79, 3.16 [16:33:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.43, 2.80, 2.91 [16:56:00] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.94, 3.85, 2.90 [17:01:52] PROBLEM - cp33 SSH on cp33 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:02:21] PROBLEM - cp33 PowerDNS Recursor on cp33 is CRITICAL: CRITICAL - Plugin timed out while executing system call [17:04:19] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:05:16] PROBLEM - cp33 Puppet on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:08:01] RECOVERY - cp33 SSH on cp33 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [17:08:01] RECOVERY - cp33 Puppet on cp33 is OK: OK: Puppet is currently enabled, last run 40 minutes ago with 0 failures [17:09:18] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [17:10:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.16, 4.88, 3.34 [17:10:57] RECOVERY - cp33 PowerDNS Recursor on cp33 is OK: DNS OK: 0.677 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [17:14:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.18, 3.82, 3.27 [17:15:57] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.60, 3.12, 3.08 [17:29:08] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.08, 2.91, 2.00 [17:33:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.65, 2.69, 2.16 [17:37:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.74, 3.64, 3.09 [17:39:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.70, 3.38, 3.07 [17:43:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.09, 3.84, 3.40 [17:44:45] [02miraheze/.github] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/.github/compare/7355856abb4d...0ff257200f5d [17:44:47] [02miraheze/.github] 07Universal-Omega 030ff2572 - CI: add PHP 8.1 tests [17:45:10] [02miraheze/CustomHeader] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CustomHeader/compare/8600dd74a77a...bf85498feba0 [17:45:11] [02miraheze/CustomHeader] 07Universal-Omega 03bf85498 - Update workflow [17:45:14] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/cbb9c92175dd...ba5098675674 [17:45:17] [02miraheze/GlobalNewFiles] 07Universal-Omega 03ba50986 - Update workflow [17:45:18] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/eb6df3422e29...8dfbecb4913d [17:45:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.45, 3.23, 3.22 [17:45:20] [02miraheze/DataDump] 07Universal-Omega 038dfbecb - Update workflow [17:45:23] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/31091d9936bd...9ef60e1dbbbf [17:45:26] [02miraheze/RemovePII] 07Universal-Omega 039ef60e1 - Update workflow [17:45:28] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/1640ef6436d3...56838bde23dd [17:45:31] [02miraheze/WikiDiscover] 07Universal-Omega 0356838bd - Update workflow [17:45:32] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/e9f71791745a...675942d2de50 [17:45:34] [02miraheze/CreateWiki] 07Universal-Omega 03675942d - Update workflow [17:45:36] [02miraheze/PDFEmbed] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/92b0995b1937...7c3a04360c65 [17:45:37] [02miraheze/PDFEmbed] 07Universal-Omega 037c3a043 - Update workflow [17:45:39] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/1c169e6c96c6...2a39241a62b9 [17:45:41] [02miraheze/ImportDump] 07Universal-Omega 032a39241 - Update workflow [17:45:44] [02miraheze/RottenLinks] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RottenLinks/compare/a91e74655a83...b3508fa5dd3d [17:45:47] [02miraheze/RottenLinks] 07Universal-Omega 03b3508fa - Update workflow [17:45:48] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/af8ae6861c1b...a1cea7be14e2 [17:45:51] [02miraheze/ManageWiki] 07Universal-Omega 03a1cea7b - Update workflow [17:45:53] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/ca5a6084f0b1...8ca7af634cfd [17:45:55] [02miraheze/IncidentReporting] 07Universal-Omega 038ca7af6 - Update workflow [17:45:57] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/99860e2625a4...d4c7fb2adea2 [17:46:00] [02miraheze/MatomoAnalytics] 07Universal-Omega 03d4c7fb2 - Update workflow [17:46:01] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/500935f58efb...4e2dd5a1246c [17:46:04] [02miraheze/MirahezeMagic] 07Universal-Omega 034e2dd5a - Update workflow [17:46:06] [02miraheze/SpriteSheet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/60bc01f938b2...717a632a56e3 [17:46:08] [02miraheze/SpriteSheet] 07Universal-Omega 03717a632 - Update workflow [17:46:10] [02miraheze/YouTube] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/YouTube/compare/28d9f9985c01...166d610cc608 [17:46:11] [02miraheze/YouTube] 07Universal-Omega 03166d610 - Update workflow [17:47:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.95, 2.51, 4.00 [17:51:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.81, 3.27, 3.16 [17:53:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.87, 2.73, 2.97 [17:53:47] miraheze/MirahezeMagic - Universal-Omega the build has errored. [17:54:48] miraheze/GlobalNewFiles - Universal-Omega the build passed. [17:57:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.69, 2.50, 3.35 [18:01:12] miraheze/WikiDiscover - Universal-Omega the build passed. [18:01:16] miraheze/CustomHeader - Universal-Omega the build passed. [18:04:09] miraheze/RemovePII - Universal-Omega the build passed. [18:04:21] miraheze/MatomoAnalytics - Universal-Omega the build passed. [18:04:24] miraheze/ManageWiki - Universal-Omega the build passed. [18:04:31] miraheze/RottenLinks - Universal-Omega the build passed. [18:04:34] miraheze/YouTube - Universal-Omega the build passed. [18:04:40] miraheze/PDFEmbed - Universal-Omega the build passed. [18:04:58] miraheze/IncidentReporting - Universal-Omega the build passed. [18:05:09] miraheze/SpriteSheet - Universal-Omega the build passed. [18:05:18] miraheze/DataDump - Universal-Omega the build passed. [18:07:51] [02puppet] 07redbluegreenhat opened pull request 03#3124: Use SRI when fetching Bootstrap CSS - 13https://github.com/miraheze/puppet/pull/3124 [18:09:47] miraheze/ImportDump - Universal-Omega the build passed. [18:10:08] miraheze/CreateWiki - Universal-Omega the build passed. [18:25:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.40, 3.88, 3.09 [18:30:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.41, 3.15, 3.10 [18:38:32] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [18:42:32] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [18:47:21] [02ErrorPages] 07redbluegreenhat opened pull request 03#34: Use SRI when fetching Bootstrap CSS - 13https://github.com/miraheze/ErrorPages/pull/34 [18:53:03] miraheze/ErrorPages - redbluegreenhat the build passed. [18:53:07] [02puppet] 07Universal-Omega closed pull request 03#3124: Use SRI when fetching Bootstrap CSS - 13https://github.com/miraheze/puppet/pull/3124 [18:53:10] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b071f9cfc51f...3ad7c0275ba0 [18:53:13] [02miraheze/puppet] 07redbluegreenhat 033ad7c02 - Use SRI when fetching Bootstrap CSS (#3124) [18:53:32] [02ErrorPages] 07Universal-Omega closed pull request 03#34: Use SRI when fetching Bootstrap CSS - 13https://github.com/miraheze/ErrorPages/pull/34 [18:53:35] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±5] 13https://github.com/miraheze/ErrorPages/compare/90fe3888b9ca...5e5e9d18542d [18:53:37] [02miraheze/ErrorPages] 07redbluegreenhat 035e5e9d1 - Use SRI when fetching Bootstrap CSS (#34) [18:54:28] miraheze/ErrorPages - Universal-Omega the build passed. [18:54:52] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.45, 4.26, 3.24 [19:02:32] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.02, 3.70, 3.61 [19:04:27] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.85, 3.07, 3.39 [19:11:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.76, 3.46, 2.89 [19:12:53] [02landing] 07redbluegreenhat opened pull request 03#111: use SRI when retrieving Bootstrap JS - 13https://github.com/miraheze/landing/pull/111 [19:13:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.29, 2.72, 2.69 [19:14:37] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.2311359644 secs [19:15:26] miraheze/landing - redbluegreenhat the build passed. [19:15:46] [02landing] 07Universal-Omega closed pull request 03#111: use SRI when retrieving Bootstrap JS - 13https://github.com/miraheze/landing/pull/111 [19:15:47] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/128d12f5a968...f4af086433ac [19:15:50] [02miraheze/landing] 07redbluegreenhat 03f4af086 - use SRI when retrieving Bootstrap JS (#111) [19:16:43] miraheze/landing - Universal-Omega the build passed. [19:20:38] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.003358244896 secs [19:22:43] PROBLEM - cloud13 Puppet on cloud13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [19:29:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.12, 6.01, 4.28 [19:33:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.66, 3.53, 3.64 [19:35:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 2.84, 3.36 [19:37:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.86, 3.43, 2.83 [19:39:28] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.75, 3.35, 2.89 [19:44:37] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.2279783189 secs [19:50:43] RECOVERY - cloud13 Puppet on cloud13 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [19:58:37] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.004739940166 secs [19:59:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 2.93, 4.03, 3.43 [20:01:41] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.62, 3.22, 3.20 [20:04:38] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset -0.1314433515 secs [20:06:37] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.07020771503 secs [20:16:38] [02ErrorPages] 07redbluegreenhat opened pull request 03#35: Set crossorigin="anonymous" - 13https://github.com/miraheze/ErrorPages/pull/35 [20:17:50] miraheze/ErrorPages - redbluegreenhat the build passed. [20:24:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.21, 3.29, 2.79 [20:24:46] [02landing] 07redbluegreenhat opened pull request 03#112: Set crossorigin="anonymous" - 13https://github.com/miraheze/landing/pull/112 [20:25:51] miraheze/landing - redbluegreenhat the build passed. [20:26:06] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.77, 3.15, 2.81 [20:28:20] [02puppet] 07redbluegreenhat opened pull request 03#3125: Set crossorigin="anonymous" - 13https://github.com/miraheze/puppet/pull/3125 [20:38:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.66, 4.90, 3.60 [20:39:07] [02puppet] 07Universal-Omega closed pull request 03#3125: Set crossorigin="anonymous" - 13https://github.com/miraheze/puppet/pull/3125 [20:39:08] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/3ad7c0275ba0...44fe1e7bb653 [20:39:09] [02miraheze/puppet] 07redbluegreenhat 0344fe1e7 - Set crossorigin="anonymous" (#3125) [20:39:21] [02landing] 07Universal-Omega closed pull request 03#112: Set crossorigin="anonymous" - 13https://github.com/miraheze/landing/pull/112 [20:39:24] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/f4af086433ac...aa3a9b2e702a [20:39:25] [02miraheze/landing] 07redbluegreenhat 03aa3a9b2 - Set crossorigin="anonymous" (#112) [20:39:31] [02ErrorPages] 07Universal-Omega closed pull request 03#35: Set crossorigin="anonymous" - 13https://github.com/miraheze/ErrorPages/pull/35 [20:39:33] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/ErrorPages/compare/5e5e9d18542d...0947156d0fe6 [20:39:35] [02miraheze/ErrorPages] 07redbluegreenhat 030947156 - Set crossorigin="anonymous" (#35) [20:40:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.94, 3.78, 3.34 [20:40:18] miraheze/landing - Universal-Omega the build passed. [20:40:27] miraheze/ErrorPages - Universal-Omega the build passed. [20:43:59] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.03, 3.20, 3.23 [20:47:01] [02ErrorPages] 07redbluegreenhat opened pull request 03#36: Remove mistakenly-added "+" sign - 13https://github.com/miraheze/ErrorPages/pull/36 [20:47:58] miraheze/ErrorPages - redbluegreenhat the build passed. [20:54:58] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.08, 3.93, 3.04 [20:55:51] [02ErrorPages] 07Universal-Omega closed pull request 03#36: Remove mistakenly-added "+" sign - 13https://github.com/miraheze/ErrorPages/pull/36 [20:55:52] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ErrorPages/compare/0947156d0fe6...82c16f351f99 [20:55:53] [02miraheze/ErrorPages] 07redbluegreenhat 0382c16f3 - Remove mistakenly-added "+" sign (#36) [20:56:55] miraheze/ErrorPages - Universal-Omega the build passed. [21:02:38] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.39, 3.40, 3.38 [21:39:43] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.86, 4.25, 3.43 [21:41:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.11, 3.50, 3.25 [21:43:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.96, 2.69, 2.99 [22:05:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.96, 3.52, 2.76 [22:09:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.99, 3.27, 2.87 [22:19:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.38, 3.36, 2.90 [22:27:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.77, 3.78, 3.49 [22:29:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.10, 2.82, 3.17 [22:29:47] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.86, 3.81, 2.14 [22:31:43] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.83, 3.57, 2.27 [22:33:39] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.49, 2.89, 2.17 [22:38:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.71, 4.53, 3.70 [22:44:48] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.28, 4.38, 3.34 [22:45:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.24, 3.47, 3.73 [22:47:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.71, 4.31, 3.99 [22:48:38] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.31, 3.84, 3.37 [22:50:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.15, 3.22, 3.19 [22:50:35] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.70, 4.84, 2.57 [22:51:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.85, 3.49, 3.77 [22:56:34] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.57, 3.12, 2.67 [22:57:18] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.76, 4.30, 3.58 [22:57:23] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.83, 2.43, 3.18 [23:00:21] PROBLEM - matomo131 Current Load on matomo131 is WARNING: WARNING - load average: 3.60, 2.91, 2.32 [23:02:21] RECOVERY - matomo131 Current Load on matomo131 is OK: OK - load average: 2.76, 2.87, 2.38 [23:18:41] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.08, 2.20, 3.99 [23:22:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.48, 3.94, 4.20 [23:36:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.05, 3.58, 2.90 [23:38:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.01, 3.42, 2.92 [23:39:59] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.83, 3.15, 2.88 [23:43:38] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.38, 2.64, 3.86 [23:49:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.87, 3.65, 3.85 [23:57:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.21, 3.78, 3.94