[00:00:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.04, 3.56, 3.26 [00:02:28] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.81, 4.69, 3.37 [00:04:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.48, 3.39, 3.29 [00:06:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.45, 10.26, 11.49 [00:08:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.06, 3.86, 3.44 [00:09:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.91, 10.38, 10.58 [00:10:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.91, 6.10, 4.38 [00:11:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.87, 9.60, 10.29 [00:13:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.04, 8.79, 9.91 [00:14:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.27, 7.19, 9.61 [00:16:42] PROBLEM - cp22 NTP time on cp22 is CRITICAL: NTP CRITICAL: Offset 0.7302240431 secs [00:16:47] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.47, 3.75, 2.30 [00:17:32] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.06, 2.87, 3.71 [00:18:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.66, 3.70, 3.87 [00:18:42] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.002609968185 secs [00:18:47] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.81, 2.64, 2.06 [00:19:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.68, 2.15, 3.34 [00:22:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.07, 2.62, 3.37 [00:28:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.38, 3.55, 3.16 [00:29:34] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.04, 4.51, 3.62 [00:30:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.28, 3.30, 3.10 [00:30:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.52, 3.27, 3.42 [00:30:42] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2180530727 secs [00:31:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.66, 3.32, 3.29 [00:31:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.79, 10.37, 9.27 [00:32:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.44, 2.88, 3.25 [00:33:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.04, 9.94, 9.23 [00:34:42] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.008910417557 secs [00:36:48] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.52, 3.30, 2.89 [00:38:48] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.02, 2.76, 2.74 [01:04:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.24, 3.26, 2.90 [01:06:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.26, 5.02, 3.68 [01:06:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.04, 2.70, 2.73 [01:09:50] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.75, 1.66, 1.05 [01:09:54] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.27, 3.84, 3.54 [01:11:47] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.11, 1.83, 1.18 [01:11:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.58, 3.36, 3.39 [01:12:53] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [01:13:42] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.77, 1.81, 1.25 [01:17:35] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.36, 1.63, 1.30 [01:20:48] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.42, 3.14, 2.79 [01:21:29] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.16, 1.94, 1.51 [01:22:48] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.10, 3.47, 2.95 [01:23:25] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.30, 1.70, 1.48 [01:24:48] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.54, 3.39, 2.98 [01:25:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.81, 4.18, 3.36 [01:29:15] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.92, 1.81, 1.58 [01:29:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.79, 3.74, 3.37 [01:31:11] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.53, 2.04, 1.70 [01:31:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.53, 4.39, 3.67 [01:33:19] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.56, 3.34, 3.37 [01:34:48] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.81, 3.12, 3.10 [01:38:48] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.11, 3.91, 3.44 [01:40:53] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:42:48] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.74, 3.81, 3.50 [01:46:48] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.89, 3.02, 3.26 [01:54:56] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.95, 1.96, 1.98 [01:56:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.32, 9.62, 8.34 [01:56:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.04, 3.78, 3.35 [01:58:07] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.82, 9.11, 8.32 [01:58:56] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.06, 1.91, 1.95 [02:00:56] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.69, 1.81, 1.90 [02:04:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.35, 3.36, 3.61 [02:06:56] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.32, 1.89, 1.90 [02:08:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.22, 2.81, 3.32 [02:10:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/CreateWiki/maintenance/setContainersAccess.php --wiki=rpiwiki [02:10:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:10:56] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.88, 1.98, 1.95 [02:12:56] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.36, 2.09, 1.99 [02:14:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.26, 3.94, 3.70 [02:14:56] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.74, 1.95, 1.96 [02:16:56] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 1.95, 2.06, 2.00 [02:18:56] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 1.68, 1.96, 1.97 [02:20:56] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.43, 2.24, 2.08 [02:24:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.94, 3.19, 3.37 [02:24:56] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 0.67, 1.56, 1.86 [02:26:56] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.47, 1.20, 1.69 [02:33:30] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.69, 4.91, 3.62 [02:39:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.13, 3.85, 3.65 [02:45:12] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.82, 2.86, 3.33 [02:53:03] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.61, 3.77, 3.42 [02:55:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.60, 2.93, 3.15 [03:00:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.56, 3.51, 2.94 [03:01:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.25, 3.34, 1.96 [03:02:26] PROBLEM - db121 Backups SQL on db121 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864144 seconds old and 0 bytes [03:04:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.72, 3.95, 3.28 [03:05:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.09, 3.07, 2.28 [03:06:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.16, 3.34, 3.14 [03:30:12] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.21, 3.67, 2.83 [03:32:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.28, 3.57, 2.90 [03:34:06] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.82, 2.87, 2.72 [03:36:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.62, 3.47, 3.07 [03:38:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.76, 4.22, 3.41 [03:40:13] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.51, 3.67, 3.31 [03:42:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.67, 3.86, 3.41 [03:46:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.22, 3.39, 3.36 [04:09:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.59, 4.36, 3.54 [04:09:24] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.28, 4.48, 3.39 [04:11:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.35, 3.95, 3.50 [04:11:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.26, 3.74, 3.25 [04:13:18] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.50, 2.94, 3.02 [04:14:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.43, 3.37, 3.36 [04:24:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.69, 4.01, 3.54 [04:27:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.81, 3.95, 3.47 [04:28:18] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.39, 3.93, 3.63 [04:28:59] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 17.82, 6.60, 4.36 [04:29:34] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.03, 3.71, 1.93 [04:32:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.61, 3.14, 3.36 [04:32:53] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.47, 3.82, 3.73 [04:36:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.09, 6.05, 4.38 [04:39:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.99, 2.99, 2.71 [04:40:41] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.09, 2.86, 3.31 [04:42:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.08, 3.96, 3.95 [04:44:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.00, 3.33, 3.43 [04:46:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.72, 2.80, 3.23 [04:48:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.44, 2.34, 3.23 [04:59:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.20, 2.51, 1.93 [05:00:21] RECOVERY - db112 Backups SQL icingaweb2 on db112 is OK: FILE_AGE OK: /var/log/sql-icingaweb2-backup-fortnightly.log is 14 seconds old and 88 bytes [05:00:59] RECOVERY - db112 Backups SQL roundcubemail on db112 is OK: FILE_AGE OK: /var/log/sql-roundcubemail-backup-fortnightly.log is 51 seconds old and 89 bytes [05:01:27] RECOVERY - db112 Backups SQL grafana on db112 is OK: FILE_AGE OK: /var/log/sql-grafana-backup-fortnightly.log is 74 seconds old and 88 bytes [05:01:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 3.30, 2.67, 2.05 [05:01:45] RECOVERY - db112 Backups SQL icinga on db112 is OK: FILE_AGE OK: /var/log/sql-icinga-backup-fortnightly.log is 104 seconds old and 0 bytes [05:06:48] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.50, 2.83, 2.16 [05:08:48] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.07, 2.76, 2.21 [05:31:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.58, 3.55, 2.02 [05:35:32] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.93, 3.49, 2.44 [05:37:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.53, 2.45, 2.18 [05:41:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.02, 9.21, 7.47 [05:41:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.36, 9.80, 8.02 [05:43:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.15, 8.65, 7.48 [05:43:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.12, 8.77, 7.86 [05:44:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.26, 3.49, 2.85 [05:46:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.96, 2.82, 2.67 [05:52:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.69, 3.63, 2.99 [05:58:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.14, 2.96, 3.02 [05:59:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.54, 4.27, 2.51 [06:01:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.83, 3.37, 2.40 [06:08:43] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.74, 3.03, 2.46 [06:10:20] PROBLEM - wiki.yunachannel.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.yunachannel.com All nameservers failed to answer the query. [06:10:39] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.60, 3.64, 2.75 [06:12:35] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.97, 3.76, 2.90 [06:18:32] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.80, 3.30, 3.00 [06:22:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.4693226814 secs [06:24:17] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.00113093853 secs [06:28:36] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.72, 5.23, 2.84 [06:29:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.65, 4.26, 2.60 [06:30:36] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.22, 3.98, 2.66 [06:32:36] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.24, 3.06, 2.49 [06:33:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.93, 2.90, 2.48 [06:39:41] PROBLEM - wiki.yunachannel.com - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.yunachannel.com. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:56:46] !log restarted deleteWikis.php [06:56:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:06:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.05, 6.68, 4.66 [07:06:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.27, 6.85, 4.75 [07:08:22] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.08, 6.19, 4.72 [07:08:32] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.26, 6.25, 4.80 [07:09:03] RECOVERY - wiki.yunachannel.com - reverse DNS on sslhost is OK: SSL OK - wiki.yunachannel.com reverse DNS resolves to cp23.miraheze.org - CNAME OK [07:34:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.41, 6.84, 5.72 [07:35:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.15, 7.20, 5.85 [07:37:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.96, 5.68, 4.73 [07:39:02] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.87, 6.50, 5.26 [07:41:02] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.06, 6.41, 5.39 [07:45:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 8.36, 7.29, 5.77 [07:46:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.38, 6.75, 5.68 [07:46:21] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=zhxomniwiki --no-updates --username-prefix=mh:zhxomni /home/reception/ImportDump/zhxomniwiki-20230214225445.xml (START) [07:46:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:47:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.66, 10.29, 8.98 [07:47:55] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204105402.xml (START) [07:48:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:48:45] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204110308 (START) [07:48:46] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204110308 (END - exit=256) [07:48:46] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (START) [07:48:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:48:53] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (END - exit=2) [07:48:55] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=ysmwikiwiki --active --update (END - exit=2) [07:49:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:49:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.45, 7.33, 6.20 [07:49:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:49:13] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204110308.xml (START) [07:49:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:49:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:49:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:49:36] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204105843 (START) [07:49:37] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204105843 (END - exit=256) [07:49:38] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (START) [07:49:39] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (END - exit=2) [07:49:40] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=ysmwikiwiki --active --update (END - exit=2) [07:49:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:49:45] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204105843.xml (START) [07:49:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:49:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:49:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:50:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.70, 6.34, 5.78 [07:50:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:50:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:51:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.39, 11.22, 9.66 [07:51:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.24, 11.36, 9.56 [07:52:17] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.4323409796 secs [07:54:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.06, 6.80, 6.10 [07:54:17] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.002298533916 secs [07:55:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.21, 10.62, 9.80 [07:55:57] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.17, 9.89, 9.39 [07:57:42] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.84, 7.49, 6.59 [07:57:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.49, 9.12, 9.35 [08:00:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.62, 6.62, 6.26 [08:00:45] [02ManageWiki] 07amire80 opened pull request 03#385: Correction of logentry-managewiki-rights - 13https://github.com/miraheze/ManageWiki/pull/385 [08:01:34] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.95, 6.62, 6.42 [08:04:34] miraheze/ManageWiki - amire80 the build passed. [08:05:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.96, 5.92, 6.40 [08:06:06] [02ManageWiki] 07Reception123 closed pull request 03#385: Correction of logentry-managewiki-rights - 13https://github.com/miraheze/ManageWiki/pull/385 [08:06:08] [02miraheze/ManageWiki] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/52a5d2d0d912...4809f34b5f1c [08:06:09] [02miraheze/ManageWiki] 07amire80 034809f34 - Correction of logentry-managewiki-rights (#385) [08:08:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.91, 6.46, 7.75 [08:08:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 3.39, 5.78, 7.49 [08:09:10] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204110308.xml (END - exit=256) [08:09:11] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (START) [08:09:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:09:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:09:30] miraheze/ManageWiki - Reception123 the build passed. [08:12:36] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.93, 5.05, 6.79 [08:14:22] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.87, 5.05, 6.70 [08:18:49] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204105843.xml (END - exit=0) [08:18:50] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (START) [08:18:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:18:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:22:13] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=zhxomniwiki --no-updates --username-prefix=mh:zhxomni /home/reception/ImportDump/zhxomniwiki-20230214225445.xml (END - exit=0) [08:22:14] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=zhxomniwiki (START) [08:22:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:22:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:25:09] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.49, 7.67, 7.03 [08:25:18] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.24, 6.48, 6.26 [08:27:14] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.31, 6.57, 6.33 [08:29:04] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.01, 6.58, 6.82 [08:29:49] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.78, 12.68, 9.72 [08:30:51] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=ysmwikiwiki --no-updates --username-prefix=jawikipedia /home/reception/Wikipedia-20230204105402.xml (END - exit=0) [08:30:52] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (START) [08:31:02] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.22, 5.81, 6.51 [08:31:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.36, 11.89, 9.72 [08:32:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:32:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:36:49] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.31, 3.35, 2.68 [08:38:48] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.38, 3.39, 2.78 [08:39:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.72, 11.23, 10.10 [08:43:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.93, 10.32, 10.08 [08:43:45] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.59, 10.68, 11.06 [08:44:33] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.54, 4.50, 2.86 [08:45:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.27, 9.27, 9.73 [08:46:32] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.82, 3.87, 2.84 [08:48:32] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 7.29, 5.15, 3.43 [08:49:44] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.32, 9.15, 10.14 [08:53:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.02, 10.81, 10.72 [08:54:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.41, 3.01, 2.15 [08:57:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.10, 11.03, 10.75 [08:58:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.10, 3.18, 2.43 [08:59:41] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.13, 11.23, 10.88 [09:03:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.23, 10.20, 9.97 [09:05:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.04, 9.83, 9.89 [09:07:39] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.36, 10.25, 10.46 [09:09:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.41, 11.57, 10.64 [09:11:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.01, 10.54, 10.61 [09:13:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.10, 9.25, 10.14 [09:13:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.77, 9.77, 10.15 [09:21:35] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.13, 10.14, 9.97 [09:21:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.57, 10.63, 10.21 [09:23:35] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.62, 8.75, 9.48 [09:23:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.58, 9.01, 9.66 [09:31:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.37, 10.23, 9.88 [09:33:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.10, 9.92, 9.79 [09:34:31] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=zhxomniwiki (END - exit=0) [09:34:33] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=zhxomniwiki --active --update (END - exit=0) [09:34:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:34:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:54:00] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (END - exit=256) [09:54:01] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (END - exit=256) [09:54:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:54:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:54:32] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 0.61, 1.17, 3.75 [09:56:20] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=ysmwikiwiki --active --update (END - exit=0) [09:56:21] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=ysmwikiwiki --active --update (END - exit=0) [09:56:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:56:32] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 0.32, 0.87, 3.32 [09:56:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:58:09] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.45, 6.38, 4.51 [09:59:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.29, 11.06, 9.57 [10:00:09] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.52, 6.13, 4.66 [10:00:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 12.00, 11.74, 9.93 [10:01:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.08, 10.20, 9.43 [10:02:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.07, 10.05, 9.54 [10:04:09] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.16, 7.33, 5.43 [10:06:09] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.96, 7.67, 5.80 [10:08:09] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.07, 7.88, 6.11 [10:10:09] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.37, 7.79, 6.30 [10:18:09] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.86, 8.51, 7.14 [10:22:09] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.60, 8.00, 7.29 [10:24:09] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 7.92, 8.06, 7.39 [10:24:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.43, 6.58, 4.95 [10:24:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.91, 6.78, 5.02 [10:25:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.22, 5.84, 4.50 [10:26:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.95, 5.72, 4.26 [10:26:09] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.08, 7.81, 7.39 [10:27:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 6.10, 6.02, 4.74 [10:28:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.08, 5.70, 4.45 [10:29:40] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 8.87, 5.44, 2.95 [10:30:09] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.48, 8.71, 7.79 [10:32:09] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 3.06, 6.55, 7.11 [10:32:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.77, 7.85, 6.42 [10:32:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.57, 7.62, 6.36 [10:34:09] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.70, 5.58, 6.68 [10:34:32] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 3.30, 6.23, 6.00 [10:35:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.22, 3.12, 2.77 [10:36:15] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.17, 10.74, 9.26 [10:36:22] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.66, 5.84, 5.94 [10:38:15] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.75, 9.39, 8.94 [10:49:49] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.01, 10.63, 8.91 [10:50:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.68, 11.51, 9.74 [10:51:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.33, 9.83, 8.81 [10:52:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.14, 10.60, 9.63 [10:58:09] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.29, 10.06, 9.76 [10:59:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.75, 4.73, 2.93 [11:01:32] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.07, 3.59, 2.72 [11:03:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 24.98, 10.91, 5.19 [11:03:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.29, 2.86, 2.57 [11:13:59] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [11:15:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.47, 11.31, 9.28 [11:15:55] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.818 second response time [11:16:33] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.30, 2.31, 3.77 [11:17:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.42, 9.95, 9.35 [11:17:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.23, 10.25, 9.16 [11:19:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.61, 8.97, 9.05 [11:19:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.88, 9.07, 8.86 [11:20:22] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.87, 1.51, 3.11 [11:23:02] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.41, 10.70, 9.71 [11:23:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.08, 12.17, 10.26 [11:25:02] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.67, 9.90, 9.54 [11:25:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.72, 11.46, 10.25 [11:29:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.20, 9.44, 9.72 [11:35:58] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.62, 11.67, 10.27 [11:36:32] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.97, 3.44, 2.49 [11:37:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.17, 10.61, 10.17 [11:37:58] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.67, 10.60, 10.03 [11:39:19] PROBLEM - cp33 NTP time on cp33 is CRITICAL: NTP CRITICAL: Offset 0.66593045 secs [11:39:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.42, 10.69, 10.22 [11:39:57] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.86, 10.83, 10.14 [11:41:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.88, 11.66, 10.69 [11:41:57] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.92, 9.44, 9.72 [11:43:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.68, 12.91, 11.26 [11:44:55] !log reception@mwtask141:~$ sudo -u www-data php /srv/mediawiki/w/maintenance/importImages.php --wiki=openfortresswiki --summary="Imported from https://open-fortress.fandom.com" --search-recursively /home/reception/OFimages [11:45:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:45:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.14, 10.71, 10.66 [11:47:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.26, 11.52, 10.94 [11:48:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.00, 10.97, 10.34 [11:49:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.64, 11.11, 10.89 [11:50:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.76, 9.99, 10.07 [11:53:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.25, 12.58, 11.42 [11:54:52] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.01, 11.33, 10.54 [11:56:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.85, 11.28, 10.61 [11:57:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.92, 11.41, 11.33 [11:58:52] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.71, 9.82, 10.16 [12:01:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.65, 12.15, 11.51 [12:03:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.84, 11.19, 11.24 [12:04:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.71, 10.18, 10.31 [12:06:49] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.74, 9.79, 10.15 [12:09:19] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.009881675243 secs [12:10:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.82, 10.24, 10.29 [12:11:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.63, 10.81, 10.80 [12:12:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.10, 12.03, 10.93 [12:13:29] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=ysmwikiwiki (END - exit=35072) [12:13:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:13:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.66, 11.59, 11.13 [12:14:13] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=ysmwikiwiki --active --update (END - exit=0) [12:14:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:14:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.61, 10.75, 10.60 [12:16:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.22, 9.38, 10.11 [12:18:43] !log DELETED and DROPPED https://phabricator.miraheze.org/P487 [12:18:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:19:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.54, 8.25, 9.78 [12:22:44] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.96, 10.28, 10.08 [12:25:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.94, 10.79, 10.30 [12:26:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.85, 11.19, 10.55 [12:27:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.64, 10.34, 10.19 [12:29:37] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 9.98, 4.10, 2.25 [12:31:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.10, 9.97, 10.09 [12:32:32] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.53, 1.78, 3.88 [12:33:32] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.41, 3.91, 2.75 [12:35:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.78, 3.19, 2.63 [12:36:32] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.45, 1.46, 3.25 [12:36:41] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.80, 12.18, 11.02 [12:38:40] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.69, 11.97, 11.10 [12:46:39] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.26, 8.59, 9.92 [13:01:55] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.99, 10.86, 9.30 [13:02:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.31, 10.25, 9.60 [13:03:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.89, 10.04, 9.17 [13:04:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.28, 10.96, 9.94 [13:08:33] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.10, 11.22, 10.33 [13:10:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.09, 9.96, 9.97 [13:11:19] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1886971593 secs [13:18:30] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.91, 10.09, 9.88 [13:22:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.20, 10.13, 9.95 [13:27:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.78, 10.74, 9.77 [13:28:27] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.78, 10.68, 10.28 [13:29:11] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.04, 10.08, 9.64 [13:29:19] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.09268304706 secs [13:30:27] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.21, 10.87, 10.37 [13:33:04] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.52, 11.57, 10.36 [13:34:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.57, 10.92, 10.24 [13:36:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.21, 11.37, 10.91 [13:36:55] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.06, 9.89, 9.95 [13:42:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.78, 10.64, 10.31 [13:44:23] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.79, 8.72, 9.89 [13:44:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.17, 9.61, 9.96 [13:48:48] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.63, 3.06, 2.40 [13:49:19] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset -0.1181440055 secs [13:50:48] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.16, 2.79, 2.39 [13:51:19] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.09586581588 secs [14:24:13] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.28, 11.74, 9.88 [14:26:13] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.55, 11.42, 9.99 [14:26:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.34, 11.40, 9.73 [14:28:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.81, 10.47, 9.59 [14:29:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.63, 4.15, 2.54 [14:30:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.62, 10.19, 9.85 [14:30:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.84, 10.00, 9.52 [14:31:32] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.31, 3.96, 2.69 [14:33:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.53, 3.16, 2.55 [14:36:10] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.88, 10.86, 10.25 [14:40:09] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.78, 10.19, 10.11 [14:50:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.48, 11.80, 10.52 [14:50:41] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.96, 11.80, 10.33 [14:52:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.88, 11.12, 10.41 [14:52:36] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.98, 11.58, 10.40 [14:54:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.03, 11.27, 10.54 [14:56:05] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.13, 10.61, 10.40 [15:00:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.09, 11.28, 10.55 [15:02:14] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.75, 10.61, 10.39 [15:04:03] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.41, 11.06, 10.60 [15:04:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.58, 9.86, 10.14 [15:06:02] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.90, 10.82, 10.58 [15:08:02] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.34, 11.07, 10.68 [15:10:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.44, 11.33, 10.86 [15:12:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.85, 12.08, 11.19 [15:13:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.41, 10.54, 10.41 [15:14:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.80, 11.52, 11.11 [15:23:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.00, 12.07, 11.12 [15:23:58] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.44, 11.23, 10.98 [15:25:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.67, 10.54, 10.75 [15:31:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.81, 12.34, 11.44 [15:36:50] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.79, 3.62, 2.75 [15:37:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.60, 11.94, 11.85 [15:38:44] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.05, 3.35, 2.75 [15:39:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.17, 12.39, 12.02 [15:44:27] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.79, 3.52, 3.02 [15:46:22] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.06, 3.19, 2.97 [15:54:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.41, 4.12, 3.44 [15:58:13] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.55, 3.49, 3.36 [15:59:49] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.35, 11.20, 11.93 [16:00:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.37, 3.06, 3.21 [16:03:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.42, 10.85, 11.82 [16:05:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.12, 11.12, 11.54 [16:07:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.47, 10.66, 11.34 [16:11:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.38, 11.37, 11.46 [16:11:46] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.26, 11.44, 11.42 [16:13:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.19, 10.14, 11.00 [16:13:46] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 11.93, 11.65 [16:16:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.61, 3.53, 2.56 [16:19:44] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.38, 10.76, 11.10 [16:22:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.31, 2.98, 2.62 [16:25:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.92, 11.72, 11.41 [16:28:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.30, 3.72, 3.03 [16:29:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.32, 10.54, 10.57 [16:31:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.90, 11.12, 10.79 [16:32:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.22, 3.13, 2.96 [16:33:41] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.37, 11.00, 10.92 [16:36:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.69, 3.45, 3.17 [16:36:48] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-4 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/171bf00bfcaa [16:36:49] [02miraheze/mw-config] 07Reception123 03171bf00 - add import sources for nenawiki and ngdwiki per request [16:36:52] [02mw-config] 07Reception123 created branch 03Reception123-patch-4 - 13https://github.com/miraheze/mw-config [16:36:53] [02mw-config] 07Reception123 opened pull request 03#5125: add import sources for nenawiki and ngdwiki per request - 13https://github.com/miraheze/mw-config/pull/5125 [16:38:04] miraheze/mw-config - Reception123 the build passed. [16:38:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.07, 3.03, 3.06 [16:39:04] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-4 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/171bf00bfcaa...9596dd864432 [16:39:06] [02miraheze/mw-config] 07Reception123 039596dd8 - Update LocalSettings.php [16:39:09] [02mw-config] 07Reception123 synchronize pull request 03#5125: add import sources for nenawiki and ngdwiki per request - 13https://github.com/miraheze/mw-config/pull/5125 [16:39:12] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/1ea5ee8a1054...679d1ad80fcb [16:39:14] [02miraheze/mw-config] 07Reception123 03679d1ad - add import sources for nenawiki and ngdwiki per request (#5125) [16:39:16] [02mw-config] 07Reception123 closed pull request 03#5125: add import sources for nenawiki and ngdwiki per request - 13https://github.com/miraheze/mw-config/pull/5125 [16:39:19] !log [reception@mwtask141] starting deploy of {'pull': 'config'} to all [16:39:19] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-4 [16:39:20] !log [reception@mwtask141] finished deploy of {'pull': 'config'} to all - SUCCESS in 1s [16:39:21] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-4 - 13https://github.com/miraheze/mw-config [16:39:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:39:26] !log [reception@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [16:39:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:39:37] !log [reception@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 10s [16:39:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:39:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:40:02] miraheze/mw-config - Reception123 the build passed. [16:40:11] miraheze/mw-config - Reception123 the build passed. [16:41:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.31, 12.43, 11.28 [16:43:39] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.19, 10.79, 11.18 [16:45:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.26, 11.49, 11.21 [16:49:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.36, 10.83, 10.87 [16:49:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.23, 11.14, 11.05 [16:53:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.28, 11.67, 11.27 [16:53:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.39, 10.93, 11.04 [16:57:15] !log [@test131] starting deploy of {'config': True} to all [16:57:16] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [16:57:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.37, 11.65, 11.23 [16:58:48] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.41, 3.10, 2.64 [17:00:48] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.40, 2.89, 2.62 [17:01:32] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.87, 3.24, 2.22 [17:03:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.35, 7.07, 4.36 [17:03:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.51, 2.66, 2.14 [17:03:34] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.46, 12.42, 11.62 [17:03:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.74, 11.83, 11.44 [17:09:09] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.25, 3.35, 3.53 [17:09:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.62, 13.58, 12.21 [17:11:03] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.41, 2.82, 3.32 [17:40:26] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.2736131847 secs [17:41:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 1.15, 8.25, 11.36 [17:41:25] PROBLEM - db121 Backups SQL on db121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:41:40] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 1056 bytes in 3.512 second response time [17:41:42] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:41:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 1.76, 7.93, 11.27 [17:42:44] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [17:43:00] Error 503 Backend fetch failed, forwarded for 170.185.249.164, 127.0.0.1 [17:43:01] (Varnish XID 465895801) via cp33 at Wed, 15 Feb 2023 17:42:52 GMT. [17:43:17] Tried to access AVID [17:43:21] PROBLEM - db121 Backups SQL on db121 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 916999 seconds old and 0 bytes [17:43:28] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [17:43:33] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [17:43:38] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.361 second response time [17:43:38] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 21.70, 45.26, 23.42 [17:43:40] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.632 second response time [17:43:41] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [17:43:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 0.78, 5.79, 10.10 [17:43:48] Also occurs on GRBGW [17:43:52] and PRBGW [17:43:53] PROBLEM - cp33 HTTP 4xx/5xx ERROR Rate on cp33 is WARNING: WARNING - NGINX Error Rate is 49% [17:45:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 1.66, 4.62, 9.20 [17:45:32] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [17:45:53] RECOVERY - cp33 HTTP 4xx/5xx ERROR Rate on cp33 is OK: OK - NGINX Error Rate is 2% [17:46:44] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [17:47:29] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [17:47:41] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [17:50:26] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.02239668369 secs [17:52:54] !log [universalomega@db121] SET GLOBAL read_only=0; [17:52:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:53:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.92, 10.02, 9.91 [17:55:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.79, 9.50, 9.73 [18:04:50] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 3.02, 3.19, 7.67 [18:05:17] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.22, 10.45, 10.07 [18:07:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.49, 9.65, 9.81 [18:08:42] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 1.85, 2.55, 6.43 [18:13:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.01, 10.29, 9.73 [18:19:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.07, 12.12, 10.60 [18:21:13] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.41, 10.12, 9.74 [18:21:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.78, 11.80, 10.66 [18:22:50] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.01, 2.97, 2.50 [18:23:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.46, 9.47, 9.54 [18:23:59] PROBLEM - matomo131 HTTPS on matomo131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.008 second response time [18:24:49] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.73, 2.98, 2.57 [18:25:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.66, 12.88, 11.28 [18:25:53] RECOVERY - matomo131 HTTPS on matomo131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.173 second response time [18:27:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.12, 11.24, 10.22 [18:29:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.63, 10.67, 10.14 [18:33:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.32, 12.84, 11.07 [18:37:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.49, 11.46, 11.68 [18:39:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.02, 11.18, 11.17 [18:41:38] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/2cf4a33c7edd...946929e6f62b [18:41:40] [02miraheze/mediawiki] 07Universal-Omega 03946929e - Try running dependabot daily [18:42:38] [02mediawiki] 07dependabot[bot] opened pull request 03#13296: Bump extensions/Translate from `54c736c` to `1839690` - 13https://github.com/miraheze/mediawiki/pull/13296 [18:42:39] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/Translate-1839690 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/193dfc026ca8 [18:42:40] [02miraheze/mediawiki] 07dependabot[bot] 03193dfc0 - Bump extensions/Translate from `54c736c` to `1839690` [18:42:43] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/Translate-1839690 - 13https://github.com/miraheze/mediawiki [18:42:45] [02mediawiki] 07dependabot[bot] opened pull request 03#13297: Bump extensions/ExternalData from `778fd73` to `37d554d` - 13https://github.com/miraheze/mediawiki/pull/13297 [18:42:46] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/ExternalData-37d554d [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/8e343a434794 [18:42:48] [02miraheze/mediawiki] 07dependabot[bot] 038e343a4 - Bump extensions/ExternalData from `778fd73` to `37d554d` [18:42:49] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/ExternalData-37d554d - 13https://github.com/miraheze/mediawiki [18:42:50] [02mediawiki] 07dependabot[bot] opened pull request 03#13298: Bump skins/Evelution from `3c24e74` to `b776ad6` - 13https://github.com/miraheze/mediawiki/pull/13298 [18:42:52] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/skins/Evelution-b776ad6 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/4a09b814ba3f [18:42:54] [02miraheze/mediawiki] 07dependabot[bot] 034a09b81 - Bump skins/Evelution from `3c24e74` to `b776ad6` [18:42:55] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/skins/Evelution-b776ad6 - 13https://github.com/miraheze/mediawiki [18:42:58] [02mediawiki] 07dependabot[bot] opened pull request 03#13299: Bump extensions/DiscordNotifications from `501a793` to `6ff8b68` - 13https://github.com/miraheze/mediawiki/pull/13299 [18:43:01] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/DiscordNotifications-6ff8b68 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/051153902f3c [18:43:02] [02miraheze/mediawiki] 07dependabot[bot] 030511539 - Bump extensions/DiscordNotifications from `501a793` to `6ff8b68` [18:43:04] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/DiscordNotifications-6ff8b68 - 13https://github.com/miraheze/mediawiki [18:43:05] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/PageForms-d9b0e47 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/c7130da510e6 [18:43:06] [02miraheze/mediawiki] 07dependabot[bot] 03c7130da - Bump extensions/PageForms from `017581a` to `d9b0e47` [18:43:07] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/PageForms-d9b0e47 - 13https://github.com/miraheze/mediawiki [18:43:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.07, 8.62, 10.08 [18:43:09] [02mediawiki] 07dependabot[bot] opened pull request 03#13300: Bump extensions/PageForms from `017581a` to `d9b0e47` - 13https://github.com/miraheze/mediawiki/pull/13300 [18:43:12] [02mediawiki] 07github-actions[bot] labeled pull request 03#13297: Bump extensions/ExternalData from `778fd73` to `37d554d` - 13https://github.com/miraheze/mediawiki/pull/13297 [18:43:15] [02mediawiki] 07github-actions[bot] labeled pull request 03#13299: Bump extensions/DiscordNotifications from `501a793` to `6ff8b68` - 13https://github.com/miraheze/mediawiki/pull/13299 [18:43:16] [02mediawiki] 07github-actions[bot] labeled pull request 03#13296: Bump extensions/Translate from `54c736c` to `1839690` - 13https://github.com/miraheze/mediawiki/pull/13296 [18:43:19] [02mediawiki] 07github-actions[bot] labeled pull request 03#13300: Bump extensions/PageForms from `017581a` to `d9b0e47` - 13https://github.com/miraheze/mediawiki/pull/13300 [18:43:20] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/StandardDialogs-575c9bb [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/3d2a1dd401e0 [18:43:21] [02miraheze/mediawiki] 07dependabot[bot] 033d2a1dd - Bump extensions/StandardDialogs from `94ae70e` to `575c9bb` [18:43:22] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/StandardDialogs-575c9bb - 13https://github.com/miraheze/mediawiki [18:43:24] [02mediawiki] 07dependabot[bot] opened pull request 03#13301: Bump extensions/StandardDialogs from `94ae70e` to `575c9bb` - 13https://github.com/miraheze/mediawiki/pull/13301 [18:43:27] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/UniversalLanguageSelector-8912e94 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/96e2a00de96d [18:43:30] [02miraheze/mediawiki] 07dependabot[bot] 0396e2a00 - Bump extensions/UniversalLanguageSelector from `6a19dda` to `8912e94` [18:43:33] [02mediawiki] 07dependabot[bot] opened pull request 03#13302: Bump extensions/UniversalLanguageSelector from `6a19dda` to `8912e94` - 13https://github.com/miraheze/mediawiki/pull/13302 [18:43:34] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/UniversalLanguageSelector-8912e94 - 13https://github.com/miraheze/mediawiki [18:43:36] [02mediawiki] 07github-actions[bot] labeled pull request 03#13298: Bump skins/Evelution from `3c24e74` to `b776ad6` - 13https://github.com/miraheze/mediawiki/pull/13298 [18:43:39] [02mediawiki] 07dependabot[bot] opened pull request 03#13303: Bump extensions/SocialProfile from `2fa4726` to `c116464` - 13https://github.com/miraheze/mediawiki/pull/13303 [18:43:41] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/SocialProfile-c116464 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/03e736000f0d [18:43:42] [02miraheze/mediawiki] 07dependabot[bot] 0303e7360 - Bump extensions/SocialProfile from `2fa4726` to `c116464` [18:43:44] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/SocialProfile-c116464 - 13https://github.com/miraheze/mediawiki [18:43:45] [02mediawiki] 07github-actions[bot] labeled pull request 03#13301: Bump extensions/StandardDialogs from `94ae70e` to `575c9bb` - 13https://github.com/miraheze/mediawiki/pull/13301 [18:43:48] [02mediawiki] 07github-actions[bot] labeled pull request 03#13302: Bump extensions/UniversalLanguageSelector from `6a19dda` to `8912e94` - 13https://github.com/miraheze/mediawiki/pull/13302 [18:43:51] [02mediawiki] 07dependabot[bot] opened pull request 03#13304: Bump extensions/ManageWiki from `52a5d2d` to `4809f34` - 13https://github.com/miraheze/mediawiki/pull/13304 [18:43:54] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_39/extensions/ManageWiki-4809f34 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/82113491ef59 [18:43:55] [02miraheze/mediawiki] 07dependabot[bot] 038211349 - Bump extensions/ManageWiki from `52a5d2d` to `4809f34` [18:43:56] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_39/extensions/ManageWiki-4809f34 - 13https://github.com/miraheze/mediawiki [18:43:58] [02mediawiki] 07github-actions[bot] labeled pull request 03#13303: Bump extensions/SocialProfile from `2fa4726` to `c116464` - 13https://github.com/miraheze/mediawiki/pull/13303 [18:44:01] [02mediawiki] 07github-actions[bot] labeled pull request 03#13304: Bump extensions/ManageWiki from `52a5d2d` to `4809f34` - 13https://github.com/miraheze/mediawiki/pull/13304 [18:45:13] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/946929e6f62b...975a2ab8f141 [18:45:15] [02miraheze/mediawiki] 07dependabot[bot] 03975a2ab - Bump extensions/Translate from `54c736c` to `1839690` (#13296) [18:45:16] [02mediawiki] 07Universal-Omega closed pull request 03#13296: Bump extensions/Translate from `54c736c` to `1839690` - 13https://github.com/miraheze/mediawiki/pull/13296 [18:45:19] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/extensions/Translate-1839690 [18:45:21] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/extensions/Translate-1839690 - 13https://github.com/miraheze/mediawiki [18:45:35] [02mediawiki] 07Universal-Omega labeled pull request 03#13301: Bump extensions/StandardDialogs from `94ae70e` to `575c9bb` - 13https://github.com/miraheze/mediawiki/pull/13301 [18:45:37] [02mediawiki] 07Universal-Omega labeled pull request 03#13302: Bump extensions/UniversalLanguageSelector from `6a19dda` to `8912e94` - 13https://github.com/miraheze/mediawiki/pull/13302 [18:45:40] [02mediawiki] 07Universal-Omega labeled pull request 03#13303: Bump extensions/SocialProfile from `2fa4726` to `c116464` - 13https://github.com/miraheze/mediawiki/pull/13303 [18:45:41] [02mediawiki] 07Universal-Omega labeled pull request 03#13304: Bump extensions/ManageWiki from `52a5d2d` to `4809f34` - 13https://github.com/miraheze/mediawiki/pull/13304 [18:45:48] [02mediawiki] 07github-actions[bot] closed pull request 03#13302: Bump extensions/UniversalLanguageSelector from `6a19dda` to `8912e94` - 13https://github.com/miraheze/mediawiki/pull/13302 [18:45:51] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_39/extensions/UniversalLanguageSelector-8912e94 - 13https://github.com/miraheze/mediawiki [18:45:53] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_39/extensions/UniversalLanguageSelector-8912e94 [18:45:54] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/975a2ab8f141...70ead21bf7cf [18:45:55] [02miraheze/mediawiki] 07dependabot[bot] 0370ead21 - Bump extensions/UniversalLanguageSelector from `6a19dda` to `8912e94` (#13302) [18:45:56] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#13302: Bump extensions/UniversalLanguageSelector from `6a19dda` to `8912e94` - 13https://github.com/miraheze/mediawiki/pull/13302 [18:45:58] [02mediawiki] 07github-actions[bot] closed pull request 03#13304: Bump extensions/ManageWiki from `52a5d2d` to `4809f34` - 13https://github.com/miraheze/mediawiki/pull/13304 [18:46:01] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_39/extensions/ManageWiki-4809f34 - 13https://github.com/miraheze/mediawiki [18:46:03] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_39/extensions/ManageWiki-4809f34 [18:46:04] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/70ead21bf7cf...62184ef6591c [18:46:06] [02miraheze/mediawiki] 07dependabot[bot] 0362184ef - Bump extensions/ManageWiki from `52a5d2d` to `4809f34` (#13304) [18:46:08] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#13304: Bump extensions/ManageWiki from `52a5d2d` to `4809f34` - 13https://github.com/miraheze/mediawiki/pull/13304 [18:46:09] [02mediawiki] 07github-actions[bot] closed pull request 03#13303: Bump extensions/SocialProfile from `2fa4726` to `c116464` - 13https://github.com/miraheze/mediawiki/pull/13303 [18:46:10] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/62184ef6591c...74b93c75efa1 [18:46:13] [02miraheze/mediawiki] 07dependabot[bot] 0374b93c7 - Bump extensions/SocialProfile from `2fa4726` to `c116464` (#13303) [18:46:14] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_39/extensions/SocialProfile-c116464 [18:46:17] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_39/extensions/SocialProfile-c116464 - 13https://github.com/miraheze/mediawiki [18:46:18] [02mediawiki] 07github-actions[bot] closed pull request 03#13301: Bump extensions/StandardDialogs from `94ae70e` to `575c9bb` - 13https://github.com/miraheze/mediawiki/pull/13301 [18:46:21] [02miraheze/mediawiki] 07github-actions[bot] pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/74b93c75efa1...7695654c61e0 [18:46:23] [02miraheze/mediawiki] 07dependabot[bot] 037695654 - Bump extensions/StandardDialogs from `94ae70e` to `575c9bb` (#13301) [18:46:24] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#13303: Bump extensions/SocialProfile from `2fa4726` to `c116464` - 13https://github.com/miraheze/mediawiki/pull/13303 [18:46:26] [02miraheze/mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_39/extensions/StandardDialogs-575c9bb [18:46:27] [02mediawiki] 07github-actions[bot] deleted branch 03dependabot/submodules/REL1_39/extensions/StandardDialogs-575c9bb - 13https://github.com/miraheze/mediawiki [18:46:30] [02mediawiki] 07github-actions[bot] unlabeled pull request 03#13301: Bump extensions/StandardDialogs from `94ae70e` to `575c9bb` - 13https://github.com/miraheze/mediawiki/pull/13301 [18:46:33] [02mediawiki] 07Universal-Omega closed pull request 03#13300: Bump extensions/PageForms from `017581a` to `d9b0e47` - 13https://github.com/miraheze/mediawiki/pull/13300 [18:46:36] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/7695654c61e0...fb5418cc39f2 [18:46:38] [02miraheze/mediawiki] 07dependabot[bot] 03fb5418c - Bump extensions/PageForms from `017581a` to `d9b0e47` (#13300) [18:46:41] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/extensions/PageForms-d9b0e47 [18:46:42] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/extensions/PageForms-d9b0e47 - 13https://github.com/miraheze/mediawiki [18:46:43] [02mediawiki] 07Universal-Omega closed pull request 03#13298: Bump skins/Evelution from `3c24e74` to `b776ad6` - 13https://github.com/miraheze/mediawiki/pull/13298 [18:46:45] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/fb5418cc39f2...2b84c283eb86 [18:46:46] [02miraheze/mediawiki] 07dependabot[bot] 032b84c28 - Bump skins/Evelution from `3c24e74` to `b776ad6` (#13298) [18:46:47] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/skins/Evelution-b776ad6 [18:46:49] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/skins/Evelution-b776ad6 - 13https://github.com/miraheze/mediawiki [18:46:52] [02mediawiki] 07Universal-Omega closed pull request 03#13297: Bump extensions/ExternalData from `778fd73` to `37d554d` - 13https://github.com/miraheze/mediawiki/pull/13297 [18:46:54] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/extensions/ExternalData-37d554d [18:46:55] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/2b84c283eb86...6a6315938eea [18:46:57] [02miraheze/mediawiki] 07dependabot[bot] 036a63159 - Bump extensions/ExternalData from `778fd73` to `37d554d` (#13297) [18:46:58] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/extensions/ExternalData-37d554d - 13https://github.com/miraheze/mediawiki [18:46:59] [02mediawiki] 07Universal-Omega closed pull request 03#13299: Bump extensions/DiscordNotifications from `501a793` to `6ff8b68` - 13https://github.com/miraheze/mediawiki/pull/13299 [18:47:01] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/6a6315938eea...353c160ba699 [18:47:04] [02miraheze/mediawiki] 07dependabot[bot] 03353c160 - Bump extensions/DiscordNotifications from `501a793` to `6ff8b68` (#13299) [18:47:06] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/extensions/DiscordNotifications-6ff8b68 - 13https://github.com/miraheze/mediawiki [18:47:07] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_39/extensions/DiscordNotifications-6ff8b68 [18:47:35] !log [universalomega@test131] starting deploy of {'world': True, 'l10n': True} to all [18:47:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:47:58] !log [universalomega@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [18:48:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:49:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.72, 8.50, 10.01 [18:51:32] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.80, 3.97, 2.57 [18:53:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.05, 2.94, 2.36 [18:59:59] !log [universalomega@test131] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 744s [19:00:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.43, 10.52, 9.79 [19:09:00] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.15, 9.74, 9.60 [19:13:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.42, 10.38, 9.94 [19:15:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.70, 9.34, 9.61 [19:19:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.37, 9.38, 9.34 [19:21:00] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.89, 10.34, 9.68 [19:22:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.76, 4.52, 3.22 [19:23:00] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.82, 10.09, 9.67 [19:23:39] !log [universalomega@mwtask141] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 2140s [19:23:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:50] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/679d1ad80fcb...088eefaff983 [19:24:52] [02miraheze/mw-config] 07Universal-Omega 03088eefa - Exclude bots in DiscordNotifications [19:24:56] !log [universalomega@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:25:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:05] !log [universalomega@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s [19:25:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:27] !log [universalomega@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:25:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:36] !log [universalomega@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s [19:25:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:55] miraheze/mw-config - Universal-Omega the build passed. [19:26:40] !log [@test131] starting deploy of {'config': True} to all [19:26:41] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [19:26:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.11, 10.49, 9.91 [19:31:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.51, 9.89, 9.81 [19:32:38] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 15.40, 11.25, 5.39 [19:35:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.61, 11.07, 10.16 [19:36:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.79, 3.28, 3.62 [19:36:38] PROBLEM - njtelimination.ml - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'njtelimination.ml' expires in 15 day(s) (Fri 03 Mar 2023 19:11:35 GMT +0000). [19:37:22] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/afe23bafc277...0c0e2ad5d30d [19:37:25] [02miraheze/ssl] 07MirahezeSSLBot 030c0e2ad - Bot: Update SSL cert for njtelimination.ml [19:38:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.75, 2.69, 3.36 [19:43:55] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.93, 9.97, 10.00 [19:44:13] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.08, 2.85, 3.97 [19:48:05] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.14, 1.97, 3.36 [19:53:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.82, 9.92, 9.54 [19:54:53] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.26, 11.01, 10.34 [19:55:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.35, 9.19, 9.31 [19:56:53] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.90, 10.57, 10.27 [19:57:00] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.48, 2.91, 2.28 [19:58:57] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.84, 3.54, 2.59 [20:00:54] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.38, 3.17, 2.55 [20:02:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.79, 10.70, 9.98 [20:02:51] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.16, 11.49, 10.74 [20:04:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.83, 9.72, 9.72 [20:05:16] RECOVERY - njtelimination.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'njtelimination.ml' will expire on Tue 16 May 2023 18:37:12 GMT +0000. [20:06:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.56, 11.93, 11.19 [20:10:51] !log Find critical/security upgrades with: sudo salt-ssh -E '.*' cmd.run 'apt-get -s dist-upgrade | grep "^Inst" | grep -i securi | grep -v "linux-image" | awk -F " " {"print $2"}' [20:10:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.01, 4.07, 3.18 [20:12:17] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.66, 10.77, 10.19 [20:12:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 11.20, 7.92, 5.93 [20:12:33] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.19, 7.58, 5.77 [20:13:02] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 9.53, 7.00, 5.32 [20:13:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.59, 3.77, 3.17 [20:14:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.05, 6.03, 4.91 [20:15:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.80, 3.20, 3.04 [20:16:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.21, 5.89, 4.98 [20:16:48] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.21, 8.87, 10.04 [20:17:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.73, 6.25, 5.03 [20:18:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.43, 9.78, 9.96 [20:19:02] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.05, 7.59, 6.23 [20:19:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.55, 6.07, 5.12 [20:21:02] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.10, 7.92, 6.53 [20:21:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.97, 10.25, 10.19 [20:22:46] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.30, 10.44, 10.39 [20:23:02] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.03, 7.59, 6.58 [20:23:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.02, 9.40, 9.88 [20:24:45] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.40, 9.71, 10.13 [20:25:02] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 4.48, 6.40, 6.26 [20:26:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.61, 7.23, 7.28 [20:26:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.09, 7.02, 7.28 [20:28:22] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.44, 5.87, 6.77 [20:28:44] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.13, 10.54, 10.36 [20:30:14] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 17.21, 7.32, 3.78 [20:30:32] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 3.85, 5.17, 6.45 [20:30:39] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.25, 10.54, 10.19 [20:30:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.65, 10.30, 10.29 [20:34:31] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.30, 10.15, 10.13 [20:36:02] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.09, 3.44, 3.22 [20:36:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.64, 9.89, 10.18 [20:37:58] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.84, 2.61, 2.94 [20:40:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.41, 10.22, 10.06 [20:44:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.40, 9.81, 9.98 [20:52:53] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.44, 10.39, 10.18 [20:55:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.83, 4.25, 3.24 [20:57:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.33, 3.59, 3.12 [21:00:36] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.51, 9.48, 9.95 [21:04:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.86, 10.80, 9.90 [21:05:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.99, 4.03, 3.39 [21:07:34] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [21:10:33] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.00, 9.56, 9.70 [21:18:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.71, 3.78, 3.81 [21:22:22] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.29, 4.37, 3.95 [21:24:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.13, 3.87, 3.83 [21:28:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.51, 2.54, 3.29 [21:31:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.65, 3.68, 2.17 [21:33:01] !log [universalomega@puppet141] Upgraded packages libgnutls30 on bast141 [21:33:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:33:17] RECOVERY - bast141 APT on bast141 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:33:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.53, 2.70, 1.99 [21:36:06] !log [universalomega@puppet141] Upgraded packages dbus, libdbus-1-3, libexpat1, libgnutlsxx28, libgnutls-dane0, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl1.1, smbclient, samba-common, libsmbclient, python3-ldb, libldb2, samba-libs, libwbclient0, libldap-2.4-2, zlib1g, libcups2, isc-dhcp-client, isc-dhcp-common, libxml2, [21:36:07] bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, cifs-utils, libxslt1.1, xsltproc, curl, libcurl4, git-man, libcurl3-gnutls, git, gnutls-bin, libksba8, libpixman-1-0, openssl, libtiff5, linux-libc-dev, and sudo on cloud14 [21:36:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:36:57] RECOVERY - cloud14 APT on cloud14 is OK: APT OK: 94 packages available for upgrade (0 critical updates). [21:37:43] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, libgnutlsxx28, libgnutls-dane0, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl1.1, libxml2, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, libexpat1, git, gnutls-bin, libksba8, libpixman-1-0, openssl, libtiff5, [21:37:44] and sudo on cloud11 [21:37:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:38:22] RECOVERY - cloud11 APT on cloud11 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [21:40:44] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libgnutlsxx28, libgnutls-dane0, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl1.1, isc-dhcp-client, isc-dhcp-common, libxml2, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, git, [21:40:45] gnutls-bin, libksba8, libpixman-1-0, openssl, libtiff5, and sudo on cloud13 [21:40:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:42:14] RECOVERY - cloud13 APT on cloud13 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [21:50:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.17, 10.99, 9.40 [21:52:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.95, 10.65, 9.46 [21:56:06] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.85, 9.79, 9.43 [21:59:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.52, 7.44, 5.89 [22:00:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.73, 7.72, 6.08 [22:02:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.09, 6.08, 4.74 [22:06:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.43, 6.59, 5.27 [22:06:42] RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [22:07:12] PROBLEM - matomo131 HTTPS on matomo131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.009 second response time [22:09:02] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.45, 7.23, 6.08 [22:09:12] RECOVERY - matomo131 HTTPS on matomo131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.374 second response time [22:09:17] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.67, 3.11, 2.61 [22:11:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.52, 6.94, 5.94 [22:11:14] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.84, 2.63, 2.50 [22:12:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.94, 7.53, 6.09 [22:13:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.93, 6.57, 5.92 [22:15:03] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.40, 7.51, 6.56 [22:17:02] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 4.51, 6.40, 6.27 [22:18:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 4.53, 5.91, 5.86 [22:18:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.54, 7.78, 7.95 [22:18:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.05, 7.33, 7.88 [22:20:43] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.64, 7.81, 8.01 [22:24:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.71, 8.27, 8.02 [22:27:02] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.99, 6.87, 6.41 [22:28:48] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.01, 2.64, 2.09 [22:30:48] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.81, 2.58, 2.13 [22:31:02] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 4.15, 6.03, 6.22 [22:32:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.74, 7.21, 7.94 [22:32:33] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 3.73, 6.96, 7.96 [22:33:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.05, 10.36, 8.98 [22:35:10] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.31, 10.15, 9.06 [22:36:32] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 2.25, 4.67, 6.80 [22:36:56] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.88, 3.55, 2.73 [22:37:09] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.14, 9.30, 8.87 [22:38:22] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 3.25, 4.57, 6.53 [22:38:50] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.46, 3.23, 2.72 [22:47:46] !log [universalomega@puppet141] Upgraded packages on cloud14 [22:47:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:57] !log [universalomega@puppet141] Upgraded packages libgnutls30 on ldap141 [22:54:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:44] RECOVERY - ldap141 APT on ldap141 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [22:55:00] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libssl1.1, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, isc-dhcp-client, isc-dhcp-common, libxml2, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, git, libksba8, libpixman-1-0, libtiff5, [22:55:01] openssl, and sudo on db131 [22:55:03] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.47, 5.06, 3.69 [22:55:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:56:23] RECOVERY - db131 APT on db131 is OK: APT OK: 31 packages available for upgrade (0 critical updates). [22:58:11] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libgnutlsxx28, libgnutls-dane0, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl1.1, isc-dhcp-client, isc-dhcp-common, libxml2, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, git, [22:58:12] gnutls-bin, libksba8, nginx-core, nginx, libnginx-mod-stream-geoip, libnginx-mod-stream, libnginx-mod-mail, libnginx-mod-http-xslt-filter, libnginx-mod-http-geoip, libnginx-mod-http-image-filter, nginx-common, libpixman-1-0, openssl, libtiff5, and sudo on cloud10 [22:58:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:58:32] RECOVERY - cloud10 APT on cloud10 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [22:58:52] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.12, 3.18, 3.25 [22:59:27] !log [universalomega@puppet141] Upgraded packages libssl1.1, libgnutls30, bind9-dnsutils, bind9-libs, bind9-host, curl, libcurl4, git-man, libcurl3-gnutls, git, libtiff5, linux-libc-dev, openssl, and sudo on db142 [22:59:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:59:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.65, 10.44, 8.98 [22:59:49] !log [universalomega@puppet141] Upgraded packages libgnutls30 on bast121 [22:59:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:46] RECOVERY - db142 APT on db142 is OK: APT OK: 10 packages available for upgrade (0 critical updates). [23:01:02] RECOVERY - bast121 APT on bast121 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [23:01:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.06, 9.64, 8.88 [23:02:22] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libgnutlsxx28, libgnutls-dane0, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl1.1, isc-dhcp-client, isc-dhcp-common, libxml2, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, git, [23:02:23] gnutls-bin, libksba8, nginx-core, nginx, libnginx-mod-stream-geoip, libnginx-mod-stream, libnginx-mod-mail, libnginx-mod-http-xslt-filter, libnginx-mod-http-geoip, libnginx-mod-http-image-filter, nginx-common, libpixman-1-0, openssl, libtiff5, and sudo on cloud12 [23:02:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:02:40] RECOVERY - cloud12 APT on cloud12 is OK: APT OK: 76 packages available for upgrade (0 critical updates). [23:03:38] PROBLEM - db101 APT on db101 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [23:04:17] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libssl1.1, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, isc-dhcp-client, isc-dhcp-common, libxml2, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, git, libksba8, libpixman-1-0, libtiff5, [23:04:18] openssl, and sudo on db101 [23:04:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:05:16] !log [universalomega@puppet141] Upgraded packages libgnutls30, libssl1.1, bind9-dnsutils, bind9-libs, bind9-host, curl, libcurl4, git-man, libcurl3-gnutls, git, libksba8, libtiff5, linux-libc-dev, openssl, and sudo on mem141 [23:05:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:05:38] RECOVERY - db101 APT on db101 is OK: APT OK: 31 packages available for upgrade (0 critical updates). [23:06:08] RECOVERY - mem141 APT on mem141 is OK: APT OK: 15 packages available for upgrade (0 critical updates). [23:07:32] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libssl1.1, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, isc-dhcp-client, isc-dhcp-common, libxml2, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, git, libksba8, libpixman-1-0, libtiff5, [23:07:33] openssl, and sudo on db112 [23:07:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:07:53] RECOVERY - db112 APT on db112 is OK: APT OK: 31 packages available for upgrade (0 critical updates). [23:09:12] PROBLEM - matomo131 HTTPS on matomo131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.011 second response time [23:09:41] !log [universalomega@puppet141] Upgraded packages libgnutls30, libssl1.1, bind9-dnsutils, bind9-libs, bind9-host, curl, libcurl4, git-man, libcurl3-gnutls, git, libtiff5, linux-libc-dev, openjdk-11-jdk, openjdk-11-jdk-headless, openjdk-11-jre, openjdk-11-jre-headless, openssl, and sudo on es141 [23:09:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:09:54] RECOVERY - es141 APT on es141 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [23:11:12] RECOVERY - matomo131 HTTPS on matomo131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.290 second response time [23:12:42] RECOVERY - jobchron121 APT on jobchron121 is OK: APT OK: 23 packages available for upgrade (0 critical updates). [23:13:55] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libtiff5, libxml2, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl-dev, libssl1.1, isc-dhcp-client, isc-dhcp-common, bind9-dnsutils, bind9-libs, bind9-host, [23:13:56] krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, git, libde265-0, libksba8, libpixman-1-0, openssl, php7.4-zip, php7.4-xml, php7.4-readline, php7.4-opcache, php7.4-mysql, php7.4-mbstring, php7.4-ldap, php7.4-json, php7.4-intl, php7.4-gmp, php7.4-gd, php7.4-cli, php7.4-dev, php7.4-dba, php7.4-curl, php7.4-bz2, php7.4-bcmath, php7.4-common, and sudo on [23:13:57] jobchron121 [23:13:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:15:29] RECOVERY - cp22 APT on cp22 is OK: APT OK: 23 packages available for upgrade (0 critical updates). [23:15:32] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libvarnishapi2, varnish, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl1.1, isc-dhcp-client, isc-dhcp-common, libxml2, bind9-dnsutils, bind9-libs, bind9-host, curl, libcurl4, dnsutils, git-man, libcurl3-gnutls, git, libksba8, nginx- [23:15:33] core, nginx, libnginx-mod-stream-geoip, libnginx-mod-stream, libnginx-mod-mail, libnginx-mod-http-xslt-filter, libnginx-mod-http-geoip, libnginx-mod-http-image-filter, nginx-common, libpixman-1-0, libtiff5, openssl, and sudo on cp22 [23:15:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:16:38] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl1.1, isc-dhcp-client, isc-dhcp-common, libxml2, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, git, libksba8, libpixman-1-0, libtiff5, [23:16:39] openssl, and sudo on mem131 [23:16:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:17:28] PROBLEM - cp22 Varnish Backends on cp22 is WARNING: No backends detected. If this is an error, see readme.txt [23:17:53] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1, libssl1.1, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, isc-dhcp-client, isc-dhcp-common, libxml2, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, git-man, libcurl3-gnutls, git, libksba8, libpixman-1-0, libtiff5, [23:17:54] openssl, and sudo on db121 [23:17:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:18:05] RECOVERY - mem131 APT on mem131 is OK: APT OK: 23 packages available for upgrade (0 critical updates). [23:18:08] PROBLEM - cp22 HTTP 4xx/5xx ERROR Rate on cp22 is CRITICAL: CRITICAL - NGINX Error Rate is 99% [23:18:16] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 217.174.247.33/cpweb, 2a00:da00:1800:326::1/cpweb [23:18:27] PROBLEM - cp22 HTTPS on cp22 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.099 second response time [23:18:42] RECOVERY - db121 APT on db121 is OK: APT OK: 31 packages available for upgrade (0 critical updates). [23:18:51] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 217.174.247.33/cpweb, 2a00:da00:1800:326::1/cpweb [23:18:56] !log [universalomega@puppet141] Upgraded packages imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, and libgnutls30 on mon141 [23:19:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:19:17] RECOVERY - mon141 APT on mon141 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [23:23:29] !log [universalomega@puppet141] Upgraded packages libtiff5, libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, libgnutls30, libssl1.1, bind9-dnsutils, bind9-libs, bind9-host, curl, libcurl4, git-man, libcurl3-gnutls, git, imagemagick-6.q16, imagemagick, libde265-0, libgraphicsmagick-q16-3, [23:23:30] libgraphicsmagick++-q16-12, libksba8, libmagick++-6.q16-8, libopenexr25, libmagickcore-6.q16-6-extra, nodejs, libnode72, linux-libc-dev, nodejs-doc, openssl, sudo, xserver-common, and xvfb on mw141 [23:23:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:25:08] RECOVERY - mw141 APT on mw141 is OK: APT OK: 16 packages available for upgrade (0 critical updates). [23:26:43] !log [universalomega@puppet141] Upgraded packages libtiff5, libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, libgnutls30, libssl1.1, bind9-dnsutils, bind9-libs, bind9-host, curl, libcurl4, git-man, libcurl3-gnutls, git, imagemagick-6.q16, imagemagick, libde265-0, libgraphicsmagick-q16-3, [23:26:44] libgraphicsmagick++-q16-12, libksba8, libmagick++-6.q16-8, libopenexr25, libmagickcore-6.q16-6-extra, nodejs, libnode72, linux-libc-dev, nodejs-doc, openssl, sudo, xserver-common, xserver-xorg-core, and xvfb on mw142 [23:26:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:55] RECOVERY - mw142 APT on mw142 is OK: APT OK: 16 packages available for upgrade (0 critical updates). [23:28:21] !log [universalomega@puppet141] Upgraded packages libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, libgnutls30, imagemagick-6.q16, imagemagick, libmagick++-6.q16-8, and libmagickcore-6.q16-6-extra on mwtask141 [23:28:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:29:39] RECOVERY - mwtask141 APT on mwtask141 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [23:31:57] RECOVERY - mw122 APT on mw122 is OK: APT OK: 25 packages available for upgrade (0 critical updates). [23:32:16] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1-dev, libexpat1, libtiff5, libxml2, libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl-dev, libssl1.1, isc-dhcp-client, [23:32:17] isc-dhcp-common, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, dbus-user-session, ffmpeg, libavdevice58, libavfilter7, libswscale5, libavformat58, libavcodec58, libswresample3, libpostproc55, libavresample4, libavutil56, git-man, libcurl3-gnutls, git, imagemagick-6.q16, imagemagick, libde265-0, libgraphicsmagick-q16-3, [23:32:18] libgraphicsmagick++-q16-12, libksba8, libmagick++-6.q16-8, libopenexr25, libmagickcore-6.q16-6-extra, nginx-core, nginx, libnginx-mod-stream-geoip, libnginx-mod-stream, libnginx-mod-mail, libnginx-mod-http-xslt-filter, libnginx-mod-http-geoip, libnginx-mod-http-image-filter, nginx-common, nodejs, libnode72, libpixman-1-dev, libpixman-1-0, nodejs-doc, openssl, [23:32:19] php7.4-zip, php7.4-xml, php7.4-readline, php7.4-opcache, php7.4-mysql, php7.4-mbstring, php7.4-ldap, php7.4-json, php7.4-intl, php7.4-gmp, php7.4-gd, php7.4-cli, php7.4-fpm, php7.4-dev, php7.4-dba, php7.4-curl, php7.4-bz2, php7.4-bcmath, php7.4-common, sudo, xserver-common, xserver-xorg-core, and xvfb on mw122 [23:32:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:35] Wow, that was a lot of packages... [23:35:23] PROBLEM - ping6 on cp32 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 191.51 ms [23:35:32] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 0%, RTA = 198.68 ms [23:36:59] !log [universalomega@puppet141] Upgraded packages imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, and libgnutls30 on phab121 [23:37:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:38:21] RECOVERY - phab121 APT on phab121 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [23:39:30] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 121.52 ms [23:39:37] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 116.12 ms [23:40:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.04, 3.64, 2.84 [23:42:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.36, 3.05, 2.72 [23:43:37] RECOVERY - ping6 on cp32 is OK: PING OK - Packet loss = 0%, RTA = 116.39 ms [23:45:38] !log [universalomega@puppet141] Upgraded packages libgnutls30 on matomo131 [23:45:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:46:57] RECOVERY - matomo131 APT on matomo131 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [23:46:58] !log [universalomega@puppet141] Upgraded packages libgnutls30, libssl1.1, bind9-dnsutils, bind9-libs, bind9-host, curl, libcurl4, git-man, libcurl3-gnutls, git, libtiff5, linux-libc-dev, openjdk-11-jdk, openjdk-11-jdk-headless, openjdk-11-jre, openjdk-11-jre-headless, openssl, and sudo on es131 [23:47:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:47:25] !log [universalomega@puppet141] Upgraded packages libgnutls30 on graylog121 [23:47:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:47:46] RECOVERY - es131 APT on es131 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [23:49:22] RECOVERY - graylog121 APT on graylog121 is OK: APT OK: 2 packages available for upgrade (0 critical updates). [23:50:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.40, 3.86, 3.14 [23:54:40] !log [universalomega@puppet141] Upgraded packages libtiff5, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, libgnutls30, libssl-dev, libssl1.1, bind9-dnsutils, bind9-libs, bind9-host, curl, libcurl4, git-man, libcurl3-gnutls, git, libde265-0, nodejs, libnode72, linux-libc-dev, nodejs-doc, openssl, and sudo on mail121 [23:54:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:55:27] RECOVERY - mail121 APT on mail121 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [23:56:19] RECOVERY - mw131 APT on mw131 is OK: APT OK: 25 packages available for upgrade (0 critical updates). [23:56:27] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1-dev, libexpat1, libtiff5, libxml2, libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl1.1, isc-dhcp-client, isc-dhcp- [23:56:28] common, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, dbus-user-session, ffmpeg, libavdevice58, libavfilter7, libswscale5, libavformat58, libavcodec58, libswresample3, libpostproc55, libavresample4, libavutil56, git-man, libcurl3-gnutls, git, imagemagick-6.q16, imagemagick, libde265-0, libgraphicsmagick-q16-3, [23:56:29] libgraphicsmagick++-q16-12, libksba8, libmagick++-6.q16-8, libopenexr25, libmagickcore-6.q16-6-extra, nginx-core, nginx, libnginx-mod-stream-geoip, libnginx-mod-stream, libnginx-mod-mail, libnginx-mod-http-xslt-filter, libnginx-mod-http-geoip, libnginx-mod-http-image-filter, nginx-common, nodejs, libnode72, libpixman-1-dev, libpixman-1-0, nodejs-doc, openssl, [23:56:30] php7.4-zip, php7.4-xml, php7.4-readline, php7.4-opcache, php7.4-mysql, php7.4-mbstring, php7.4-ldap, php7.4-json, php7.4-intl, php7.4-gmp, php7.4-gd, php7.4-cli, php7.4-fpm, php7.4-dba, php7.4-curl, php7.4-bz2, php7.4-bcmath, php7.4-common, sudo, xserver-common, and xvfb on mw131 [23:56:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:58:04] !log [universalomega@puppet141] Upgraded packages linux-libc-dev, dbus, libdbus-1-3, libexpat1-dev, libexpat1, libtiff5, libxml2, libimage-magick-q16-perl, libimage-magick-perl, imagemagick-6-common, libmagickcore-6.q16-6, libmagickwand-6.q16-6, libgnutls30, libk5crypto3, libkrb5support0, libkrb5-3, libgssapi-krb5-2, libssl1.1, isc-dhcp-client, isc-dhcp- [23:58:05] common, bind9-dnsutils, bind9-libs, bind9-host, krb5-locales, curl, libcurl4, dbus-user-session, ffmpeg, libavdevice58, libavfilter7, libswscale5, libavformat58, libavcodec58, libswresample3, libpostproc55, libavresample4, libavutil56, git-man, libcurl3-gnutls, git, imagemagick-6.q16, imagemagick, libde265-0, libgraphicsmagick-q16-3, [23:58:06] libgraphicsmagick++-q16-12, libksba8, libmagick++-6.q16-8, libopenexr25, libmagickcore-6.q16-6-extra, nginx-core, nginx, libnginx-mod-stream-geoip, libnginx-mod-stream, libnginx-mod-mail, libnginx-mod-http-xslt-filter, libnginx-mod-http-geoip, libnginx-mod-http-image-filter, nginx-common, nodejs, libnode72, libpixman-1-dev, libpixman-1-0, nodejs-doc, openssl, [23:58:07] php7.4-zip, php7.4-xml, php7.4-readline, php7.4-opcache, php7.4-mysql, php7.4-mbstring, php7.4-ldap, php7.4-json, php7.4-intl, php7.4-gmp, php7.4-gd, php7.4-cli, php7.4-fpm, php7.4-dba, php7.4-curl, php7.4-bz2, php7.4-bcmath, php7.4-common, sudo, xserver-common, xserver-xorg-core, and xvfb on mw132 [23:58:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:58:17] RECOVERY - mw132 APT on mw132 is OK: APT OK: 25 packages available for upgrade (0 critical updates). [23:59:28] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [23:59:43] !log [universalomega@puppet141] Upgraded packages libgnutls30, libssl1.1, bind9-dnsutils, bind9-libs, bind9-host, curl, libcurl4, git-man, libcurl3-gnutls, git, libtiff5, linux-libc-dev, openssl, and sudo on ns2 [23:59:47] RECOVERY - cp22 HTTPS on cp22 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3627 bytes in 0.175 second response time [23:59:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log