[00:00:03] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:00:37] PROBLEM - miraheze.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:01:36] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 15.21, 8.15, 3.97 [00:03:11] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.26, 5.71, 3.15 [00:04:05] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [00:07:11] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.54, 2.93, 2.60 [00:07:18] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.57, 3.28, 3.13 [00:07:37] PROBLEM - swiftac111 NTP time on swiftac111 is WARNING: NTP WARNING: Offset 0.4996653795 secs [00:08:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.54, 4.18, 2.92 [00:08:38] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:10:12] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:10:33] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [00:10:56] RECOVERY - wiki.thunis.eu - reverse DNS on sslhost is OK: SSL OK - wiki.thunis.eu reverse DNS resolves to cp22.miraheze.org - CNAME OK [00:11:19] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 7.78, 6.21, 3.97 [00:12:10] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [00:12:16] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.73, 3.21, 2.86 [00:15:17] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.59, 3.95, 3.59 [00:17:16] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.54, 2.75, 3.19 [00:17:29] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:17:49] !log install mono-devel on test131 [00:17:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:19:28] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [00:21:50] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:23:51] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [00:28:02] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.97, 1.68, 1.42 [00:29:12] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:30:02] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.38, 1.52, 1.38 [00:30:19] PROBLEM - miraheze.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.com' expires in 13 day(s) (Wed 12 Oct 2022 13:21:03 GMT +0000). [00:31:06] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.07, 4.44, 2.84 [00:32:54] PROBLEM - test131 Disk Space on test131 is WARNING: DISK WARNING - free space: / 2082 MB (10% inode=65%); [00:33:14] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [00:33:26] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [00:35:06] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.07, 3.15, 2.73 [00:36:22] RECOVERY - swiftac111 NTP time on swiftac111 is OK: NTP OK: Offset 0.004448741674 secs [00:37:37] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [01:07:13] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.12, 4.24, 3.25 [01:09:13] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.60, 3.88, 3.23 [01:09:16] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:11:12] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.07, 2.90, 2.95 [01:11:22] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [01:25:09] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:27:06] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [01:28:12] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:29:06] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.58, 3.76, 1.84 [01:30:09] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [01:31:06] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.20, 2.68, 1.67 [01:46:48] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.75, 2.94, 2.42 [01:48:48] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.45, 2.29, 2.24 [01:53:03] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:54:11] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.55, 3.55, 3.04 [01:55:05] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [01:55:54] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:56:11] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.59, 2.85, 2.85 [01:56:21] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [01:56:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.78, 3.83, 2.69 [01:57:51] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [01:58:19] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.85, 3.07, 2.55 [01:58:19] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [01:59:55] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:01:51] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:02:17] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:04:32] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:06:21] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:11:02] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:12:46] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:13:03] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:15:52] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:16:54] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 11.29, 5.40, 2.81 [02:17:52] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:20:52] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.02, 3.69, 2.79 [02:22:42] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:22:51] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.33, 2.56, 2.48 [02:26:49] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:38:18] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:40:15] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:45:55] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:47:51] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [03:09:58] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [03:12:03] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [03:15:09] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [03:17:06] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [03:27:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.69, 6.02, 3.89 [03:31:22] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.04, 3.34, 3.26 [03:38:24] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [03:40:02] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.25, 3.95, 2.86 [03:40:20] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [03:42:02] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.80, 3.02, 2.64 [03:53:15] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [03:54:32] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.51, 2.92, 2.41 [03:56:27] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.82, 3.57, 2.70 [03:57:22] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [03:58:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.13, 3.22, 2.67 [04:03:47] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [04:07:55] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [04:19:55] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [04:21:51] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [04:23:06] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.19, 3.93, 2.35 [04:25:07] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.36, 2.89, 2.15 [04:37:00] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.75, 3.33, 2.77 [04:39:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.57, 2.58, 2.56 [04:44:01] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [04:46:00] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [04:46:18] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [04:47:11] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 8.25, 4.54, 2.37 [04:48:14] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [04:51:11] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.29, 3.24, 2.41 [05:05:03] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:07:00] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:08:35] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:09:19] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/invalidateUserSessions.php --wiki=avidwiki --user Michael1986 (END - exit=0) [05:09:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:09:58] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:10:34] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:14:02] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:32:13] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:34:10] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:37:28] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:39:28] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:47:43] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:49:38] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [05:49:55] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [05:54:03] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:10:02] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.97, 1.66, 1.33 [06:12:02] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.10, 1.82, 1.43 [06:18:09] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:20:10] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:24:36] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:26:35] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:28:02] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.45, 4.71, 3.15 [06:28:05] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:29:06] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.84, 3.40, 1.89 [06:29:11] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.60, 6.85, 3.82 [06:29:15] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:30:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.51, 3.56, 2.91 [06:31:06] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.32, 3.88, 2.29 [06:32:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.50, 2.84, 2.72 [06:32:10] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:33:06] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.81, 2.82, 2.10 [06:33:11] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.68, 3.45, 3.11 [06:33:17] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:35:11] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.81, 2.64, 2.85 [06:35:47] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.70, 3.34, 2.51 [06:37:47] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.70, 2.57, 2.32 [06:44:14] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [06:46:13] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [07:07:07] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:08:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.86, 4.79, 2.78 [07:09:03] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [07:10:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.26, 3.61, 2.59 [07:12:02] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.17, 1.81, 1.99 [07:12:51] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.86, 2.65, 2.36 [07:18:02] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.04, 1.23, 1.65 [07:24:24] PROBLEM - forecasting.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:25:15] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:27:13] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [07:41:36] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:50:01] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [07:52:10] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [07:52:53] PROBLEM - cloud14 Puppet on cloud14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [07:56:10] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [08:07:35] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [08:09:34] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [08:19:57] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [08:20:53] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [08:21:56] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [08:29:34] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [08:31:31] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [08:35:56] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [08:36:35] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [08:38:42] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [08:39:58] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [08:52:22] RECOVERY - forecasting.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'forecasting.wiki' will expire on Fri 16 Dec 2022 13:58:58 GMT +0000. [08:58:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.17, 4.28, 2.65 [08:58:33] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:00:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.50, 3.01, 2.38 [09:00:29] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [09:00:44] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.47, 4.38, 2.73 [09:02:44] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.57, 3.29, 2.52 [09:06:19] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1880836487 secs [09:06:44] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.38, 3.72, 2.94 [09:12:43] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.74, 2.47, 2.71 [09:17:29] PROBLEM - wiki.hsins.eu - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.hsins.eu All nameservers failed to answer the query. [09:23:35] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:25:36] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [09:25:40] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:27:36] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [09:28:19] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08746868372 secs [09:44:05] PROBLEM - swiftac111 NTP time on swiftac111 is CRITICAL: NTP CRITICAL: Offset 0.71502617 secs [09:46:28] RECOVERY - wiki.hsins.eu - reverse DNS on sslhost is OK: SSL OK - wiki.hsins.eu reverse DNS resolves to cp23.miraheze.org - CNAME OK [09:53:00] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [09:55:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.28, 5.59, 3.27 [09:57:01] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [09:58:28] RECOVERY - swiftac111 NTP time on swiftac111 is OK: NTP OK: Offset 3.018975258e-05 secs [10:01:33] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [10:01:41] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.80, 3.25, 2.92 [10:03:32] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [10:07:39] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [10:09:35] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [10:28:19] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset -0.1094866097 secs [10:33:22] PROBLEM - swiftac111 NTP time on swiftac111 is CRITICAL: NTP CRITICAL: Offset 0.727830112 secs [10:38:20] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.09221574664 secs [10:47:44] RECOVERY - swiftac111 NTP time on swiftac111 is OK: NTP OK: Offset 0.0008007287979 secs [10:54:20] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [10:56:02] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.34, 5.43, 3.03 [10:59:20] PROBLEM - cp33 SSH on cp33 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:59:29] PROBLEM - cp33 PowerDNS Recursor on cp33 is CRITICAL: CRITICAL - Plugin timed out while executing system call [11:01:29] PROBLEM - cp33 Puppet on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:02:47] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [11:03:19] RECOVERY - cp33 SSH on cp33 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [11:03:28] RECOVERY - cp33 Puppet on cp33 is OK: OK: Puppet is currently enabled, last run 38 minutes ago with 0 failures [11:03:33] RECOVERY - cp33 PowerDNS Recursor on cp33 is OK: DNS OK: 0.113 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [11:07:35] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.59, 3.49, 1.98 [11:09:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.08, 2.77, 1.90 [11:17:30] PROBLEM - wiki.hsins.eu - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.hsins.eu All nameservers failed to answer the query. [11:24:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.14, 2.41, 3.97 [11:29:31] PROBLEM - wiki.mineland.eu - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mineland.eu. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:31:36] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [11:32:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.61, 2.25, 3.28 [11:33:34] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [11:46:29] RECOVERY - wiki.hsins.eu - reverse DNS on sslhost is OK: SSL OK - wiki.hsins.eu reverse DNS resolves to cp23.miraheze.org - CNAME OK [11:48:16] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [11:50:11] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [11:54:10] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [11:56:06] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [12:12:56] PROBLEM - wiki.thunis.eu - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.thunis.eu. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:27:34] RECOVERY - wiki.mineland.eu - reverse DNS on sslhost is OK: SSL OK - wiki.mineland.eu reverse DNS resolves to cp22.miraheze.org - CNAME OK [12:37:14] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.17, 9.83, 7.45 [12:37:41] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2145942152 secs [12:37:50] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [12:38:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.81, 4.02, 2.65 [12:39:14] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.75, 8.44, 7.22 [12:40:28] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.47, 3.47, 2.60 [12:41:51] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [12:41:51] PROBLEM - wiki.thunis.eu - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.thunis.eu All nameservers failed to answer the query. [12:42:16] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [12:42:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.13, 2.60, 2.38 [12:44:04] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 14.77, 6.30, 3.21 [12:44:14] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [12:48:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.84, 3.19, 2.62 [12:51:41] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.01165786386 secs [13:10:56] RECOVERY - wiki.thunis.eu - reverse DNS on sslhost is OK: SSL OK - wiki.thunis.eu reverse DNS resolves to cp23.miraheze.org - CNAME OK [13:30:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.27, 4.42, 3.01 [13:32:01] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [13:32:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.29, 3.25, 2.75 [13:33:57] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:06:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.21, 4.01, 2.58 [14:07:27] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:08:27] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:10:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.21, 3.83, 2.89 [14:11:28] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:12:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.65, 3.09, 2.73 [14:19:00] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:26:42] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:28:39] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:37:42] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [14:39:42] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:49:06] PROBLEM - swiftac111 NTP time on swiftac111 is CRITICAL: NTP CRITICAL: Offset 0.6861334145 secs [15:00:14] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1241316199 secs [15:20:17] RECOVERY - swiftac111 NTP time on swiftac111 is OK: NTP OK: Offset -0.0008133351803 secs [15:27:46] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [15:28:22] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 17.03, 7.20, 3.78 [15:29:46] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [15:30:14] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08146175742 secs [15:32:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.16, 3.82, 3.15 [15:36:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.18, 3.04, 2.97 [15:55:01] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [15:55:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.91, 3.49, 2.73 [15:57:01] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [15:57:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 2.71, 2.53 [16:17:51] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [16:17:55] PROBLEM - wiki.veloren.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.veloren.net' expires in 15 day(s) (Sat 15 Oct 2022 15:52:05 GMT +0000). [16:19:52] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [16:24:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/395a13c652bf...9ba1778821dc [16:24:44] [url] Comparing 395a13c652bf...9ba1778821dc · miraheze/ssl · GitHub | github.com [16:24:45] [02miraheze/ssl] 07MirahezeSSLBot 039ba1778 - Bot: Update SSL cert for wiki.veloren.net [16:27:29] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [16:29:26] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [16:30:57] PROBLEM - swiftac111 NTP time on swiftac111 is CRITICAL: NTP CRITICAL: Offset 0.72814852 secs [16:37:10] RECOVERY - swiftac111 NTP time on swiftac111 is OK: NTP OK: Offset 0.001194119453 secs [16:44:45] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.49, 2.72, 1.91 [16:46:45] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.26, 2.93, 2.12 [16:47:05] RECOVERY - wiki.veloren.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.veloren.net' will expire on Wed 28 Dec 2022 15:24:37 GMT +0000. [17:23:16] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [17:27:25] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [17:29:06] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [17:31:03] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:06:58] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [18:08:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.55, 4.00, 2.98 [18:09:31] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.90, 1.64, 1.33 [18:10:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.07, 4.07, 3.13 [18:11:07] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:11:31] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.11, 1.80, 1.43 [18:11:55] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.23, 3.35, 2.97 [18:21:01] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [18:26:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.36, 4.28, 2.65 [18:29:31] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:34:38] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.65, 3.83, 3.69 [18:34:46] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.14, 2.88, 1.78 [18:34:53] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [18:36:38] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.67, 2.84, 3.34 [18:36:45] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.37, 2.92, 1.95 [18:36:50] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:48:00] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [18:50:38] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.93, 5.89, 4.02 [18:52:12] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [18:54:38] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.89, 3.69, 3.54 [18:56:38] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.28, 2.83, 3.23 [19:00:36] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.47, 3.20, 2.48 [19:02:31] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.67, 2.56, 2.33 [19:06:23] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.70, 4.22, 2.99 [19:08:18] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.94, 3.50, 2.87 [19:10:13] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.28, 2.81, 2.70 [19:11:31] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.05, 1.72, 1.99 [19:17:31] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.03, 1.20, 1.65 [19:46:11] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1242954135 secs [19:52:21] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [19:56:32] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:04:11] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08012390137 secs [20:10:11] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2320258617 secs [20:12:13] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:13:08] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.39, 4.11, 2.52 [20:14:13] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:14:38] PROBLEM - cp22 APT on cp22 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:15:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.37, 3.56, 2.51 [20:16:37] RECOVERY - cp22 APT on cp22 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:16:45] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.95, 3.05, 1.90 [20:17:01] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.16, 2.66, 2.30 [20:18:45] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.84, 2.17, 1.71 [20:33:46] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:35:46] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:35:58] PROBLEM - swiftac111 NTP time on swiftac111 is CRITICAL: NTP CRITICAL: Offset 0.6955677271 secs [20:36:11] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09652021527 secs [20:36:49] !log remove and cleanup mono-devel from test131 [20:36:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:40] RECOVERY - test131 Disk Space on test131 is OK: DISK OK - free space: / 2199 MB (11% inode=66%); [20:46:40] !log renamed templatewiki to templatewikiarchivewiki [20:46:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:48:14] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:48:30] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/9ba1778821dc...9f6bc05ae2f1 [20:48:31] [url] Comparing 9ba1778821dc...9f6bc05ae2f1 · miraheze/ssl · GitHub | github.com [20:48:32] [02miraheze/ssl] 07Universal-Omega 039f6bc05 - redirect template -> dev [20:50:18] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:52:54] PROBLEM - cp23 APT on cp23 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:56:31] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.59, 7.76, 4.39 [20:56:35] RECOVERY - cp23 APT on cp23 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [20:58:00] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=devwiki --no-updates --username-prefix=templatewiki /mnt/mediawiki-static/metawiki/ImportDump/devwiki-20220929205505.xml (START) [20:58:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:58:47] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=devwiki --no-updates --username-prefix=templatewiki /mnt/mediawiki-static/metawiki/ImportDump/devwiki-20220929205505.xml (END - exit=0) [20:58:48] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=devwiki (START) [20:59:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:59:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:00:23] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.36, 3.73, 3.49 [21:00:26] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.75, 3.56, 2.46 [21:00:33] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.1120127439 secs [21:00:51] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=devwiki (END - exit=0) [21:00:52] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=devwiki --active --update (END - exit=0) [21:00:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:01:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:01:31] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=devwiki --no-updates --username-prefix=templatewiki /mnt/mediawiki-static/metawiki/ImportDump/devwiki-20220929205624.xml (START) [21:01:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:19] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.49, 2.73, 3.16 [21:02:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.85, 2.85, 2.32 [21:02:57] PROBLEM - cp32 APT on cp32 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [21:03:17] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=devwiki --no-updates --username-prefix=templatewiki /mnt/mediawiki-static/metawiki/ImportDump/devwiki-20220929205624.xml (END - exit=0) [21:03:18] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=devwiki (START) [21:03:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:04:30] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/923220bd90c5...25d74676ab27 [21:04:31] [url] Comparing 923220bd90c5...25d74676ab27 · miraheze/mw-config · GitHub | github.com [21:04:31] [02miraheze/mw-config] 07Universal-Omega 0325d7467 - templatewiki -> devwiki in `$wgImportSources` default [21:04:36] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=devwiki (END - exit=0) [21:04:37] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=devwiki --active --update (END - exit=0) [21:04:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:04:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:05:39] miraheze/mw-config - Universal-Omega the build passed. [21:06:22] PROBLEM - cp33 APT on cp33 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [21:07:02] RECOVERY - cp32 APT on cp32 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:08:50] RECOVERY - swiftac111 NTP time on swiftac111 is OK: NTP OK: Offset -0.007325798273 secs [21:10:00] !log [@mwtask141] starting deploy of {'config': True} to all [21:10:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:10:09] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 9s [21:10:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:10:30] RECOVERY - cp33 APT on cp33 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:12:13] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.08222907782 secs [21:23:36] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=devwiki --no-updates --username-prefix=templatewiki /mnt/mediawiki-static/metawiki/ImportDump/devwiki-20220929205644.xml (START) [21:23:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:24:42] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=devwiki --no-updates --username-prefix=templatewiki /mnt/mediawiki-static/metawiki/ImportDump/devwiki-20220929205644.xml (END - exit=0) [21:24:43] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=devwiki (START) [21:24:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:24:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:25:45] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=devwiki (END - exit=0) [21:25:46] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=devwiki --active --update (END - exit=0) [21:25:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:25:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:27:34] !log [@test131] starting deploy of {'config': True} to all [21:27:35] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [21:27:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:27:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:32:17] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/invalidateUserSessions.php --wiki=metawiki --User=MacFan4000 (END - exit=256) [21:32:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:32:57]