[00:08:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.11, 3.88, 3.68 [00:10:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.04, 3.47, 3.55 [00:10:37] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.18, 3.03, 2.18 [00:12:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.98, 3.11, 3.40 [00:12:37] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.87, 3.33, 2.40 [00:13:09] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.91, 3.68, 2.43 [00:14:37] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.08, 3.19, 2.46 [00:19:09] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.99, 2.71, 2.53 [00:25:20] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.23, 4.82, 3.88 [00:31:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.14, 3.41, 3.71 [00:31:19] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.74, 3.70, 2.62 [00:33:18] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.00, 2.64, 2.36 [00:35:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.86, 3.63, 3.65 [00:37:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.93, 3.43, 3.59 [00:41:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.01, 3.72, 3.65 [00:47:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.55, 3.54, 3.64 [00:49:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.71, 5.14, 4.17 [01:01:23] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 3.75, 4.52, 2.64 [01:03:22] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.95, 3.20, 2.38 [01:05:44] PROBLEM - test131 NTP time on test131 is CRITICAL: NTP CRITICAL: Offset 0.7427132726 secs [01:06:15] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.90, 10.28, 8.45 [01:07:23] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1842924654 secs [01:08:15] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.57, 10.17, 8.66 [01:16:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.00, 2.83, 3.98 [01:20:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.38, 3.49, 3.95 [01:24:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.25, 3.55, 3.88 [01:25:23] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09917354584 secs [01:29:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.24, 3.33, 3.94 [01:29:18] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.50, 2.87, 1.81 [01:32:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.50, 2.79, 3.40 [01:35:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.42, 3.26, 3.62 [01:36:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.64, 4.96, 4.16 [01:37:17] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.82, 2.98, 2.56 [01:37:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.46, 2.84, 3.42 [01:37:54] RECOVERY - test131 NTP time on test131 is OK: NTP OK: Offset -0.01432904601 secs [01:43:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.02, 4.15, 3.76 [01:45:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.19, 3.32, 3.50 [01:51:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.00, 2.85, 3.27 [01:55:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 12.38, 8.86, 5.57 [02:15:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.17, 2.97, 3.94 [02:19:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.94, 3.52, 3.91 [02:25:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.31, 3.31, 3.74 [02:27:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.76, 3.84, 3.88 [02:29:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.99, 3.74, 3.83 [02:31:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.20, 3.91, 3.88 [02:33:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.91, 3.44, 3.70 [02:37:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.47, 2.64, 3.30 [02:45:23] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1440172493 secs [02:51:23] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09404286742 secs [02:56:12] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.49, 7.01, 4.92 [03:19:56] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.69, 2.45, 3.78 [03:21:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.97, 3.56, 4.01 [03:24:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.87, 3.25, 3.97 [03:30:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.64, 4.75, 4.22 [03:32:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.46, 3.71, 3.91 [03:34:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.12, 4.24, 4.10 [03:35:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.42, 3.33, 3.94 [03:39:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.12, 3.68, 3.91 [03:41:41] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.29, 3.46, 3.80 [03:43:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.10, 3.93, 3.94 [03:47:37] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.97, 3.41, 3.73 [03:51:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.21, 3.46, 3.63 [03:52:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1038269103 secs [03:54:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.31, 3.27, 3.88 [03:57:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.24, 3.75, 3.81 [04:00:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.41, 3.92, 3.88 [04:01:28] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.70, 2.65, 3.35 [04:02:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.41, 2.96, 3.53 [04:04:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.79, 3.54, 3.66 [04:11:21] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.73, 5.61, 4.19 [04:15:18] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.31, 3.71, 3.73 [04:16:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09931245446 secs [04:18:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.90, 3.48, 3.93 [04:19:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.02, 2.83, 3.36 [04:22:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.55, 4.41, 4.18 [04:25:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 27.82, 14.56, 7.71 [04:26:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.92, 3.63, 3.91 [04:30:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.05, 3.95, 3.97 [04:32:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.34, 3.82, 3.93 [04:34:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.04, 4.09, 4.02 [04:42:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.57, 3.17, 3.73 [04:45:20] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.18, 2.46, 3.87 [04:48:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.72, 3.39, 3.58 [04:51:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.15, 2.44, 3.40 [04:52:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 2.68, 3.27 [05:02:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 20.06, 10.02, 5.64 [05:09:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.46, 3.17, 2.98 [05:11:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.24, 2.86, 2.89 [05:16:48] [02mw-config] 07AgentIsai opened pull request 03#5055: Update approval/decline wiki request messages - 13https://github.com/miraheze/mw-config/pull/5055 [05:17:42] miraheze/mw-config - AgentIsai the build has errored. [05:18:14] [02mw-config] 07AgentIsai synchronize pull request 03#5055: Update approval/decline wiki request messages - 13https://github.com/miraheze/mw-config/pull/5055 [05:19:17] miraheze/mw-config - AgentIsai the build passed. [05:24:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.30, 2.18, 3.98 [05:26:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.82, 3.45, 4.22 [05:28:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.30, 2.84, 3.89 [05:30:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.60, 4.48, 4.38 [05:44:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.85, 3.08, 3.94 [05:50:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.64, 3.76, 3.91 [05:52:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.52, 3.13, 3.65 [05:54:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.74, 2.59, 3.39 [06:02:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.98, 5.49, 4.25 [06:13:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.50, 9.93, 8.40 [06:15:40] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.06, 8.91, 8.22 [06:50:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1100953221 secs [06:53:09] [02mw-config] 07Universal-Omega reviewed pull request 03#5055 commit - 13https://github.com/miraheze/mw-config/pull/5055#discussion_r1063180012 [06:53:10] [02mw-config] 07Universal-Omega reviewed pull request 03#5055 commit - 13https://github.com/miraheze/mw-config/pull/5055#discussion_r1063180253 [06:54:01] [02mw-config] 07Universal-Omega commented on pull request 03#5055: Update approval/decline wiki request messages - 13https://github.com/miraheze/mw-config/pull/5055#issuecomment-1373211071 [06:55:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 27.97, 13.16, 6.46 [07:04:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.00, 2.42, 3.86 [07:06:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.53, 3.10, 3.93 [07:10:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09938678145 secs [07:13:10] [02mw-config] 07AgentIsai synchronize pull request 03#5055: Update approval/decline wiki request messages - 13https://github.com/miraheze/mw-config/pull/5055 [07:13:16] [02mw-config] 07AgentIsai synchronize pull request 03#5055: Update approval/decline wiki request messages - 13https://github.com/miraheze/mw-config/pull/5055 [07:13:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.74, 2.77, 3.80 [07:13:32] [02mw-config] 07AgentIsai commented on pull request 03#5055: Update approval/decline wiki request messages - 13https://github.com/miraheze/mw-config/pull/5055#issuecomment-1373234729 [07:14:11] miraheze/mw-config - AgentIsai the build passed. [07:14:19] miraheze/mw-config - AgentIsai the build passed. [07:16:19] PROBLEM - cp32 PowerDNS Recursor on cp32 is CRITICAL: CRITICAL - Plugin timed out while executing system call [07:17:18] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.53, 3.36, 3.73 [07:18:49] PROBLEM - cp32 SSH on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:19:09] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.82, 3.68, 2.07 [07:19:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.85, 3.40, 3.69 [07:21:08] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.57, 2.89, 1.98 [07:21:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.50, 4.30, 3.98 [07:22:48] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:23:56] PROBLEM - cp32 Puppet on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:28:38] PROBLEM - cp32 conntrack_table_size on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:29:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.64, 3.71, 3.93 [07:31:09] RECOVERY - cp32 conntrack_table_size on cp32 is OK: OK: nf_conntrack is 3 % full [07:33:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.85, 3.50, 3.73 [07:33:33] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [07:33:40] RECOVERY - cp32 SSH on cp32 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [07:33:41] RECOVERY - cp32 PowerDNS Recursor on cp32 is OK: DNS OK: 0.207 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [07:34:38] RECOVERY - cp32 Puppet on cp32 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [07:35:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.34, 3.55, 3.73 [07:39:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.86, 2.71, 3.31 [07:43:18] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 14.84, 6.67, 4.60 [07:49:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.35, 3.55, 3.90 [07:53:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.65, 3.28, 3.64 [07:59:10] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.50, 3.42, 1.99 [08:07:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.58, 2.77, 3.92 [08:09:10] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.74, 3.01, 3.15 [08:11:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.48, 1.86, 3.27 [08:18:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.44, 1.94, 3.77 [08:20:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.93, 3.01, 3.93 [08:24:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.57, 3.25, 3.87 [08:29:07] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.14, 2.75, 2.20 [08:31:06] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.44, 2.78, 2.29 [08:34:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 13.32, 6.34, 4.63 [08:46:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.75, 2.81, 3.83 [08:49:56] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/ca75f38ebe61 [08:49:59] [02miraheze/mw-config] 07Reception123 03ca75f38 - add autopatrolled protection level to meta per Community Discussion [08:50:01] [02mw-config] 07Reception123 created branch 03Reception123-patch-2 - 13https://github.com/miraheze/mw-config [08:50:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.82, 1.77, 3.16 [08:51:59] [02mw-config] 07Reception123 opened pull request 03#5056: add autopatrolled protection level to meta per Community Discussion - 13https://github.com/miraheze/mw-config/pull/5056 [08:53:05] miraheze/mw-config - Reception123 the build passed. [08:53:46] [02mw-config] 07Reception123 closed pull request 03#5056: add autopatrolled protection level to meta per Community Discussion - 13https://github.com/miraheze/mw-config/pull/5056 [08:53:48] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-2 [08:53:50] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/bde418941091...95bc746f66e6 [08:53:53] [02miraheze/mw-config] 07Reception123 0395bc746 - add autopatrolled protection level to meta per Community Discussion (#5056) [08:53:55] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-2 - 13https://github.com/miraheze/mw-config [08:54:47] miraheze/mw-config - Reception123 the build passed. [08:54:57] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.07, 5.14, 3.19 [08:56:44] !log [@test131] starting deploy of {'config': True} to all [08:56:45] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [08:56:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:56:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:56:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.49, 3.88, 2.96 [09:00:53] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.18, 2.84, 2.78 [09:05:23] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.03, 4.89, 3.59 [09:10:27] !log [@mwtask141] starting deploy of {'config': True} to all [09:10:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:10:34] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [09:10:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:12:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.21, 3.83, 2.94 [09:14:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.69, 2.90, 2.70 [09:20:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.93, 2.34, 3.97 [09:24:53] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.28, 1.67, 3.31 [09:35:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.08, 4.31, 3.75 [09:45:31] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.46, 3.65, 3.92 [09:49:25] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.41, 2.33, 3.32 [09:55:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.05, 3.00, 2.02 [09:57:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.39, 2.70, 2.02 [10:06:05] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.65, 6.70, 4.56 [10:09:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.22, 3.99, 3.95 [10:11:58] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 23.71, 11.20, 6.54 [10:39:38] PROBLEM - cp32 SSH on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:41:38] RECOVERY - cp32 SSH on cp32 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [10:56:01] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.57, 6.41, 3.96 [11:04:44] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.80, 2.45, 3.88 [11:06:40] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 12.23, 6.06, 5.01 [11:15:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.04, 1.83, 3.95 [11:16:25] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.92, 2.39, 3.64 [11:18:22] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.83, 1.92, 3.32 [11:19:52] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.30, 1.56, 3.34 [11:28:44] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.06, 4.18, 3.82 [11:30:43] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.38, 3.05, 3.44 [11:32:42] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.73, 2.24, 3.10 [11:38:25] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.15, 6.06, 3.83 [11:54:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.52, 2.20, 3.97 [11:56:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.12, 6.13, 3.63 [11:58:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.63, 1.37, 3.22 [12:00:28] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.83, 3.38, 3.08 [12:06:27] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.06, 5.37, 4.00 [12:16:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.05, 3.06, 3.82 [12:20:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.11, 1.98, 3.19 [12:23:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.53, 3.54, 2.66 [12:32:16] PROBLEM - cp33 PowerDNS Recursor on cp33 is CRITICAL: CRITICAL - Plugin timed out while executing system call [12:33:16] PROBLEM - cp33 SSH on cp33 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:34:11] RECOVERY - cp33 PowerDNS Recursor on cp33 is OK: DNS OK: 0.130 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [12:35:14] RECOVERY - cp33 SSH on cp33 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [12:38:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.70, 6.71, 4.35 [12:42:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.05, 4.00, 3.79 [12:46:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.73, 2.29, 3.14 [12:53:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.24, 1.85, 3.92 [12:57:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.93, 1.42, 3.27 [13:07:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.82, 6.35, 3.83 [13:13:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.79, 3.52, 3.37 [13:15:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.41, 2.78, 3.11 [13:28:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.33, 4.08, 3.08 [13:29:13] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.67, 2.90, 1.78 [13:32:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.28, 3.13, 2.98 [13:33:12] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.30, 2.53, 1.95 [13:52:14] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.54, 7.24, 5.08 [13:59:08] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.17, 2.81, 1.81 [14:03:07] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.56, 3.85, 2.60 [14:05:07] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.28, 2.92, 2.40 [14:08:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.44, 3.37, 2.33 [14:10:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.59, 3.68, 2.56 [14:12:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.77, 3.62, 2.67 [14:13:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.15, 10.79, 8.43 [14:14:14] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 4.31, 6.71, 7.71 [14:14:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.60, 2.99, 2.56 [14:15:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.85, 9.51, 8.25 [14:18:14] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.37, 5.00, 6.79 [14:21:23] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2348833978 secs [14:24:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 2.44, 4.06, 3.21 [14:26:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.37, 3.21, 3.01 [14:28:21] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.64, 4.94, 3.43 [14:30:19] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.78, 3.74, 3.17 [14:32:18] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.79, 2.69, 2.85 [14:38:28] PROBLEM - cp32 PowerDNS Recursor on cp32 is CRITICAL: CRITICAL - Plugin timed out while executing system call [14:38:29] PROBLEM - cp32 SSH on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:38:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 30.90, 16.80, 8.16 [14:40:29] RECOVERY - cp32 SSH on cp32 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [14:40:32] RECOVERY - cp32 PowerDNS Recursor on cp32 is OK: DNS OK: 4.942 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [14:42:28] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1702556908 secs [14:43:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.94, 11.76, 9.23 [14:45:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.40, 10.45, 9.07 [14:46:54] PROBLEM - cp32 SSH on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:47:04] PROBLEM - cp32 PowerDNS Recursor on cp32 is CRITICAL: CRITICAL - Plugin timed out while executing system call [14:47:09] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 108.175.15.182/cpweb, 2607:f1c0:1800:8100::1/cpweb [14:47:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.60, 8.79, 8.63 [14:47:26] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 108.175.15.182/cpweb, 2607:f1c0:1800:8100::1/cpweb [14:48:53] RECOVERY - cp32 SSH on cp32 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [14:49:09] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [14:49:26] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [14:50:16] PROBLEM - cp32 Puppet on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [14:50:29] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.0857886374 secs [14:51:12] RECOVERY - cp32 PowerDNS Recursor on cp32 is OK: DNS OK: 0.197 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [14:51:23] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.01987099648 secs [14:52:13] RECOVERY - cp32 Puppet on cp32 is OK: OK: Puppet is currently enabled, last run 39 minutes ago with 0 failures [14:53:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 9.97, 8.76 [14:55:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.93, 9.86, 8.88 [15:00:58] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 13.66, 5.63, 2.96 [15:01:15] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.73, 10.26, 9.39 [15:01:23] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1000820696 secs [15:03:23] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.01631954312 secs [15:05:14] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.25, 12.17, 10.27 [15:08:57] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.19, 3.46, 3.25 [15:10:57] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.03, 2.64, 2.98 [15:11:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.04, 10.90, 10.47 [15:12:02] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.71, 11.15, 9.89 [15:14:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.99, 10.82, 9.93 [15:21:09] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.52, 10.94, 10.55 [15:23:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.41, 10.27, 10.35 [15:24:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.47, 2.64, 2.16 [15:26:38] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.25, 2.48, 2.16 [15:27:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.03, 10.83, 10.53 [15:27:46] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.69, 11.88, 10.81 [15:28:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.64, 2.18, 3.79 [15:29:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.02, 11.11, 10.69 [15:29:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.59, 11.28, 10.74 [15:30:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.07, 2.90, 3.83 [15:32:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.37, 2.67, 3.64 [15:34:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.91, 4.00, 4.03 [15:35:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.45, 12.29, 11.16 [15:41:31] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.05, 13.06, 11.56 [15:44:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.73, 3.25, 3.81 [15:48:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.03, 2.53, 3.36 [15:51:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.72, 11.66, 11.83 [15:55:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.27, 4.22, 3.01 [15:56:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.11, 11.31, 11.89 [16:01:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.79, 3.43, 3.22 [16:02:55] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.57, 12.36, 12.02 [16:03:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.77, 2.87, 3.04 [16:05:18] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.74, 3.40, 3.18 [16:07:17] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.92, 4.80, 3.71 [16:11:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.15, 13.22, 11.69 [16:11:55] [02mw-config] 07redbluegreenhat opened pull request 03#5057: T10257: set wgUrlProtocols for 100acgwiki - 13https://github.com/miraheze/mw-config/pull/5057 [16:13:10] miraheze/mw-config - redbluegreenhat the build passed. [16:18:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.00, 2.99, 3.78 [16:22:49] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.20, 10.85, 11.89 [16:22:53] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.85, 2.27, 3.30 [16:23:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.75, 11.36, 11.93 [16:23:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.51, 4.80, 3.56 [16:24:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 11.03, 11.81 [16:26:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.54, 9.94, 11.31 [16:33:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.88, 2.98, 3.74 [16:34:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.47, 4.48, 3.84 [16:34:45] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.83, 11.99, 11.41 [16:37:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.76, 1.92, 3.14 [16:41:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.11, 11.86, 11.06 [16:42:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.23, 11.15, 11.55 [16:45:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.84, 11.77, 11.31 [16:46:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.06, 2.88, 3.73 [16:46:41] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.66, 12.14, 11.74 [16:48:40] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.44, 11.28, 11.47 [16:49:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.43, 11.43, 11.23 [16:50:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.91, 2.42, 3.35 [16:53:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.95, 11.74, 11.41 [16:58:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.61, 11.11, 11.14 [17:02:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.64, 10.26, 10.83 [17:04:35] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.50, 12.35, 11.50 [17:10:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.00, 3.94, 3.53 [17:12:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.00, 2.94, 3.21 [17:13:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.40, 11.62, 10.97 [17:13:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.98, 4.17, 2.98 [17:14:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.60, 11.82, 11.76 [17:15:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.91, 11.65, 11.09 [17:15:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.08, 3.33, 2.82 [17:15:55] [02mw-config] 07Universal-Omega closed pull request 03#5057: T10257: set wgUrlProtocols for 100acgwiki - 13https://github.com/miraheze/mw-config/pull/5057 [17:15:58] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/95bc746f66e6...d2d8dcc681a8 [17:16:01] [02miraheze/mw-config] 07redbluegreenhat 03d2d8dcc - T10257: set wgUrlProtocols for 100acgwiki (#5057) [17:16:59] miraheze/mw-config - Universal-Omega the build passed. [17:20:59] [02mw-config] 07Universal-Omega reviewed pull request 03#5055 commit - 13https://github.com/miraheze/mw-config/pull/5055#discussion_r1063626952 [17:21:00] [02mw-config] 07Universal-Omega reviewed pull request 03#5055 commit - 13https://github.com/miraheze/mw-config/pull/5055#discussion_r1063626632 [17:21:52] [02mw-config] 07AgentIsai synchronize pull request 03#5055: Update approval/decline wiki request messages - 13https://github.com/miraheze/mw-config/pull/5055 [17:21:59] [02mw-config] 07AgentIsai synchronize pull request 03#5055: Update approval/decline wiki request messages - 13https://github.com/miraheze/mw-config/pull/5055 [17:22:56] miraheze/mw-config - AgentIsai the build passed. [17:22:59] miraheze/mw-config - AgentIsai the build passed. [17:25:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.91, 9.41, 10.12 [17:25:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 11.58, 5.41, 3.64 [17:27:17] !log [@test131] starting deploy of {'config': True} to all [17:27:18] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [17:27:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:27:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:31:47] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.16, 3.93, 3.56 [17:33:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.11, 3.18, 3.33 [17:34:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.83, 12.39, 11.37 [17:38:22] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 15.84, 7.09, 4.08 [17:38:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.12, 11.95, 11.55 [17:39:40] !log [@mwtask141] starting deploy of {'config': True} to all [17:39:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:39:49] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [17:39:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:42:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.52, 12.75, 10.95 [17:43:23] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1129155755 secs [17:44:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.62, 3.80, 3.56 [17:45:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.74, 11.07, 10.72 [17:48:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.28, 2.73, 3.19 [17:49:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.75, 11.75, 11.02 [17:50:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.47, 11.36, 11.17 [17:51:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.42, 10.88, 10.79 [17:52:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.97, 10.21, 10.76 [17:52:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.18, 3.21, 3.23 [17:55:30] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.19, 3.69, 2.99 [17:57:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.96, 3.49, 3.01 [17:57:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.11, 9.61, 10.18 [17:58:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.76, 9.19, 10.09 [17:58:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.22, 3.88, 3.67 [17:59:27] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.97, 3.89, 3.21 [18:01:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.65, 3.06, 2.98 [18:02:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.65, 2.99, 3.33 [18:03:23] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07883626223 secs [18:04:15] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.21, 11.14, 10.59 [18:08:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.47, 11.30, 10.88 [18:08:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.03, 5.25, 4.06 [18:12:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.80, 9.45, 10.18 [18:13:26] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.57, 11.23, 10.28 [18:14:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.81, 3.37, 3.68 [18:15:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.84, 10.84, 10.26 [18:17:22] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.38, 10.15, 10.08 [18:24:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.84, 9.87, 9.87 [18:24:12] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.83, 10.27, 10.20 [18:24:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.43, 4.67, 3.99 [18:26:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.83, 9.52, 9.73 [18:26:10] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.05, 9.11, 9.78 [18:32:33] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 8.77, 4.85, 2.83 [18:36:02] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.69, 11.07, 10.14 [18:36:32] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.31, 3.41, 2.76 [18:38:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.67, 2.45, 2.48 [18:40:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.59, 11.30, 10.41 [18:40:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.19, 3.05, 4.00 [18:42:00] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.49, 10.64, 10.28 [18:42:49] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.82, 11.79, 10.37 [18:43:29] PROBLEM - mail121 Current Load on mail121 is WARNING: WARNING - load average: 1.89, 1.43, 0.70 [18:43:59] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.72, 9.87, 10.06 [18:44:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.78, 11.96, 10.62 [18:45:29] RECOVERY - mail121 Current Load on mail121 is OK: OK - load average: 0.30, 0.98, 0.62 [18:46:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.32, 2.25, 3.29 [18:50:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.25, 10.76, 10.35 [18:52:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.18, 9.90, 10.13 [18:52:55] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.19, 9.89, 10.09 [18:56:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.27, 3.30, 2.72 [18:56:53] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.54, 11.70, 10.78 [19:00:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.80, 11.29, 10.88 [19:02:42] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.64, 3.23, 3.06 [19:04:51] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.90, 11.80, 11.16 [19:10:49] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.57, 11.65, 11.34 [19:14:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.59, 11.09, 10.19 [19:16:14] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.17, 10.23, 10.00 [19:18:12] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.85, 9.36, 9.73 [19:22:45] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.46, 9.06, 10.11 [19:23:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.15, 4.72, 3.53 [19:28:13] PROBLEM - cp33 PowerDNS Recursor on cp33 is CRITICAL: CRITICAL - Plugin timed out while executing system call [19:30:07] RECOVERY - cp33 PowerDNS Recursor on cp33 is OK: DNS OK: 0.219 seconds response time. miraheze.org returns 108.175.15.182,2607:f1c0:1800:26f::1,2607:f1c0:1800:8100::1,74.208.203.152 [19:31:25] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.40, 3.28, 2.10 [19:32:41] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.47, 9.19, 9.49 [19:34:40] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.57, 11.55, 10.31 [19:35:45] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.19, 3.40, 2.86 [19:39:24] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.34, 3.15, 2.93 [19:40:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.64, 11.31, 10.70 [19:41:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.05, 3.34, 3.16 [19:43:42] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.91, 12.19, 10.12 [19:44:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.16, 11.12, 10.70 [19:45:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.77, 11.51, 10.15 [19:46:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.48, 10.00, 10.36 [19:50:35] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.90, 9.65, 10.16 [19:50:53] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [19:51:33] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.41, 9.34, 9.66 [19:54:53] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [20:04:57] [02mw-config] 07redbluegreenhat opened pull request 03#5058: T10256: Add wgCategoryTreeMaxDepth and set a custom value for acg100wiki - 13https://github.com/miraheze/mw-config/pull/5058 [20:05:59] miraheze/mw-config - redbluegreenhat the build passed. [20:07:12] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.81, 4.10, 3.41 [20:13:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.17, 11.10, 9.28 [20:15:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.95, 3.95, 3.90 [20:15:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.21, 10.37, 9.22 [20:17:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.68, 3.92, 3.87 [20:17:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.72, 9.19, 8.94 [20:18:57] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.46, 3.38, 3.68 [20:20:54] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.43, 3.72, 3.75 [20:24:48] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.76, 3.02, 3.48 [20:26:45] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.71, 2.69, 3.31 [20:33:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.46, 3.05, 3.79 [20:35:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.08, 3.22, 3.73 [20:36:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.17, 4.46, 3.62 [20:37:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.57, 2.45, 3.38 [20:38:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.85, 3.71, 3.44 [20:40:30] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.20, 3.35, 3.35 [20:43:20] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.04, 5.58, 4.30 [20:51:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.27, 3.70, 3.95 [20:53:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.28, 3.75, 3.92 [20:56:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1129961312 secs [21:04:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.53, 10.71, 9.55 [21:06:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.45, 10.46, 9.60 [21:08:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.44, 9.85, 9.49 [21:10:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.08, 4.59, 3.32 [21:11:31] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03postfix-discard-spam [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/f1baaa44e21f [21:11:33] [02miraheze/puppet] 07Universal-Omega 03f1baaa4 - postfix: discard mail with spamassassin level of 7 or higher [21:11:36] [02puppet] 07Universal-Omega created branch 03postfix-discard-spam - 13https://github.com/miraheze/puppet [21:11:37] [02puppet] 07Universal-Omega opened pull request 03#3113: postfix: discard mail with spamassassin level of 7 or higher - 13https://github.com/miraheze/puppet/pull/3113 [21:15:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.56, 3.22, 3.91 [21:16:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.50, 3.78, 3.64 [21:19:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.45, 2.22, 3.33 [21:20:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.26, 2.59, 3.20 [21:23:42] [02mw-config] 07Universal-Omega closed pull request 03#5058: T10256: Add wgCategoryTreeMaxDepth and set a custom value for acg100wiki - 13https://github.com/miraheze/mw-config/pull/5058 [21:23:44] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/d2d8dcc681a8...c3a8207e7372 [21:23:45] [02miraheze/mw-config] 07redbluegreenhat 03c3a8207 - T10256: Add wgCategoryTreeMaxDepth and set a custom value for acg100wiki (#5058) [21:24:52] miraheze/mw-config - Universal-Omega the build passed. [21:24:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09547364712 secs [21:26:51] !log [@test131] starting deploy of {'config': True} to all [21:26:52] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [21:26:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:26:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:27:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.67, 4.53, 3.83 [21:33:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.58, 3.98, 3.91 [21:36:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.12, 10.55, 9.24 [21:38:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.08, 3.86, 3.29 [21:38:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.83, 10.21, 9.28 [21:39:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.81, 2.59, 3.26 [21:39:57] !log [@mwtask141] starting deploy of {'config': True} to all [21:40:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:40:06] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [21:40:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:40:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.48, 3.92, 3.39 [21:40:55] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.41, 9.92, 9.28 [21:41:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.28, 10.53, 9.39 [21:41:46] [02MirahezeMagic] 07Universal-Omega commented on pull request 03#385: T9997: Add Miraheze-specific CreateWiki messages - 13https://github.com/miraheze/MirahezeMagic/pull/385#issuecomment-1374167054 [21:43:17] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.50, 10.86, 9.65 [21:44:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.88, 2.72, 3.07 [21:49:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.22, 9.82, 9.70 [21:59:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.23, 7.96, 5.26 [22:02:59] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.45, 3.60, 2.15 [22:04:58] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.42, 3.31, 2.24 [22:07:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.18, 2.82, 3.76 [22:12:33] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [22:13:51] [02miraheze/puppet] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/28cc9388b780 [22:13:52] [02miraheze/puppet] 07The-Voidwalker 0328cc938 - explicitly configure phabricator favicon [22:13:53] [02puppet] 07The-Voidwalker created branch 03The-Voidwalker-patch-1 - 13https://github.com/miraheze/puppet [22:13:55] [02puppet] 07The-Voidwalker opened pull request 03#3114: explicitly configure phabricator favicon - 13https://github.com/miraheze/puppet/pull/3114 [22:15:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.68, 2.72, 3.40 [22:23:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.13, 3.95, 3.50 [22:23:39] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.63, 10.18, 9.29 [22:24:45] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.19, 4.01, 3.04 [22:25:38] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.59, 9.83, 9.29 [22:37:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.22, 2.95, 3.80 [22:37:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.87, 11.38, 10.08 [22:39:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.56, 11.33, 10.22 [22:40:32] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:41:36] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.99, 9.92, 9.83 [22:43:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.67, 3.27, 3.56 [22:43:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.23, 9.65, 9.21 [22:45:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.40, 3.19, 3.50 [22:49:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.78, 2.57, 3.20 [22:51:54] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=androgynywiki --no-updates --username-prefix=wikia:tales-of-androgyny /home/macfan/ImportDump/androgynywiki-20221230164914.xml (START) [22:51:55] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=androgynywiki --no-updates --username-prefix=wikia:tales-of-androgyny /home/macfan/ImportDump/androgynywiki-20221230164914.xml (END - exit=256) [22:51:56] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=androgynywiki (START) [22:51:57] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=androgynywiki (END - exit=0) [22:51:58] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=androgynywiki --active --update (END - exit=0) [22:51:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.81, 2.64, 3.89 [22:54:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.47, 3.65, 4.10 [22:56:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 17.21, 7.19, 4.74 [22:56:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.47, 3.31, 3.91 [22:57:23] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.45, 10.04, 9.98 [23:00:40] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=locarbwiki --no-updates --username-prefix=mh:locarb /home/macfan/ImportDump/locarbwiki-20230104173245.xml (START) [23:00:41] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=locarbwiki --no-updates --username-prefix=mh:locarb /home/macfan/ImportDump/locarbwiki-20230104173245.xml (END - exit=0) [23:00:42] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=locarbwiki (START) [23:00:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:50] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=locarbwiki (END - exit=0) [23:00:51] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=locarbwiki --active --update (END - exit=0) [23:00:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:01:09] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2812879384 secs [23:01:50] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.40, 5.76, 3.06 [23:03:12] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=archaeomysticismwiki --no-updates --username-prefix=w /home/macfan/ImportDump/archaeomysticismwiki-20230106090359.xml (START) [23:03:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:03:19] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=archaeomysticismwiki --no-updates --username-prefix=w /home/macfan/ImportDump/archaeomysticismwiki-20230106090359.xml (END - exit=0) [23:03:20] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=archaeomysticismwiki (START) [23:03:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:03:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:05:32] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.69, 10.58, 9.91 [23:05:52] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=archaeomysticismwiki (END - exit=0) [23:05:53] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=archaeomysticismwiki --active --update (END - exit=0) [23:05:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:05:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:06:10] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.57, 2.82, 3.80 [23:06:59] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.01113951206 secs [23:07:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.24, 10.70, 10.04 [23:08:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 14.49, 6.86, 4.81 [23:09:30] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.44, 9.71, 9.75 [23:09:49] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.97, 3.84, 3.52 [23:11:48] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.84, 2.90, 3.22 [23:12:06] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.97, 11.28, 10.29 [23:14:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.48, 11.74, 10.62 [23:15:09] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.81, 2.96, 1.60 [23:16:03] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.33, 2.67, 3.31 [23:16:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.43, 2.84, 3.72 [23:19:08] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.13, 3.02, 2.05 [23:21:56] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.37, 9.64, 10.12 [23:22:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.65, 2.45, 3.28 [23:26:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.88, 3.34, 3.50 [23:27:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.16, 5.42, 3.88 [23:28:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.85, 2.96, 3.35 [23:33:50] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.89, 3.48, 3.70 [23:35:21] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.97, 11.00, 9.69 [23:36:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.51, 4.41, 3.72 [23:37:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 12.00, 11.33, 9.96 [23:39:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.80, 2.81, 3.30 [23:42:31] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.06, 12.49, 10.67 [23:45:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.14, 9.20, 9.52 [23:46:27] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.38, 11.17, 10.56 [23:47:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.25, 3.77, 3.58 [23:48:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.67, 3.32, 3.90 [23:49:38] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.28, 2.92, 3.29 [23:50:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.26, 3.87, 4.06 [23:52:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.98, 3.53, 3.91 [23:52:21] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.15, 9.46, 10.02 [23:54:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.35, 3.64, 3.89 [23:55:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.55, 4.11, 3.67 [23:56:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.30, 3.19, 3.70 [23:58:16] PROBLEM - mw122 NTP time on mw122 is WARNING: NTP WARNING: Offset 0.1070677638 secs