[00:03:02] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.42, 4.08, 3.24 [00:03:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.41, 4.95, 3.71 [00:04:37] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.48, 7.47, 6.57 [00:04:37] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.69, 5.73, 4.03 [00:06:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.09, 8.61, 7.09 [00:06:24] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.27, 6.49, 4.51 [00:06:33] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.64, 3.00, 2.26 [00:06:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.83, 3.99, 3.51 [00:07:34] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1057178676 secs [00:07:45] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.14, 7.99, 7.04 [00:08:35] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.57, 2.78, 2.27 [00:08:35] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.50, 3.21, 3.28 [00:09:36] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.40, 8.35, 7.24 [00:10:03] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.06, 7.42, 5.48 [00:11:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.75, 10.74, 9.88 [00:12:05] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.38, 5.21, 4.90 [00:12:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.86, 3.88, 3.63 [00:13:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.08, 7.18, 7.02 [00:14:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.52, 10.47, 10.05 [00:17:28] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.15, 6.00, 6.57 [00:18:15] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.06, 2.83, 3.24 [00:18:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.57, 10.86, 10.24 [00:20:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.51, 10.51, 10.18 [00:20:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.15, 3.20, 3.92 [00:22:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.63, 9.87, 9.99 [00:23:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.08, 10.28, 9.63 [00:24:52] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.05, 4.13, 4.01 [00:25:28] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09318804741 secs [00:25:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.78, 8.96, 9.23 [00:26:03] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.69, 3.28, 2.63 [00:26:03] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.01, 7.09, 5.14 [00:26:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.55, 3.97, 3.60 [00:26:49] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.80, 3.94, 3.96 [00:27:27] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [00:28:03] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.58, 2.86, 2.55 [00:28:04] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.30, 4.55, 3.85 [00:28:04] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.76, 5.20, 4.68 [00:28:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.90, 11.37, 10.44 [00:30:00] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.46, 3.82, 3.67 [00:30:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.99, 11.63, 10.66 [00:32:03] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.37, 7.23, 5.57 [00:32:40] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.63, 2.27, 3.18 [00:34:09] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 6.11, 7.17, 5.77 [00:35:43] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.56, 11.11, 10.12 [00:35:56] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.92, 5.06, 4.07 [00:36:03] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.39, 6.26, 5.65 [00:36:36] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.41, 2.84, 3.20 [00:37:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.55, 10.26, 9.92 [00:38:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.46, 3.31, 3.32 [00:38:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.39, 11.14, 10.72 [00:39:42] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.07, 9.73, 9.76 [00:40:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.16, 3.77, 3.79 [00:40:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.37, 3.08, 3.25 [00:44:04] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 15.17, 9.04, 6.66 [00:44:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.11, 10.74, 10.87 [00:46:20] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.95, 4.58, 3.33 [00:47:15] PROBLEM - mem141 Puppet on mem141 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:47:50] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.50, 4.15, 3.83 [00:49:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.47, 3.75, 3.71 [00:50:01] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.38, 3.95, 3.42 [00:50:03] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.91, 6.58, 6.52 [00:50:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.88, 3.22, 3.12 [00:52:00] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.78, 3.20, 3.20 [00:52:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.10, 9.14, 10.07 [00:53:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.26, 4.14, 3.84 [00:54:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.85, 4.48, 3.57 [00:56:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.09, 3.48, 3.32 [00:58:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.02, 4.51, 3.69 [01:02:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.08, 3.54, 3.52 [01:04:33] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.20, 10.83, 9.42 [01:04:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.00, 4.23, 3.77 [01:06:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.20, 9.50, 9.11 [01:07:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.05, 3.62, 3.93 [01:08:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.37, 3.60, 3.65 [01:10:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.67, 4.68, 4.04 [01:10:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.74, 10.68, 9.92 [01:12:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.79, 12.04, 10.53 [01:13:15] RECOVERY - mem141 Puppet on mem141 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [01:14:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.21, 3.35, 3.64 [01:14:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.27, 10.46, 10.13 [01:16:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.85, 4.58, 4.07 [01:16:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.71, 9.94, 9.96 [01:19:47] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.71, 2.68, 3.26 [01:20:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.48, 3.98, 3.93 [01:26:07] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [01:30:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.44, 3.96, 3.80 [01:32:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.74, 3.09, 3.50 [01:32:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.90, 6.65, 5.98 [01:35:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.73, 11.42, 10.31 [01:36:32] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.11, 4.05, 3.35 [01:36:40] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.70, 6.67, 6.15 [01:37:27] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.09, 12.07, 10.66 [01:38:10] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.59, 5.71, 3.73 [01:38:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.68, 3.42, 3.20 [01:38:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.50, 3.01, 3.35 [01:39:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.87, 11.46, 10.60 [01:41:15] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.23, 13.12, 11.29 [01:42:03] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.56, 6.37, 4.59 [01:42:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.61, 3.21, 3.18 [01:43:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.71, 10.06, 9.16 [01:44:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.29, 4.60, 3.83 [01:45:36] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.75, 10.13, 9.31 [01:49:33] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.72, 7.80, 6.74 [01:50:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.35, 3.57, 3.22 [01:50:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.65, 3.16, 3.50 [01:50:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.08, 12.00, 11.68 [01:51:33] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.54, 6.76, 6.48 [01:52:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.93, 2.68, 3.27 [01:54:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.44, 3.26, 3.19 [01:54:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.26, 11.58, 11.53 [01:56:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.51, 10.83, 11.28 [02:10:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.36, 11.74, 11.30 [02:11:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.44, 11.14, 9.95 [02:11:55] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:13:09] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.98, 10.72, 9.92 [02:13:58] RECOVERY - cp33 APT on cp33 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [02:17:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.93, 10.11, 9.86 [02:18:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.46, 11.89, 11.67 [02:20:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.85, 6.88, 6.20 [02:21:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.45, 10.52, 10.06 [02:22:54] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.30, 5.84, 5.90 [02:23:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.23, 9.58, 9.76 [02:26:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.18, 10.50, 10.89 [02:27:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.13, 5.00, 3.61 [02:28:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.33, 9.79, 10.60 [02:29:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.36, 3.88, 3.36 [02:31:53] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.83, 3.24, 3.19 [02:34:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.71, 9.20, 10.06 [02:35:54] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.35, 4.49, 3.43 [02:41:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.39, 3.99, 3.70 [02:42:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.50, 10.99, 10.38 [02:44:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.26, 11.07, 10.49 [02:48:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.04, 9.75, 10.09 [02:49:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.25, 3.63, 3.58 [02:51:30] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.79, 3.50, 3.55 [02:51:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.51, 3.45, 3.13 [02:52:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.20, 10.59, 10.38 [02:53:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.22, 3.38, 3.15 [02:55:24] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.58, 2.94, 3.36 [02:56:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.84, 9.23, 9.96 [03:03:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.32, 4.13, 3.44 [03:05:59] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.04, 3.51, 3.31 [03:07:48] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.39, 2.82, 3.08 [03:13:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.37, 10.15, 9.70 [03:17:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.39, 10.02, 9.78 [03:25:38] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.51, 4.50, 3.44 [03:27:41] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.27, 3.98, 3.39 [03:29:43] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.37, 4.39, 3.57 [03:31:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.44, 3.60, 3.38 [03:32:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2321224809 secs [03:33:28] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.14, 3.05, 3.20 [03:34:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.15, 4.07, 3.23 [03:42:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.47, 11.59, 10.20 [03:42:36] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.80, 3.56, 3.47 [03:43:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.39, 10.32, 9.90 [03:46:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.17, 3.11, 3.32 [03:47:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.08, 3.72, 3.28 [03:48:34] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.02347260714 secs [03:48:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.43, 10.83, 9.77 [03:49:09] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.22, 3.26, 3.18 [03:50:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.02, 11.04, 9.99 [03:56:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.70, 9.87, 9.85 [04:00:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.40, 10.24, 10.06 [04:01:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.65, 9.61, 10.08 [04:02:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.90, 9.43, 9.78 [04:12:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.44, 11.58, 10.33 [04:14:27] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.62, 11.18, 10.40 [04:16:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.93, 11.04, 10.54 [04:18:26] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.64, 10.14, 10.14 [04:20:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.25, 11.66, 10.89 [04:22:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.80, 10.31, 10.50 [04:24:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.68, 9.28, 10.11 [04:27:48] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [04:33:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.30, 3.53, 2.75 [04:35:18] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.27, 3.07, 2.68 [04:37:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.52, 3.72, 3.08 [04:38:18] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.25, 11.07, 9.88 [04:39:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.05, 3.03, 2.90 [04:40:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.08, 9.98, 9.64 [04:40:43] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f4fc5369aca8...7db95141a297 [04:40:46] [02miraheze/mw-config] 07AgentIsai 037db9514 - (1) beta.bh.o -> meta.bh.o (2) Change target URL of global spam/title blacklist [04:41:51] miraheze/mw-config - AgentIsai the build passed. [04:43:27] !log [agent@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [04:43:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:43:35] !log [agent@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [04:43:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:57:07] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [04:57:14] !log [@test131] starting deploy of {'config': True} to all [04:57:15] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [04:57:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:57:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:00:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.80, 10.52, 9.66 [05:02:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.97, 9.88, 9.53 [05:24:07] !log [agent@mwtask141] sudo -u www-data php ../maintenance/reassignEdits.php Julian JulianM --wiki rosettacodewiki [05:24:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:24:15] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/assignImportedEdits.php --from Csb6 --to Csb6 --wiki rosettacodewiki --import-prefix=rosettacode [05:24:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:27] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:27:17] !log [agent@mwtask141] sudo -u www-data php setContainersAccess.php --wiki 30xxwiki [05:27:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:34:07] !log [agent@mwtask141] sudo -u www-data php setContainersAccess.php --wiki pauldebouvierwiki [05:34:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:35:59] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.45, 10.18, 9.18 [05:39:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.18, 9.93, 9.27 [05:41:23] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.72, 3.13, 2.45 [05:42:23] PROBLEM - puppet141 Puppet on puppet141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[postgresql-contrib-13] [05:43:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.16, 10.66, 10.11 [05:45:23] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.03, 3.30, 2.70 [05:47:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.57, 8.95, 9.57 [05:53:23] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 8.59, 5.81, 3.95 [06:02:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.48, 4.24, 2.57 [06:04:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.44, 3.50, 2.50 [06:06:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.21, 4.20, 2.91 [06:08:31] RECOVERY - puppet141 Puppet on puppet141 is OK: OK: Puppet is currently enabled, last run 11 seconds ago with 0 failures [06:08:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.69, 3.50, 2.80 [06:10:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.23, 3.12, 2.75 [06:18:23] PROBLEM - db131 Backups SQL on db131 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864221 seconds old and 1753 bytes [06:21:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.19, 10.58, 9.62 [06:21:44] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1509491503 secs [06:23:43] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.62, 9.04, 9.17 [06:25:05] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [06:27:23] PROBLEM - wikipwaadia.works - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikipwaadia.works' expires in 15 day(s) (Sun 14 May 2023 06:02:02 GMT +0000). [06:29:47] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c734d8c25464...d0ae7aaf751c [06:29:49] [02miraheze/ssl] 07MirahezeSSLBot 03d0ae7aa - Bot: Update SSL cert for wikipwaadia.works [06:39:44] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.05672824383 secs [06:40:03] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.27, 5.20, 2.86 [06:42:03] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.57, 6.11, 3.49 [06:44:03] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.62, 4.94, 3.39 [06:47:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.59, 10.00, 9.39 [06:51:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.12, 10.00, 9.55 [06:57:44] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1287053525 secs [07:05:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.02, 6.33, 5.56 [07:07:20] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.74, 5.87, 5.50 [07:11:44] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.09342265129 secs [07:25:39] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:27:10] RECOVERY - wikipwaadia.works - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipwaadia.works' will expire on Thu 27 Jul 2023 05:29:36 GMT +0000. [07:32:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.76, 10.05, 9.41 [07:34:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.76, 9.75, 9.36 [07:42:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.59, 10.41, 9.71 [07:44:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.86, 9.53, 9.47 [07:50:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.88, 10.26, 9.91 [07:52:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.98, 10.47, 9.89 [07:54:11] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.41, 9.57, 9.62 [07:54:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.25, 11.00, 10.29 [07:54:58] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [07:55:23] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 0.78, 1.44, 4.00 [07:56:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.63, 10.87, 10.33 [07:59:23] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 0.70, 1.05, 3.25 [08:00:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.06, 10.17, 10.20 [08:02:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1296951771 secs [08:10:34] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07587864995 secs [08:12:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.62, 10.02, 9.79 [08:16:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.91, 9.88, 9.83 [08:20:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.88, 11.66, 10.50 [08:22:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.08, 11.20, 10.47 [08:24:44] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [08:26:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.44, 9.37, 9.92 [08:53:28] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [08:56:30] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:12:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.01, 10.28, 9.43 [09:14:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.33, 9.64, 9.32 [09:20:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.46, 10.15, 9.60 [09:24:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.45, 9.19, 9.37 [09:25:49] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [09:30:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.62, 9.93, 9.56 [09:34:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.56, 9.79, 8.72 [09:34:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.24, 9.68, 9.60 [09:36:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.63, 9.74, 8.84 [09:55:09] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [09:57:28] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1438307762 secs [10:09:28] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.07520011067 secs [10:10:04] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.58, 5.77, 2.99 [10:14:03] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.34, 5.13, 3.47 [10:19:26] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.93, 10.44, 9.78 [10:21:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.48, 11.15, 10.09 [10:23:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.60, 10.63, 10.03 [10:27:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.70, 9.84, 9.87 [10:42:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.11, 10.64, 9.96 [10:44:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.33, 10.41, 9.95 [10:50:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.80, 11.39, 10.52 [10:54:07] [02TSPortal] 07redbluegreenhat closed pull request 03#10: T10167: Add the ability to copy to clipboard elements - 13https://github.com/miraheze/TSPortal/pull/10 [10:54:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.19, 11.79, 10.92 [11:06:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.29, 9.30, 10.12 [11:10:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.85, 10.69, 10.47 [11:12:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.16, 12.22, 11.03 [11:14:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.49, 11.39, 10.90 [11:20:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.69, 9.00, 9.98 [11:32:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.78, 10.08, 9.87 [11:35:33] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.60, 10.39, 9.63 [11:37:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.86, 10.17, 9.65 [11:38:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.02, 10.95, 10.29 [11:41:30] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.57, 10.74, 9.96 [11:43:30] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.41, 11.14, 10.19 [11:45:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.57, 10.83, 10.19 [11:49:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.00, 11.18, 10.45 [11:50:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.50, 11.69, 11.51 [11:51:27] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.82, 10.56, 10.31 [11:53:27] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.81, 9.69, 10.03 [11:54:03] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.13, 5.35, 3.09 [11:56:03] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.12, 3.96, 2.85 [11:56:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1433053613 secs [12:02:23] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.47, 10.90, 10.30 [12:08:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.61, 11.25, 10.73 [12:08:34] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.097789675 secs [12:10:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.51, 11.08, 10.91 [12:14:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.05, 11.55, 10.84 [12:39:40] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [12:43:40] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [12:55:21] PROBLEM - wiki.bloxotel.tk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.bloxotel.tk' expires in 15 day(s) (Sun 14 May 2023 12:47:07 GMT +0000). [13:00:46] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d0ae7aaf751c...a3a2463e6ccb [13:00:48] [02miraheze/ssl] 07MirahezeSSLBot 03a3a2463 - Bot: Update SSL cert for wiki.bloxotel.tk [13:25:19] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [13:48:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.08, 6.95, 6.56 [13:48:59] PROBLEM - wiki-tintin.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki-tintin.cf could not be found [13:49:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.12, 7.43, 6.76 [13:51:56] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.29, 7.13, 6.71 [13:54:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [13:54:39] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:54:44] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [13:55:11] RECOVERY - wiki.bloxotel.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.bloxotel.tk' will expire on Thu 27 Jul 2023 12:00:38 GMT +0000. [13:55:51] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.68, 6.66, 6.64 [14:00:41] [02miraheze/ImportDump] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.25.0 [+0/-0/±2] 13https://github.com/miraheze/ImportDump/commit/b25b41f9c87e [14:00:44] [02miraheze/ImportDump] 07dependabot[bot] 03b25b41f - Bump eslint-config-wikimedia from 0.24.0 to 0.25.0 [14:00:45] [02ImportDump] 07dependabot[bot] opened pull request 03#41: Bump eslint-config-wikimedia from 0.24.0 to 0.25.0 - 13https://github.com/miraheze/ImportDump/pull/41 [14:00:48] [02ImportDump] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.25.0 - 13https://github.com/miraheze/ImportDump [14:00:50] [02ImportDump] 07dependabot[bot] labeled pull request 03#41: Bump eslint-config-wikimedia from 0.24.0 to 0.25.0 - 13https://github.com/miraheze/ImportDump/pull/41 [14:00:52] [02ImportDump] 07dependabot[bot] labeled pull request 03#41: Bump eslint-config-wikimedia from 0.24.0 to 0.25.0 - 13https://github.com/miraheze/ImportDump/pull/41 [14:03:04] miraheze/ImportDump - dependabot[bot] the build has errored. [14:04:31] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [14:19:28] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1191794276 secs [14:23:28] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [14:23:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.69, 6.45, 4.05 [14:27:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.30, 3.91, 3.58 [14:29:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.40, 4.11, 3.70 [14:31:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.76, 3.82, 3.64 [14:33:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.66, 6.00, 4.56 [14:36:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1028722227 secs [14:39:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.57, 7.16, 6.59 [14:39:28] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09979641438 secs [14:39:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.42, 3.33, 3.89 [14:40:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.60, 6.79, 6.51 [14:43:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.22, 2.52, 3.40 [14:44:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 14.18, 9.39, 7.49 [14:53:19] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:54:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.55, 4.15, 3.66 [14:58:34] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07713186741 secs [14:58:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.60, 3.42, 3.48 [14:58:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.60, 7.68, 7.89 [15:00:34] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.02, 2.87, 3.26 [15:04:25] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.70, 2.91, 1.58 [15:06:26] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.11, 2.61, 1.63 [15:10:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.50, 6.71, 7.16 [15:12:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.17, 6.03, 6.85 [15:14:40] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.14, 5.70, 6.63 [15:25:32] [02mw-config] 07brandon-wm opened pull request 03#5215: T10773: Add $wgUFAllowedNamespaces - 13https://github.com/miraheze/mw-config/pull/5215 [15:26:34] [02mw-config] 07brandon-wm commented on pull request 03#5215: T10773: Add $wgUFAllowedNamespaces - 13https://github.com/miraheze/mw-config/pull/5215#issuecomment-1527733746 [15:26:35] [02mw-config] 07brandon-wm closed pull request 03#5215: T10773: Add $wgUFAllowedNamespaces - 13https://github.com/miraheze/mw-config/pull/5215 [15:26:36] miraheze/mw-config - brandon-wm the build passed. [15:28:43] [02mw-config] 07brandon-wm opened pull request 03#5216: T10773: Add $wgUFAllowedNamespaces - 13https://github.com/miraheze/mw-config/pull/5216 [15:29:01] [02mw-config] 07redbluegreenhat commented on pull request 03#5215: T10773: Add $wgUFAllowedNamespaces - 13https://github.com/miraheze/mw-config/pull/5215#issuecomment-1527736591 [15:29:49] miraheze/mw-config - brandon-wm the build passed. [15:33:28] [02mw-config] 07brandon-wm synchronize pull request 03#5216: T10773: Add $wgUFAllowedNamespaces - 13https://github.com/miraheze/mw-config/pull/5216 [15:34:18] [02mw-config] 07brandon-wm commented on pull request 03#5215: T10773: Add $wgUFAllowedNamespaces - 13https://github.com/miraheze/mw-config/pull/5215#issuecomment-1527742680 [15:34:22] miraheze/mw-config - brandon-wm the build has errored. [15:36:16] [02mw-config] 07brandon-wm synchronize pull request 03#5216: T10773: Add $wgUFAllowedNamespaces - 13https://github.com/miraheze/mw-config/pull/5216 [15:37:12] miraheze/mw-config - brandon-wm the build passed. [15:42:34] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1020261347 secs [15:43:31] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.51, 7.11, 6.33 [15:45:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.47, 6.43, 6.17 [15:55:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.92, 6.52, 6.30 [15:55:19] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:57:14] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.65, 5.88, 6.10 [15:58:34] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09885403514 secs [16:03:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.30, 6.68, 6.34 [16:05:03] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.26, 7.49, 6.65 [16:07:01] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.66, 6.61, 6.43 [16:10:54] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.52, 6.86, 6.58 [16:13:08] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.49, 3.38, 2.82 [16:14:50] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.79, 6.18, 6.40 [16:15:06] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.35, 3.33, 2.85 [16:17:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.43, 2.88, 2.74 [16:20:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [16:24:38] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [16:25:04] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/MirahezeMagic/maintenance/assignImportedEdits.php --from Mercerenies --to Mercerenies --wiki rosettacodewiki --import-prefix=rosettacode [16:25:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:26:34] [02mw-config] 07redbluegreenhat closed pull request 03#5204: Remove IPInfo extension T10754 - 13https://github.com/miraheze/mw-config/pull/5204 [16:30:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.78, 7.65, 6.78 [16:32:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.05, 7.72, 6.93 [16:38:40] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.85, 6.40, 6.59 [16:40:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [16:42:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.47, 7.79, 7.35 [16:46:40] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.29, 6.08, 6.76 [16:50:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.09, 8.27, 7.51 [16:52:40] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.94, 7.30, 7.24 [16:53:58] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [16:54:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.59, 3.50, 2.94 [16:58:05] [02miraheze/MatomoAnalytics] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.25.0 [+0/-0/±2] 13https://github.com/miraheze/MatomoAnalytics/commit/522077eb2219 [16:58:08] [02miraheze/MatomoAnalytics] 07dependabot[bot] 03522077e - Bump eslint-config-wikimedia from 0.24.0 to 0.25.0 [16:58:10] [02MatomoAnalytics] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.25.0 - 13https://github.com/miraheze/MatomoAnalytics [16:58:11] [02MatomoAnalytics] 07dependabot[bot] opened pull request 03#99: Bump eslint-config-wikimedia from 0.24.0 to 0.25.0 - 13https://github.com/miraheze/MatomoAnalytics/pull/99 [16:58:14]