[00:02:28] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.56, 3.58, 2.67 [00:02:32] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:03:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.83, 3.48, 3.38 [00:03:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.94, 3.78, 3.31 [00:03:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.00, 3.38, 3.46 [00:04:25] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.86, 2.68, 2.45 [00:04:45] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.50, 3.26, 2.02 [00:05:18] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.27, 3.36, 3.35 [00:05:25] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.69, 3.16, 3.36 [00:05:28] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [00:06:46] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.80, 2.83, 2.00 [00:09:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.76, 3.83, 3.68 [00:09:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.41, 4.45, 3.89 [00:10:06] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.85, 3.62, 3.33 [00:10:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.32, 3.73, 3.93 [00:11:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.84, 2.81, 3.33 [00:11:21] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:12:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.58, 4.01, 3.49 [00:12:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.55, 4.31, 4.11 [00:12:45] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 10.15, 7.79, 4.25 [00:13:59] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.10, 3.69, 3.44 [00:14:16] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [00:14:17] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 9.98, 7.58, 4.30 [00:15:56] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.14, 3.80, 3.50 [00:17:14] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:18:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.45, 3.72, 4.00 [00:19:42] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.31, 3.42, 3.30 [00:20:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.01, 3.88, 4.02 [00:20:45] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.35, 3.08, 3.63 [00:21:46] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.46, 3.94, 3.70 [00:22:08] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.13, 3.62, 3.93 [00:22:35] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.51, 3.57, 3.87 [00:22:45] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.38, 2.19, 3.24 [00:22:55] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [00:23:31] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.49, 3.17, 3.23 [00:25:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.08, 3.75, 3.94 [00:26:04] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.24, 2.19, 3.26 [00:26:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.69, 4.63, 4.19 [00:28:48] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:32:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.92, 3.63, 3.98 [00:33:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.18, 3.67, 3.54 [00:35:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.28, 3.84, 3.81 [00:35:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.42, 3.72, 3.59 [00:36:07] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.21, 3.99, 3.52 [00:37:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.40, 3.85, 3.84 [00:37:40] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [00:38:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.67, 3.47, 3.38 [00:38:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.48, 3.24, 3.62 [00:39:55] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.29, 3.15, 3.28 [00:40:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.41, 2.94, 3.47 [00:41:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.83, 4.06, 3.85 [00:42:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.52, 9.96, 8.82 [00:42:34] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.76, 2.83, 3.36 [00:43:33] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:44:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.63, 9.12, 8.65 [00:45:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.41, 3.82, 3.62 [00:49:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.65, 3.56, 3.80 [00:49:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.37, 3.59, 3.56 [00:55:21] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [00:55:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.43, 3.69, 3.76 [00:55:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.02, 3.56, 3.53 [00:58:19] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:59:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.70, 3.88, 3.68 [01:03:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.97, 3.81, 3.91 [01:04:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.57, 3.56, 2.94 [01:05:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.94, 4.99, 4.36 [01:06:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.35, 3.12, 2.86 [01:06:55] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [01:09:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.13, 3.63, 3.96 [01:09:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.25, 3.07, 3.38 [01:10:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.16, 3.62, 3.09 [01:13:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.95, 3.83, 3.93 [01:14:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.19, 3.20, 3.07 [01:15:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.72, 3.48, 3.80 [01:19:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.15, 3.27, 3.59 [01:20:27] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.94, 3.45, 3.14 [01:21:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.18, 3.41, 2.97 [01:21:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.02, 3.10, 3.48 [01:21:42] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:22:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.79, 3.38, 3.16 [01:23:18] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.72, 2.83, 2.81 [01:23:24] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.85, 3.00, 3.40 [01:24:37] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [01:25:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.97, 3.59, 3.31 [01:26:05] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.19, 3.38, 2.79 [01:27:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.15, 3.35, 3.25 [01:27:35] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:29:46] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.98, 4.55, 2.58 [01:30:01] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.29, 3.45, 3.00 [01:30:12] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.84, 4.24, 3.77 [01:30:13] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [01:31:44] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.62, 3.88, 2.57 [01:31:59] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.02, 2.55, 2.72 [01:32:06] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.14, 3.69, 3.62 [01:33:42] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.89, 2.86, 2.36 [01:34:00] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.47, 4.08, 3.75 [01:35:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.32, 3.59, 3.23 [01:35:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.24, 3.45, 3.35 [01:35:54] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.93, 3.69, 3.66 [01:36:06] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:36:30] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.61, 3.64, 3.23 [01:37:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.11, 3.94, 3.38 [01:37:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.03, 3.66, 3.44 [01:39:18] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.37, 3.33, 3.23 [01:39:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.69, 3.29, 3.33 [01:40:31] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.54, 3.08, 3.14 [01:41:50] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [01:45:24] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.28, 2.85, 3.30 [01:46:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.48, 3.41, 3.15 [01:47:25] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.21, 3.32, 2.56 [01:47:29] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:48:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.37, 3.39, 3.19 [01:49:22] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 3.09, 3.37, 2.68 [01:52:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.59, 3.15, 3.16 [01:54:22] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.86, 2.67, 2.99 [01:55:35] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.42, 2.94, 2.62 [01:56:07] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [01:57:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.99, 5.15, 3.44 [01:58:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.46, 3.49, 3.21 [01:59:05] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:00:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.53, 3.02, 3.06 [02:01:41] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [02:03:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.47, 3.51, 3.36 [02:04:08] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.29, 3.53, 3.20 [02:05:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.08, 3.09, 3.22 [02:06:05] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.67, 3.31, 3.16 [02:06:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.95, 4.75, 3.74 [02:08:06] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.46, 4.03, 3.38 [02:10:00] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.27, 3.71, 3.34 [02:10:29] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:11:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.60, 3.12, 3.14 [02:15:42] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.01, 3.22, 3.26 [02:16:19] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [02:17:16] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.55, 3.25, 3.25 [02:19:17] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:20:44] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.35, 4.03, 3.46 [02:22:14] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [02:22:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.85, 2.88, 3.77 [02:22:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.45, 3.42, 3.30 [02:24:37] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.83, 2.96, 3.15 [02:24:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.68, 3.37, 3.82 [02:25:12] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:28:03] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.77, 3.78, 3.32 [02:30:01] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.67, 2.85, 3.03 [02:30:46] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.14, 2.90, 2.18 [02:32:27] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.41, 3.30, 3.14 [02:32:39] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.98, 3.27, 3.86 [02:32:46] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.55, 3.08, 2.34 [02:33:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.37, 3.39, 2.92 [02:34:41] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.95, 5.49, 4.08 [02:34:46] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.61, 2.95, 2.38 [02:36:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.99, 9.97, 8.46 [02:36:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.08, 4.40, 4.15 [02:36:50] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [02:37:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.41, 3.78, 3.23 [02:38:19] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.81, 9.22, 8.37 [02:41:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.23, 10.98, 9.19 [02:42:45] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:43:05] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.41, 9.53, 8.86 [02:43:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.18, 4.12, 3.53 [02:44:07] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.50, 3.68, 3.59 [02:45:32] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [02:46:04] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.79, 5.04, 4.11 [02:48:30] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:50:43] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.28, 3.11, 3.94 [02:51:26] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [02:53:50] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.24, 3.82, 3.86 [02:54:24] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:54:44] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 11.35, 5.46, 4.56 [02:55:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.10, 3.88, 3.92 [02:57:07] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [02:57:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.13, 3.82, 3.88 [02:57:27] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.50, 3.40, 3.94 [02:59:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.34, 3.69, 3.98 [02:59:42] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.35, 3.76, 3.80 [03:00:06] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:03:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.42, 3.18, 2.71 [03:04:45] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.36, 3.04, 3.75 [03:05:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.64, 2.62, 2.56 [03:06:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.20, 4.00, 4.00 [03:08:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.94, 3.23, 3.73 [03:10:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.43, 4.71, 4.24 [03:11:53] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [03:12:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.79, 3.55, 3.86 [03:14:52] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:16:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.65, 2.43, 3.31 [03:17:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 2.70, 4.26, 3.31 [03:17:37] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [03:20:35] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:21:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.05, 3.38, 3.18 [03:23:16] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [03:25:03] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.63, 4.26, 3.62 [03:25:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.64, 3.65, 3.63 [03:26:15] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:27:01] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.42, 3.71, 3.50 [03:27:47] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.93, 2.67, 3.27 [03:28:59] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.70, 4.63, 3.84 [03:29:04] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.98, 4.13, 2.33 [03:30:57] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.35, 3.80, 3.64 [03:31:58] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [03:32:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.57, 2.99, 3.36 [03:34:57] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:37:52] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [03:39:04] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.72, 3.50, 3.48 [03:41:04] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.46, 2.43, 3.09 [03:41:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.14, 2.71, 3.79 [03:46:16] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:47:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.19, 3.59, 3.74 [03:49:07] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [03:53:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.02, 3.63, 3.84 [03:55:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.21, 3.53, 3.76 [03:57:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 1.39, 2.76, 3.45 [03:57:35] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [04:00:26] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [04:01:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.30, 3.59, 3.61 [04:03:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.08, 3.38, 3.53 [04:04:37] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1919004619 secs [04:05:52] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.88, 5.06, 3.53 [04:09:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.93, 4.02, 3.72 [04:11:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.00, 3.79, 3.69 [04:11:53] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [04:12:38] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.049541682 secs [04:13:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.18, 3.91, 3.74 [04:14:03] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1165017486 secs [04:15:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.96, 3.53, 3.62 [04:15:55] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.65, 3.71, 3.89 [04:16:03] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.08779495955 secs [04:17:32] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [04:19:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.38, 3.35, 3.96 [04:19:56] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.74, 2.41, 3.29 [04:21:18] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.55, 2.66, 3.26 [04:23:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.23, 3.55, 3.89 [04:25:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.26, 4.83, 3.34 [04:25:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.37, 3.57, 3.86 [04:29:00] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [04:29:22] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.89, 3.83, 3.23 [04:29:25] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.37, 3.48, 4.00 [04:31:12] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [04:31:20] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.71, 3.27, 3.09 [04:32:15] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 15.46, 8.34, 3.89 [04:33:22] PROBLEM - gluster122 NTP time on gluster122 is CRITICAL: NTP CRITICAL: Offset 2.699336052 secs [04:34:03] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1450983882 secs [04:35:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.03, 3.13, 3.44 [04:37:24] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.28, 2.55, 3.30 [04:37:34] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.87, 2.94, 3.33 [04:39:59] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.78, 3.82, 3.32 [04:41:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.38, 3.50, 3.56 [04:42:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 2.97, 3.08 [04:43:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.42, 4.03, 3.73 [04:47:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.86, 3.65, 3.67 [04:48:43] !log disabled a user on Phabricator [04:48:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:50:03] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.07597970963 secs [04:53:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.36, 3.63, 3.60 [04:53:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 7.04, 4.22, 3.52 [04:55:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.72, 3.03, 2.69 [04:55:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.23, 3.61, 3.37 [04:56:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.10, 4.87, 3.70 [04:56:17] RECOVERY - gluster122 NTP time on gluster122 is OK: NTP OK: Offset -0.0008354783058 secs [04:57:18] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.77, 2.87, 2.67 [04:57:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.75, 3.30, 3.29 [04:58:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.11, 3.61, 3.38 [04:59:07] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.73, 2.25, 1.48 [04:59:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.00, 3.36, 3.58 [05:00:02] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.69, 3.06, 3.18 [05:01:05] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.25, 2.21, 1.56 [05:01:24] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.05, 2.84, 3.35 [05:07:03] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.47, 5.05, 4.00 [05:12:29] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.73, 3.81, 3.37 [05:15:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.97, 3.79, 3.45 [05:18:19] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.45, 3.91, 3.60 [05:19:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.19, 3.88, 3.53 [05:20:03] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset -0.1120264828 secs [05:21:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.27, 3.55, 3.45 [05:22:12] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.40, 3.28, 3.38 [05:24:04] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.09563454986 secs [05:25:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.04, 3.06, 3.83 [05:25:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.60, 2.99, 2.50 [05:27:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.40, 2.44, 2.36 [05:31:23] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.41, 2.14, 3.20 [05:31:24] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.76, 2.89, 3.27 [05:36:38] PROBLEM - programming.red - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - programming.red All nameservers failed to answer the query. [05:37:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 15.88, 7.97, 5.12 [05:38:15] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.25, 2.51, 3.66 [05:38:46] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.96, 2.72, 2.01 [05:40:46] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.10, 2.08, 1.87 [05:42:15] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.20, 2.35, 3.32 [05:45:15] PROBLEM - www.programming.red - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.programming.red All nameservers failed to answer the query. [05:45:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.40, 3.55, 3.46 [05:47:24] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.51, 3.30, 3.39 [05:51:31] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.23, 2.47, 3.98 [05:55:31] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.18, 1.74, 3.33 [05:57:52] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.44, 3.31, 2.63 [05:59:50] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.24, 3.13, 2.65 [06:06:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.75, 4.02, 3.57 [06:08:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.97, 3.99, 3.62 [06:09:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.29, 3.74, 3.39 [06:11:53] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.62, 3.40, 3.30 [06:12:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.52, 2.94, 3.30 [06:15:41] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.26, 3.48, 3.36 [06:17:12] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.61, 3.67, 3.24 [06:17:34] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.93, 3.27, 3.30 [06:19:09] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.08, 3.61, 3.29 [06:21:06] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.80, 3.33, 3.22 [06:21:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.03, 3.63, 3.48 [06:22:35] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.06, 3.23, 3.08 [06:23:24] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.64, 3.28, 3.36 [06:24:22] [02mw-config] 07Reception123 closed pull request 03#4980: T9938: set set wgMFCollapseSectionsByDefault to false on twistwoodtaleswiki - 13https://github.com/miraheze/mw-config/pull/4980 [06:24:22] [url] Page not found · GitHub · GitHub | github.com [06:24:22] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/48ddd4b63c04...108a559468d3 [06:24:24] [url] Comparing 48ddd4b63c04...108a559468d3 · miraheze/mw-config · GitHub | github.com [06:24:25] [02miraheze/mw-config] 07ugochimobi 03108a559 - T9938: set set wgMFCollapseSectionsByDefault to false on twistwoodtaleswiki (#4980) [06:24:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.00, 2.72, 2.91 [06:25:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.32, 3.43, 3.29 [06:25:25] miraheze/mw-config - Reception123 the build passed. [06:26:58] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.89, 3.21, 3.22 [06:27:09] !log [@test131] starting deploy of {'config': True} to all [06:27:10] !log [@test131] DEPLOY ABORTED: Canary check failed for beta.betaheze.org@localhost [06:27:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:27:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:27:59] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 30.37, 14.72, 6.56 [06:28:04] PROBLEM - www.programming.red - LetsEncrypt on sslhost is CRITICAL: connect to address www.programming.red and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [06:28:08] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 109.228.51.216/cpweb, 2a00:da00:1800:328::1/cpweb [06:28:19] PROBLEM - cp23 PowerDNS Recursor on cp23 is CRITICAL: CRITICAL - Plugin timed out while executing system call [06:28:35] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.65, 3.54, 3.36 [06:29:20] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.02, 7.12, 3.92 [06:30:08] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:30:36] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.24, 4.59, 3.73 [06:30:41] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[MediaWiki Config Sync] [06:31:04] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=littlebigplanetwiki --no-updates --username-prefix=wikia:littlebigplanet /home/reception/ImportDump/littlebigplanetwiki-20221109171702.xml (START) [06:31:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:32:29] RECOVERY - cp23 PowerDNS Recursor on cp23 is OK: DNS OK: 0.254 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [06:32:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.92, 4.00, 3.52 [06:33:13] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.07, 3.81, 3.27 [06:33:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.58, 3.66, 3.36 [06:34:47] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.04, 3.56, 3.41 [06:35:10] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.82, 3.09, 3.07 [06:35:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.70, 4.02, 3.50 [06:36:17] PROBLEM - programming.red - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for programming.red could not be found [06:36:44] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.50, 3.29, 3.34 [06:37:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.48, 3.42, 3.35 [06:39:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.22, 3.64, 3.43 [06:40:28] !log [@mwtask141] starting deploy of {'config': True} to all [06:40:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:40:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.51, 3.78, 3.99 [06:40:37] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 9s [06:40:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:41:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.06, 3.56, 3.44 [06:43:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.14, 3.73, 3.51 [06:44:11] PROBLEM - programming.red - LetsEncrypt on sslhost is CRITICAL: connect to address programming.red and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [06:44:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.56, 2.06, 3.22 [06:45:15] PROBLEM - www.programming.red - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.programming.red could not be found [06:45:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.57, 3.71, 3.53 [06:45:39] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.93, 1.75, 3.68 [06:46:30] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.75, 3.97, 3.54 [06:47:24] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.07, 3.13, 3.34 [06:48:27] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.94, 3.56, 3.44 [06:49:35] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.04, 1.72, 3.21 [06:50:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.79, 3.22, 3.33 [06:50:40] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.61, 3.95, 3.59 [06:52:40] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.91, 3.27, 3.40 [06:56:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.64, 3.69, 3.49 [06:58:13] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.88, 3.33, 3.38 [06:58:40] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures [06:59:24] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.23, 3.48, 3.22 [07:00:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 2.55, 4.19, 3.82 [07:01:22] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.12, 2.56, 2.91 [07:02:08] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.24, 3.88, 3.60 [07:02:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.63, 3.58, 3.63 [07:05:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.03, 4.97, 3.86 [07:05:48] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 10.75, 4.95, 3.28 [07:06:42] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.72, 4.92, 4.15 [07:07:42] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.12, 3.93, 3.09 [07:09:11] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1031332314 secs [07:11:30] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.91, 2.92, 2.86 [07:11:36] RECOVERY - wiki.auraxis.co - reverse DNS on sslhost is OK: SSL OK - wiki.auraxis.co reverse DNS resolves to cp23.miraheze.org - CNAME OK [07:13:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.03, 4.00, 3.94 [07:16:45] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.99, 2.99, 3.82 [07:19:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.06, 3.54, 3.92 [07:20:45] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.32, 3.18, 3.64 [07:22:45] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.68, 3.31, 3.63 [07:24:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.82, 2.79, 3.40 [07:27:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.77, 3.63, 3.64 [07:27:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.93, 2.57, 3.36 [07:28:47] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.12, 5.22, 4.22 [07:29:11] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09978759289 secs [07:31:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.91, 3.64, 3.73 [07:39:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.77, 3.59, 3.76 [07:39:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.91, 3.08, 3.38 [07:42:48] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.42, 3.36, 3.99 [07:46:38] [02landing] 07Universal-Omega closed pull request 03#98: Use "Miraheze Donate" for headline on donate page - 13https://github.com/miraheze/landing/pull/98 [07:46:38] [url] Page not found · GitHub · GitHub | github.com [07:46:41] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/b90a20f05780...92163f6c1ecb [07:46:41] [url] Comparing b90a20f05780...92163f6c1ecb · miraheze/landing · GitHub | github.com [07:46:44] [02miraheze/landing] 07Universal-Omega 0392163f6 - Use "Miraheze Donate" for headline on donate page (#98) [07:46:45] [02miraheze/landing] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [07:46:48] [02landing] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/landing [07:46:48] [url] Page not found · GitHub · GitHub | github.com [07:46:48] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.80, 2.08, 3.32 [07:47:32] miraheze/landing - Universal-Omega the build passed. [07:48:07] [02landing] 07Universal-Omega closed pull request 03#99: Update keywords - 13https://github.com/miraheze/landing/pull/99 [07:48:08] [url] Page not found · GitHub · GitHub | github.com [07:48:10] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/92163f6c1ecb...047ee455a516 [07:48:11] [url] Comparing 92163f6c1ecb...047ee455a516 · miraheze/landing · GitHub | github.com [07:48:12] [02miraheze/landing] 07Universal-Omega 03047ee45 - Update keywords (#99) [07:48:14] [02miraheze/landing] 07Universal-Omega deleted branch 03keywords [07:48:15] [02landing] 07Universal-Omega deleted branch 03keywords - 13https://github.com/miraheze/landing [07:48:16] [url] Page not found · GitHub · GitHub | github.com [07:49:03] miraheze/landing - Universal-Omega the build passed. [07:53:24] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.73, 3.09, 3.36 [08:00:42] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[Landing Sync] [08:06:53] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.60, 3.81, 3.10 [08:08:53] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.47, 3.98, 3.27 [08:10:54] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.12, 3.77, 3.26 [08:12:54] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.07, 3.34, 3.18 [08:14:25] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=littlebigplanetwiki --no-updates --username-prefix=wikia:littlebigplanet /home/reception/ImportDump/littlebigplanetwiki-20221109171702.xml (END - exit=0) [08:14:26] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=littlebigplanetwiki (START) [08:14:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:14:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:16:35] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.92, 2.82, 1.90 [08:17:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.38, 3.70, 3.12 [08:18:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.96, 4.37, 2.61 [08:19:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.59, 3.18, 3.00 [08:20:34] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.34, 3.19, 2.39 [08:24:09] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.46, 3.08, 2.47 [08:28:11] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:29:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.30, 3.42, 2.98 [08:30:29] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 17.06, 8.44, 3.87 [08:31:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.88, 2.59, 2.74 [08:33:53] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.97, 2.64, 2.67 [08:37:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.57, 4.59, 3.52 [08:38:10] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.11, 3.02, 3.02 [08:39:50] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.33, 3.94, 3.43 [08:41:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.03, 2.89, 3.11 [08:55:20] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.90, 2.74, 2.07 [08:57:17] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.22, 2.30, 2.00 [08:57:20] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=littlebigplanetwiki (END - exit=0) [08:57:21] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=littlebigplanetwiki --active --update (END - exit=0) [08:57:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:57:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:59:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.11, 3.57, 3.05 [09:01:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.89, 3.70, 3.16 [09:03:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.54, 4.17, 3.39 [09:03:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.72, 3.91, 3.08 [09:05:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.66, 3.47, 3.22 [09:05:26] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.44, 3.31, 2.96 [09:07:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.56, 3.14, 3.12 [09:27:18] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.54, 5.32, 3.31 [09:40:18] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.05, 3.42, 3.13 [09:42:13] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.62, 3.10, 3.04 [09:58:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.61, 1.93, 3.88 [10:02:11] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 1.42, 3.22 [10:03:42] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.06, 3.96, 3.31 [10:05:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.55, 3.44, 3.20 [10:07:39] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.18, 3.02, 3.08 [10:08:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.36, 4.73, 4.04 [10:11:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.19, 3.74, 3.80 [10:13:54] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.37, 4.20, 3.95 [10:15:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.74, 3.43, 3.14 [10:15:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.36, 3.86, 3.89 [10:17:14] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.16, 3.36, 3.15 [10:19:51] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.49, 2.12, 3.17 [10:29:44] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 7.86, 3.72, 2.11 [10:31:44] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.82, 3.48, 2.24 [10:33:44] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.78, 2.46, 2.01 [10:35:41] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.91, 3.61, 2.86 [10:37:38] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.61, 3.19, 2.80 [10:43:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.40, 3.42, 3.22 [10:45:25] RECOVERY - wiki.slimeapedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimeapedia.org' will expire on Fri 23 Dec 2022 04:36:40 GMT +0000. [10:46:18] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.14, 3.41, 3.09 [10:47:14] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.92, 3.27, 3.22 [10:48:16] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.94, 3.29, 3.08 [10:56:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.02, 3.36, 2.15 [10:58:05] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.69, 2.98, 2.51 [10:58:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.15, 3.52, 2.38 [10:59:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.94, 3.36, 3.13 [11:00:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.97, 4.02, 2.97 [11:00:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.72, 2.51, 2.15 [11:01:14] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.69, 3.15, 3.08 [11:03:54] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.22, 3.39, 2.96 [11:16:20] PROBLEM - wiki.slimeapedia.org - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.slimeapedia.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [11:21:48] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.61, 4.71, 3.55 [11:23:23] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.50, 3.60, 2.80 [11:32:01] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.09, 4.14, 3.25 [11:35:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 1.95, 3.88, 3.85 [11:35:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.41, 3.52, 2.17 [11:39:21] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.68, 2.73, 3.38 [11:39:35] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 1.96, 3.01, 3.87 [11:45:31] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.13, 3.14, 3.56 [11:47:29] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.36, 3.13, 3.50 [11:49:50] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.67, 3.27, 3.52 [11:51:26] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.75, 2.94, 3.35 [11:51:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.67, 2.43, 3.18 [11:55:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.86, 3.53, 3.54 [12:01:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.89, 3.24, 3.98 [12:01:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.44, 3.12, 3.36 [12:02:26] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.nj.cn.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:03:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 3.96, 3.58, 4.02 [12:05:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.24, 3.33, 3.86 [12:05:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.52, 3.49, 3.54 [12:07:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.26, 3.09, 3.38 [12:07:50] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.44, 5.08, 3.37 [12:09:50] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.79, 3.85, 3.12 [12:10:56] [02miraheze/ImportDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/9bea3d9b6150...06133d9676cb [12:10:57] [url] Comparing 9bea3d9b6150...06133d9676cb · miraheze/ImportDump · GitHub | github.com [12:10:59] [02miraheze/ImportDump] 07translatewiki 0306133d9 - Localisation updates from https://translatewiki.net. [12:11:00] [url] Main page - translatewiki.net | translatewiki.net [12:11:02] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/a5197f9459ea...57e4e4c05daf [12:11:03] [url] Comparing a5197f9459ea...57e4e4c05daf · miraheze/CreateWiki · GitHub | github.com [12:11:05] [02miraheze/CreateWiki] 07translatewiki 0357e4e4c - Localisation updates from https://translatewiki.net. [12:11:06] [url] Main page - translatewiki.net | translatewiki.net [12:11:08] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/MirahezeMagic/compare/abdfe4129961...17efa8a185f7 [12:11:09] [url] Comparing abdfe4129961...17efa8a185f7 · miraheze/MirahezeMagic · GitHub | github.com [12:11:10] [02miraheze/MirahezeMagic] 07translatewiki 0317efa8a - Localisation updates from https://translatewiki.net. [12:11:11] [url] Main page - translatewiki.net | translatewiki.net [12:11:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.27, 3.59, 3.76 [12:11:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.08, 2.86, 2.85 [12:13:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.94, 3.62, 3.75 [12:16:19] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.03, 3.52, 3.37 [12:18:17] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.29, 3.01, 3.20 [12:20:25] miraheze/ImportDump - translatewiki the build passed. [12:22:24] miraheze/CreateWiki - translatewiki the build passed. [12:23:14] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.39, 2.63, 3.33 [12:23:46] miraheze/MirahezeMagic - translatewiki the build has errored. [12:26:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.13, 3.07, 1.97 [12:32:16] RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK [12:32:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.03, 3.64, 2.66 [12:34:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.90, 2.63, 2.41 [12:38:00] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.65, 3.22, 3.10 [12:38:01] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.00, 3.60, 3.45 [12:39:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.60, 3.25, 3.33 [12:39:59] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.37, 2.93, 3.01 [12:55:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 3.73, 4.26, 3.71 [12:57:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.12, 3.82, 3.61 [13:00:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.23, 4.05, 3.12 [13:02:47] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.77, 3.30, 2.96 [13:03:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.48, 4.16, 3.76 [13:06:02] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.65, 3.96, 3.14 [13:06:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.68, 3.44, 3.11 [13:06:42] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.80, 3.88, 3.27 [13:07:59] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.61, 4.14, 3.29 [13:08:35] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.57, 3.91, 3.32 [13:10:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.30, 3.71, 3.32 [13:11:52] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.40, 3.41, 3.20 [13:12:31] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.22, 2.67, 3.00 [13:13:49] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.93, 3.31, 3.19 [13:19:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.79, 3.96, 3.97 [13:20:26] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.75, 3.35, 3.38 [13:23:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.94, 3.81, 3.85 [13:24:05] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 3 backends are down. mw132 mw141 mw142 [13:25:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.21, 3.56, 3.76 [13:26:05] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [13:31:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.26, 3.89, 3.79 [13:34:13] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.02, 4.29, 3.72 [13:35:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.75, 3.90, 3.88 [13:36:52] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.27, 3.89, 3.06 [13:40:09] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.22, 3.55, 3.56 [13:44:37] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.95, 3.85, 3.53 [13:46:05] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.95, 3.72, 3.58 [13:46:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.41, 3.08, 3.29 [13:47:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.61, 5.30, 4.24 [13:49:28] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1450027525 secs [13:52:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.79, 4.00, 3.78 [13:53:59] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.14, 4.26, 3.91 [13:57:56] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.94, 3.64, 3.74 [13:59:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.72, 3.56, 3.93 [13:59:44] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.53, 3.65, 2.57 [14:01:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.13, 3.87, 4.00 [14:01:44] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.67, 3.28, 2.56 [14:03:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.05, 2.80, 3.33 [14:06:41] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.49, 3.56, 3.21 [14:07:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.66, 3.86, 3.96 [14:09:28] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.08397778869 secs [14:10:34] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.99, 3.32, 3.19 [14:10:44] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.46, 3.30, 3.37 [14:11:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.75, 3.93, 3.93 [14:13:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.90, 3.82, 3.89 [14:14:54] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.56, 2.39, 1.65 [14:15:56] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 14.56, 12.94, 7.98 [14:16:29] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 23.96, 15.11, 8.87 [14:16:54] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.88, 2.08, 1.62 [14:17:54] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 6.78, 10.54, 7.70 [14:18:26] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 6.85, 4.03, 2.64 [14:19:22] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 7.39, 4.17, 3.51 [14:19:33] PROBLEM - mw131 nutcracker process on mw131 is CRITICAL: PROCS CRITICAL: 0 processes with UID = 115 (nutcracker), command name 'nutcracker' [14:19:52] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 5.12, 8.69, 7.36 [14:20:28] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 5.01, 9.44, 7.97 [14:21:03] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 8191 bytes in 0.248 second response time [14:21:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.58, 5.06, 4.29 [14:22:35] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.68, 4.07, 3.71 [14:24:34] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.38, 3.77, 3.64 [14:26:32] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.39, 3.96, 3.72 [14:27:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.46, 3.82, 3.99 [14:28:31] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.15, 3.85, 3.72 [14:29:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.08, 3.70, 3.91 [14:29:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.92, 3.79, 3.73 [14:29:44] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.63, 2.67, 2.01 [14:31:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.70, 3.78, 3.92 [14:31:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.39, 3.93, 3.77 [14:31:44] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.77, 2.88, 2.18 [14:33:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.26, 3.59, 3.66 [14:35:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.24, 4.12, 3.98 [14:35:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.51, 3.93, 3.77 [14:40:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.48, 3.98, 3.72 [14:41:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.70, 3.83, 3.97 [14:41:33] RECOVERY - mw131 nutcracker process on mw131 is OK: PROCS OK: 1 process with UID = 115 (nutcracker), command name 'nutcracker' [14:42:22] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 4.00, 3.78, 3.67 [14:42:30] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.230 second response time [14:43:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.30, 4.02, 4.01 [14:44:25] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 0.95, 3.06, 3.89 [14:45:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.09, 3.83, 3.96 [14:45:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.31, 3.81, 3.85 [14:48:25] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.90, 2.20, 3.31 [14:49:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.52, 4.02, 3.99 [14:49:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.16, 4.28, 4.00 [14:53:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.62, 3.68, 3.89 [14:53:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 1.94, 3.45, 3.76 [14:54:13] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.60, 2.59, 3.21 [14:57:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.60, 3.88, 3.90 [14:57:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.12, 3.81, 3.82 [14:59:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.69, 3.66, 3.81 [14:59:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.49, 3.33, 3.64 [15:00:08] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 4.00, 3.72, 3.51 [15:02:07] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.51, 3.28, 3.37 [15:05:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.46, 3.75, 3.75 [15:05:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.24, 3.63, 3.62 [15:05:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.48, 4.88, 3.10 [15:06:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 3.94, 4.08, 3.70 [15:07:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.79, 3.45, 3.54 [15:09:22] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.93, 4.40, 3.89 [15:11:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.72, 3.73, 3.81 [15:11:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.36, 3.97, 3.79 [15:11:50] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.95, 3.50, 3.11 [15:11:58] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.77, 3.74, 3.73 [15:13:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.23, 4.15, 3.94 [15:13:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.00, 4.20, 3.89 [15:13:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.98, 2.84, 2.91 [15:15:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.62, 3.51, 3.73 [15:15:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.48, 3.73, 3.74 [15:17:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.17, 3.59, 3.67 [15:19:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.55, 3.26, 3.54 [15:19:52] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.01, 3.48, 3.56 [15:21:50] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.67, 3.20, 3.45 [15:23:14] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.11, 2.97, 3.37 [15:25:21] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.69, 3.05, 3.37 [15:28:25] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.65, 3.01, 2.30 [15:29:44] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.79, 3.09, 3.34 [15:30:20] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.33, 2.44, 2.17 [15:31:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.40, 3.76, 3.52 [15:33:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.24, 4.13, 3.69 [15:34:13] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.66, 4.40, 3.84 [15:35:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.78, 3.55, 3.53 [15:36:09] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.37, 3.98, 3.75 [15:40:02] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.08, 2.89, 3.34 [15:43:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.02, 3.94, 3.68 [15:47:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.03, 3.74, 3.91 [15:47:30] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.85, 3.69, 3.65 [15:47:51] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.14, 4.02, 3.67 [15:49:06] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/047ee455a516...32ed2a792fff [15:49:06] [url] Comparing 047ee455a516...32ed2a792fff · miraheze/landing · GitHub | github.com [15:49:07] [02miraheze/landing] 07Universal-Omega 0332ed2a7 - Remove unnecessary extra tab [15:49:28] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.19, 3.99, 3.77 [15:50:03] miraheze/landing - Universal-Omega the build passed. [15:51:45] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.24, 3.50, 3.58 [15:53:10] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.08, 3.07, 2.19 [15:53:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.05, 4.03, 3.94 [15:55:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.99, 3.80, 3.88 [15:55:24] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.06, 3.83, 3.81 [15:55:38] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.70, 3.06, 3.38 [15:57:03] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.25, 3.43, 2.62 [15:57:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.00, 4.26, 4.07 [15:57:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.33, 4.03, 3.89 [15:59:00] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.41, 3.20, 2.64 [15:59:31] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[Landing Sync] [15:59:33] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.83, 4.45, 3.87 [16:00:14] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.77, 3.91, 2.72 [16:01:30] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.56, 3.98, 3.76 [16:02:09] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.96, 3.74, 2.82 [16:03:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.33, 3.84, 3.91 [16:03:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.28, 4.04, 3.81 [16:04:05] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.97, 2.77, 2.58 [16:05:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.20, 4.02, 3.97 [16:05:23] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.54, 3.90, 3.79 [16:06:43] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.17, 4.80, 3.25 [16:07:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.70, 3.57, 3.81 [16:09:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.11, 3.60, 3.67 [16:09:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.12, 4.21, 4.01 [16:13:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.43, 3.79, 3.76 [16:14:28] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.97, 3.73, 3.51 [16:15:53] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=growevertreewikiwiki --no-updates --username-prefix=wikia:grow-song-of-the-evertree /home/reception/ImportDump/growevertreewikiwiki-20221108064430.xml (START) [16:15:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:18:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.56, 3.10, 3.30 [16:23:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.41, 3.17, 3.94 [16:23:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.47, 3.94, 3.70 [16:24:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.78, 3.79, 3.01 [16:25:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.17, 3.76, 4.04 [16:25:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.92, 3.74, 3.65 [16:25:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.83, 3.63, 3.92 [16:26:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.47, 2.84, 2.75 [16:26:43] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=growevertreewikiwiki --no-updates --username-prefix=wikia:grow-song-of-the-evertree /home/reception/ImportDump/growevertreewikiwiki-20221108064430.xml (END - exit=0) [16:26:44] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=growevertreewikiwiki (START) [16:26:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:26:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:27:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.63, 3.73, 4.00 [16:27:27] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [16:29:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.54, 4.23, 4.14 [16:29:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.24, 3.88, 3.72 [16:29:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.15, 3.85, 3.91 [16:32:52] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=growevertreewikiwiki (END - exit=0) [16:32:53] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=growevertreewikiwiki --active --update (END - exit=0) [16:33:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:33:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:33:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.39, 3.76, 3.71 [16:35:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.93, 4.70, 4.06 [16:35:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.62, 3.84, 3.93 [16:35:50] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.26, 3.91, 3.07 [16:39:50] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.22, 3.97, 3.30 [16:41:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.66, 3.86, 3.88 [16:41:50] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.22, 4.63, 3.63 [16:42:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.71, 9.44, 7.46 [16:43:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.59, 3.95, 3.89 [16:43:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.71, 3.46, 3.31 [16:44:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.89, 9.18, 7.61 [16:45:50] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.15, 3.86, 3.48 [16:47:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.51, 3.60, 3.93 [16:47:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 3.00, 3.21 [16:49:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.39, 3.44, 3.75 [16:49:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.01, 3.37, 3.49 [16:51:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.09, 4.03, 3.90 [16:51:38] !log reception@mw131:~$ sudo service nutcracker restart [16:51:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:53:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.01, 3.68, 3.82 [16:53:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.79, 3.86, 3.86 [16:53:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.63, 3.47, 3.49 [16:54:56] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.19, 3.60, 2.76 [16:55:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.68, 3.40, 3.71 [16:55:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.34, 4.13, 3.94 [16:56:53] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.89, 3.36, 2.78 [16:57:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.12, 3.93, 3.63 [16:59:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.78, 3.46, 3.49 [17:01:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.60, 3.59, 3.82 [17:03:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.52, 3.13, 3.36 [17:04:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.19, 3.73, 3.18 [17:05:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.42, 4.30, 4.03 [17:06:42] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.56, 3.62, 3.23 [17:07:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.29, 3.50, 3.77 [17:07:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.06, 3.66, 3.51 [17:08:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.68, 3.03, 3.07 [17:09:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.74, 3.66, 3.78 [17:09:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.54, 3.68, 3.54 [17:11:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.31, 3.17, 3.37 [17:13:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.99, 3.38, 3.64 [17:17:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.11, 3.41, 3.42 [17:17:44] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.38, 3.59, 2.47 [17:19:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.51, 3.28, 3.04 [17:19:44] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.49, 2.77, 2.31 [17:21:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.48, 3.66, 3.56 [17:21:18] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.01, 2.91, 2.94 [17:21:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.31, 3.90, 3.72 [17:22:37] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/45b41a181759 [17:22:39] [02miraheze/dns] 07paladox 0345b41a1 - Remove swiftobject115 from dns [17:22:40] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [17:22:40] [url] Page not found · GitHub · GitHub | github.com [17:22:43] [02dns] 07paladox opened pull request 03#369: Remove swiftobject115 from dns - 13https://github.com/miraheze/dns/pull/369 [17:22:43] [url] Page not found · GitHub · GitHub | github.com [17:22:46] [02dns] 07paladox closed pull request 03#369: Remove swiftobject115 from dns - 13https://github.com/miraheze/dns/pull/369 [17:22:46] [url] Page not found · GitHub · GitHub | github.com [17:22:48] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [17:22:49] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/7a097d350277...bdb0cb3700db [17:22:49] [url] Comparing 7a097d350277...bdb0cb3700db · miraheze/dns · GitHub | github.com [17:22:52] [02miraheze/dns] 07paladox 03bdb0cb3 - Remove swiftobject115 from dns (#369) [17:22:54] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [17:22:54] [url] Page not found · GitHub · GitHub | github.com [17:23:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.57, 3.71, 3.59 [17:23:21] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.11, 3.67, 3.66 [17:24:57] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/1e199da828ba [17:25:00] [02miraheze/dns] 07paladox 031e199da - Add swiftobject121 to dns [17:25:03] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [17:25:03] [url] Page not found · GitHub · GitHub | github.com [17:25:05] [02dns] 07paladox opened pull request 03#370: Add swiftobject121 to dns - 13https://github.com/miraheze/dns/pull/370 [17:25:05] ... [17:25:16] [02dns] 07paladox closed pull request 03#370: Add swiftobject121 to dns - 13https://github.com/miraheze/dns/pull/370 [17:25:16] ... [17:25:19] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [17:25:21] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/bdb0cb3700db...8244bc123a7a [17:25:21] [url] Comparing bdb0cb3700db...8244bc123a7a · miraheze/dns · GitHub | github.com [17:25:22] [02miraheze/dns] 07paladox 038244bc1 - Add swiftobject121 to dns (#370) [17:25:24] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [17:25:24] [url] Page not found · GitHub · GitHub | github.com [17:29:14] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.05, 2.94, 3.32 [17:29:21] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.30, 2.96, 3.37 [17:29:23] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.16, 3.07, 3.26 [17:36:17] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.03, 3.81, 3.58 [17:38:13] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.33, 3.26, 3.41 [17:40:10] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.88, 3.19, 3.36 [17:48:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.88, 4.19, 3.07 [17:50:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.86, 3.41, 2.91 [17:52:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.11, 2.96, 2.80 [17:57:45] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.04, 3.27, 3.18 [17:59:39] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.17, 3.40, 3.25 [18:00:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.77, 3.53, 3.40 [18:02:02] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.79, 3.31, 3.34 [18:07:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.37, 3.84, 3.46 [18:07:18] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.81, 5.56, 3.75 [18:08:01] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.91, 4.53, 3.83 [18:09:09] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.38, 3.41, 3.36 [18:11:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.42, 3.15, 3.27 [18:11:17] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.55, 3.63, 3.40 [18:13:17] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.21, 2.74, 3.09 [18:13:58] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.93, 3.70, 3.70 [18:21:55] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.83, 2.80, 3.31 [18:29:51] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.59, 3.38, 3.31 [18:31:51] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.33, 2.93, 3.15 [18:34:57] PROBLEM - swiftobject114 Puppet on swiftobject114 is CRITICAL: connect to address 2a10:6740::6:206 port 5666: Connection refusedconnect to host 2a10:6740::6:206 port 5666: Connection refused [18:35:29] PROBLEM - cp33 HTTP 4xx/5xx ERROR Rate on cp33 is CRITICAL: CRITICAL - NGINX Error Rate is 80% [18:35:30] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:35:31] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 28.17, 13.18, 5.59 [18:35:31] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:35:34] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:35:35] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:35:49] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:36:03] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:36:12] PROBLEM - mw142 HTTPS on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:36:12] PROBLEM - mw121 HTTPS on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:36:13] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:36:14] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.80, 4.16, 3.14 [18:36:18] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:36:25] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 217.174.247.33/cpweb, 109.228.51.216/cpweb, 2a00:da00:1800:326::1/cpweb, 2a00:da00:1800:328::1/cpweb, 108.175.15.182/cpweb, 74.208.203.152/cpweb, 2607:f1c0:1800:8100::1/cpweb, 2607:f1c0:1800:26f::1/cpweb [18:36:29] PROBLEM - mw122 HTTPS on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:36:49] PROBLEM - cp32 HTTPS on cp32 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:36:55] PROBLEM - swiftobject114 Puppet on swiftobject114 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 4 days ago with 0 failures [18:36:58] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:37:26] PROBLEM - cp33 HTTP 4xx/5xx ERROR Rate on cp33 is WARNING: WARNING - NGINX Error Rate is 51% [18:37:52] PROBLEM - cloud12 Current Load on cloud12 is CRITICAL: CRITICAL - load average: 71.35, 47.36, 28.42 [18:38:13] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.41, 3.51, 3.04 [18:38:24] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [18:38:25] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [18:38:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.28, 12.44, 9.20 [18:38:49] RECOVERY - cp32 HTTPS on cp32 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3424 bytes in 0.439 second response time [18:38:56] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [18:39:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.65, 10.41, 8.21 [18:39:21] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [18:39:32] PROBLEM - jobchron121 Current Load on jobchron121 is CRITICAL: CRITICAL - load average: 2.02, 1.41, 0.69 [18:39:41] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [18:39:55] PROBLEM - cp23 HTTP 4xx/5xx ERROR Rate on cp23 is WARNING: WARNING - NGINX Error Rate is 41% [18:40:13] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.89, 2.60, 2.76 [18:40:32] PROBLEM - mail121 NTP time on mail121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:40:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.56, 10.86, 9.02 [18:41:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 2.84, 7.43, 7.38 [18:41:12] PROBLEM - cp22 HTTP 4xx/5xx ERROR Rate on cp22 is WARNING: WARNING - NGINX Error Rate is 41% [18:41:14] PROBLEM - cp32 HTTP 4xx/5xx ERROR Rate on cp32 is WARNING: WARNING - NGINX Error Rate is 51% [18:41:21] RECOVERY - cp33 HTTP 4xx/5xx ERROR Rate on cp33 is OK: OK - NGINX Error Rate is 30% [18:41:22] PROBLEM - mail121 SMTP on mail121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:41:25] PROBLEM - mail121 Current Load on mail121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:41:37] PROBLEM - mail121 ferm_active on mail121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:41:44] PROBLEM - mail121 conntrack_table_size on mail121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:41:49] PROBLEM - cp23 HTTP 4xx/5xx ERROR Rate on cp23 is CRITICAL: CRITICAL - NGINX Error Rate is 65% [18:41:59] PROBLEM - mail121 webmail.miraheze.org HTTPS on mail121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:42:04] PROBLEM - mail121 HTTPS on mail121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:42:11] PROBLEM - mail121 Disk Space on mail121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:42:15] PROBLEM - mail121 php-fpm on mail121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:42:23] PROBLEM - mail121 Puppet on mail121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:42:24] PROBLEM - mail121 PowerDNS Recursor on mail121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:42:33] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.54, 9.76, 8.83 [18:43:43] PROBLEM - cp23 HTTP 4xx/5xx ERROR Rate on cp23 is WARNING: WARNING - NGINX Error Rate is 51% [18:44:15] PROBLEM - gluster121 ferm_active on gluster121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:44:35] PROBLEM - gluster121 glusterd Volume on gluster121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:44:47] RECOVERY - mw121 HTTPS on mw121 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 8.635 second response time [18:44:51] RECOVERY - mail121 PowerDNS Recursor on mail121 is OK: DNS OK: 1.100 second response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [18:44:55] RECOVERY - mail121 Puppet on mail121 is OK: OK: Puppet is currently enabled, last run 32 minutes ago with 0 failures [18:45:11] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.227 second response time [18:45:14] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:45:14] PROBLEM - gluster121 conntrack_table_size on gluster121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:45:22] RECOVERY - mail121 SMTP on mail121 is OK: SMTP OK - 0.008 sec. response time [18:45:23] RECOVERY - mail121 NTP time on mail121 is OK: NTP OK: Offset -0.001406848431 secs [18:45:33] RECOVERY - jobchron121 Current Load on jobchron121 is OK: OK - load average: 1.24, 1.64, 1.07 [18:45:58] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.633 second response time [18:46:00] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.288 second response time [18:46:01] RECOVERY - mail121 webmail.miraheze.org HTTPS on mail121 is OK: HTTP OK: HTTP/1.1 200 OK - 6281 bytes in 0.765 second response time [18:46:02] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.343 second response time [18:46:02] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.296 second response time [18:46:05] RECOVERY - mail121 HTTPS on mail121 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.008 second response time [18:46:12] RECOVERY - gluster121 ferm_active on gluster121 is OK: OK ferm input default policy is set [18:46:16] RECOVERY - mw132 HTTPS on mw132 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.008 second response time [18:46:27] RECOVERY - mail121 ferm_active on mail121 is OK: OK ferm input default policy is set [18:46:28] RECOVERY - mw131 HTTPS on mw131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.017 second response time [18:46:33] RECOVERY - mw141 HTTPS on mw141 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.009 second response time [18:46:35] RECOVERY - gluster121 glusterd Volume on gluster121 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfsd' [18:46:37] RECOVERY - mail121 conntrack_table_size on mail121 is OK: OK: nf_conntrack is 0 % full [18:46:46] RECOVERY - mw122 HTTPS on mw122 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.010 second response time [18:46:46] RECOVERY - mw142 HTTPS on mw142 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.009 second response time [18:46:48] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.483 second response time [18:47:08] RECOVERY - mail121 Disk Space on mail121 is OK: DISK OK - free space: / 10793 MB (58% inode=91%); [18:47:08] RECOVERY - mail121 php-fpm on mail121 is OK: PROCS OK: 3 processes with command name 'php-fpm7.4' [18:47:10] RECOVERY - gluster121 conntrack_table_size on gluster121 is OK: OK: nf_conntrack is 0 % full [18:47:10] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 20 minutes ago with 0 failures [18:47:14] RECOVERY - cp32 HTTP 4xx/5xx ERROR Rate on cp32 is OK: OK - NGINX Error Rate is 33% [18:47:31] RECOVERY - cp23 HTTP 4xx/5xx ERROR Rate on cp23 is OK: OK - NGINX Error Rate is 31% [18:47:52] RECOVERY - cloud12 Current Load on cloud12 is OK: OK - load average: 5.68, 33.56, 34.37 [18:48:56] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [18:48:58] RECOVERY - cp22 HTTP 4xx/5xx ERROR Rate on cp22 is OK: OK - NGINX Error Rate is 5% [18:49:14] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [18:49:28] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [18:49:59] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [18:55:39] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.57, 3.23, 2.65 [18:59:38] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.48, 4.25, 3.18 [19:02:53] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.65, 3.60, 2.99 [19:04:47] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.35, 3.71, 3.09 [19:06:12] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.89, 2.90, 2.11 [19:06:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.19, 3.62, 3.14 [19:08:12] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.76, 2.88, 2.21 [19:08:36] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.20, 3.15, 3.03 [19:09:34] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.97, 3.89, 3.56 [19:13:33] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.00, 3.33, 3.40 [19:14:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.64, 3.69, 3.31 [19:15:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.05, 1.13, 3.69 [19:16:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.28, 3.87, 3.42 [19:17:48] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.00, 1.05, 3.35 [19:18:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.16, 3.60, 3.37 [19:20:36] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.45, 3.33, 3.30 [19:20:43] PROBLEM - mail121 Current Load on mail121 is WARNING: WARNING - load average: 0.05, 0.18, 1.97 [19:24:07] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.84, 3.14, 2.25 [19:24:33] RECOVERY - mail121 Current Load on mail121 is OK: OK - load average: 0.02, 0.11, 1.54 [19:24:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.97, 3.77, 3.50 [19:28:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.77, 2.88, 2.40 [19:28:36] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.62, 3.26, 3.36 [19:34:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 7.30, 5.02, 3.99 [19:34:43] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.22, 1.86 [19:35:23] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.45, 5.20, 3.85 [19:36:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.64, 3.95, 3.15 [19:36:42] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.09, 2.44, 1.75 [19:42:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.91, 3.32, 3.23 [19:48:39] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.27, 4.56, 3.38 [20:07:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.63, 3.01, 2.48 [20:09:02] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.55, 3.34, 2.65 [20:11:01] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.10, 3.21, 2.69 [20:26:17] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.74, 3.40, 3.95 [20:31:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 14.00, 6.83, 4.20 [20:32:17] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 7.19, 4.13, 3.98 [20:35:28] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.22, 3.88, 3.62 [20:37:28] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 0.59, 2.80, 3.25 [20:40:16] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 4.00, 3.71, 3.94 [20:42:16] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.04, 3.89, 3.96 [20:46:16] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.29, 3.66, 3.91 [20:47:55] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.18, 3.47, 2.87 [20:48:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.24, 3.62, 3.96 [20:48:59] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.29, 3.39, 3.89 [20:49:55] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 2.77, 2.68 [20:50:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.14, 4.18, 4.15 [20:51:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+1/-0/±0] 13https://github.com/miraheze/puppet/commit/309bcadc8715 [20:51:23] [02miraheze/puppet] 07paladox 03309bcad - Add swiftobject121 [20:51:26] [02puppet] 07paladox created branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [20:51:26] [url] Page not found · GitHub · GitHub | github.com [20:51:28] [02puppet] 07paladox opened pull request 03#2991: Add swiftobject121 - 13https://github.com/miraheze/puppet/pull/2991 [20:51:29] [url] Page not found · GitHub · GitHub | github.com [20:52:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.37, 3.58, 3.94 [20:53:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/c85d7a1d76ff...30e36e2ff7d8 [20:53:12] [url] Comparing c85d7a1d76ff...30e36e2ff7d8 · miraheze/puppet · GitHub | github.com [20:53:12] [02miraheze/puppet] 07paladox 0330e36e2 - swift: increase object-replication concurrency to 3 [20:53:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/ff99e7b13378 [20:53:55] [02miraheze/puppet] 07paladox 03ff99e7b - swift: remove node timeout and conn timeout from proxy [20:53:58] [02puppet] 07paladox created branch 03paladox-patch-7 - 13https://github.com/miraheze/puppet [20:53:58] [url] Page not found · GitHub · GitHub | github.com [20:53:59] [02puppet] 07paladox opened pull request 03#2992: swift: remove node timeout and conn timeout from proxy - 13https://github.com/miraheze/puppet/pull/2992 [20:53:59] [url] Page not found · GitHub · GitHub | github.com [20:54:07] [02puppet] 07paladox edited pull request 03#2992: swift: remove node timeout and conn timeout from proxy - 13https://github.com/miraheze/puppet/pull/2992 [20:54:08] ... [20:54:14] [02puppet] 07paladox closed pull request 03#2992: swift: remove node timeout and conn timeout from proxy - 13https://github.com/miraheze/puppet/pull/2992 [20:54:14] ... [20:54:16] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/30e36e2ff7d8...571515e23fcb [20:54:16] [url] Comparing 30e36e2ff7d8...571515e23fcb · miraheze/puppet · GitHub | github.com [20:54:18] [02miraheze/puppet] 07paladox 03571515e - swift: remove node timeout and conn timeout from proxy (#2992) [20:54:20] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-7 [20:54:23] [02puppet] 07paladox deleted branch 03paladox-patch-7 - 13https://github.com/miraheze/puppet [20:54:23] [url] Page not found · GitHub · GitHub | github.com [20:54:58] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/309bcadc8715...e8054962fc05 [20:54:58] [url] Comparing 309bcadc8715...e8054962fc05 · miraheze/puppet · GitHub | github.com [20:55:01] [02miraheze/puppet] 07paladox 03e805496 - Update site.pp [20:55:03] [02puppet] 07paladox synchronize pull request 03#2991: Add swiftobject121 - 13https://github.com/miraheze/puppet/pull/2991 [20:55:04] [url] Page not found · GitHub · GitHub | github.com [20:55:07] [02puppet] 07paladox closed pull request 03#2991: Add swiftobject121 - 13https://github.com/miraheze/puppet/pull/2991 [20:55:07] [url] Page not found · GitHub · GitHub | github.com [20:55:09] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-6 [20:55:10] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.84, 4.42, 4.19 [20:55:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/puppet/compare/571515e23fcb...b80cddde654c [20:55:12] [url] Comparing 571515e23fcb...b80cddde654c · miraheze/puppet · GitHub | github.com [20:55:15] [02miraheze/puppet] 07paladox 03b80cddd - Add swiftobject121 (#2991) [20:55:18] [02puppet] 07paladox deleted branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [20:55:18] [url] Page not found · GitHub · GitHub | github.com [20:55:51] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [20:57:01] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.29, 3.76, 3.70 [20:59:13] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.55, 4.07, 3.89 [21:01:12] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.42, 3.82, 3.82 [21:02:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.97, 3.91, 3.86 [21:03:11] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.19, 4.21, 3.97 [21:09:09] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.70, 3.95, 3.90 [21:09:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 4.00, 3.09, 2.44 [21:10:49] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.26, 3.34, 3.50 [21:11:08] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.99, 4.29, 4.03 [21:11:34] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.91, 2.49, 2.29 [21:12:46] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 4.00, 3.65, 3.60 [21:14:46] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.64, 4.35, 3.86 [21:21:19] PROBLEM - swiftobject114 Puppet on swiftobject114 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:22:36] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.01, 3.36, 1.48 [21:22:54] PROBLEM - swiftobject114 SSH on swiftobject114 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:23:46] PROBLEM - swiftobject114 Swift Object Service on swiftobject114 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:24:10] PROBLEM - Host swiftobject114 is DOWN: PING CRITICAL - Packet loss = 100% [21:27:05] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: connect to address 2a10:6740::6:316 port 5666: Connection refusedconnect to host 2a10:6740::6:316 port 5666: Connection refused [21:27:06] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.95, 3.58, 2.77 [21:28:59] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 1.27, 0.43, 0.15 [21:29:01] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 2.99, 2.66 [21:29:25] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:29:45] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.08, 3.23, 2.27 [21:31:44] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.23, 2.88, 2.27 [21:32:17] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b80cddde654c...a6828bb2df8f [21:32:18] [url] Comparing b80cddde654c...a6828bb2df8f · miraheze/puppet · GitHub | github.com [21:32:20] [02miraheze/puppet] 07paladox 03a6828bb - swift: set concurrency to 1 for object-replicator [21:40:50] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 6.14, 4.06, 1.71 [21:45:56] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.82, 3.04, 2.37 [21:49:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.08, 2.95, 2.54 [21:58:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.29, 10.21, 8.76 [22:01:34] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.82, 3.80, 2.96 [22:02:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.40, 9.19, 8.66 [22:03:31] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.57, 3.47, 2.93 [22:05:28] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.98, 3.92, 3.15 [22:06:50] RECOVERY - Host swiftobject114 is UP: PING OK - Packet loss = 0%, RTA = 1.08 ms [22:07:03] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/3ad61005d3ad [22:07:04] [02miraheze/dns] 07paladox 033ad6100 - Add gluster112 to dns [22:07:07] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [22:07:07] [url] Page not found · GitHub · GitHub | github.com [22:07:08] [02dns] 07paladox opened pull request 03#371: Add gluster112 to dns - 13https://github.com/miraheze/dns/pull/371 [22:07:09] ... [22:07:25] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.57, 3.96, 3.27 [22:07:55] RECOVERY - swiftobject114 SSH on swiftobject114 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [22:07:59] RECOVERY - swiftobject114 Swift Object Service on swiftobject114 is OK: TCP OK - 0.001 second response time on 2a10:6740::6:206 port 6000 [22:08:00] PROBLEM - swiftobject114 Puppet on swiftobject114 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 4 days ago with 0 failures [22:09:22] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.84, 3.14, 3.05 [22:13:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/3a3f6afb98c9 [22:13:04] [02miraheze/puppet] 07paladox 033a3f6af - swift: increase interval for object-replicator to increase likely hood of succeeding [22:13:05] [02puppet] 07paladox created branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [22:13:05] [url] Page not found · GitHub · GitHub | github.com [22:13:08] [02puppet] 07paladox opened pull request 03#2993: swift: increase interval for object-replicator to increase likely hood of succeeding - 13https://github.com/miraheze/puppet/pull/2993 [22:13:09] ... [22:13:44] [02puppet] 07paladox closed pull request 03#2993: swift: increase interval for object-replicator to increase likely hood of succeeding - 13https://github.com/miraheze/puppet/pull/2993 [22:13:44] [url] Page not found · GitHub · GitHub | github.com [22:13:46] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-6 [22:13:49] [02puppet] 07paladox deleted branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [22:13:49] [url] Page not found · GitHub · GitHub | github.com [22:13:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a6828bb2df8f...bc72cc7a45c1 [22:13:50] [url] Comparing a6828bb2df8f...bc72cc7a45c1 · miraheze/puppet · GitHub | github.com [22:13:53] [02miraheze/puppet] 07paladox 03bc72cc7 - swift: increase interval for object-replicator to increase likely hood of succeeding (#2993) [22:14:29] [02dns] 07paladox closed pull request 03#371: Add gluster112 to dns - 13https://github.com/miraheze/dns/pull/371 [22:14:30] [url] Page not found · GitHub · GitHub | github.com [22:14:30] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [22:14:32] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [22:14:33] ... [22:14:33] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/8244bc123a7a...2e1eaca9df21 [22:14:34] [url] Comparing 8244bc123a7a...2e1eaca9df21 · miraheze/dns · GitHub | github.com [22:14:35] [02miraheze/dns] 07paladox 032e1eaca - Add gluster112 to dns (#371) [22:16:44] PROBLEM - swiftobject114 Puppet on swiftobject114 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:18:10] PROBLEM - swiftobject114 Swift Object Service on swiftobject114 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:18:21] PROBLEM - swiftobject114 SSH on swiftobject114 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:18:33] !log remove swiftobject114 and replace with gluster112 [22:18:44] PROBLEM - ping6 on swiftobject114 is CRITICAL: PING CRITICAL - Packet loss = 100% [22:18:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:19:58] PROBLEM - Host swiftobject114 is DOWN: PING CRITICAL - Packet loss = 100% [22:48:38] PROBLEM - db121 APT on db121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [22:49:26] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.23, 9.60, 8.44 [22:50:40] PROBLEM - db121 APT on db121 is CRITICAL: APT CRITICAL: 27 packages available for upgrade (8 critical updates). [22:51:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.68, 9.88, 8.69 [22:53:26] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.83, 9.35, 8.64 [22:56:06] [02dns] 07MacFan4000 opened pull request 03#372: add 2 zones - 13https://github.com/miraheze/dns/pull/372 [22:56:06] [url] Page not found · GitHub · GitHub | github.com [22:57:29] MacFan4000: need me to merge? [22:57:34] sure [22:57:41] [02dns] 07Universal-Omega closed pull request 03#372: add 2 zones - 13https://github.com/miraheze/dns/pull/372 [22:57:41] [url] Page not found · GitHub · GitHub | github.com [22:57:44] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+2/-0/±0] 13https://github.com/miraheze/dns/compare/2e1eaca9df21...e49fecae7fea [22:57:45] [url] Comparing 2e1eaca9df21...e49fecae7fea · miraheze/dns · GitHub | github.com [22:57:46] [02miraheze/dns] 07MacFan4000 03e49feca - add 2 zones (#372) [23:01:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.57, 3.35, 2.66 [23:03:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.35, 3.32, 2.73 [23:03:51] PROBLEM - cp33 SSH on cp33 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [23:05:10] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 65.70, 65.32, 29.51 [23:05:48] RECOVERY - cp33 SSH on cp33 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [23:07:33] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.94, 3.78, 3.09 [23:09:31] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.64, 4.31, 3.38 [23:11:29] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.44, 3.28, 3.11 [23:13:48] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+1/-0/±0] 13https://github.com/miraheze/puppet/commit/a88eda3f3297 [23:13:51] [02miraheze/puppet] 07paladox 03a88eda3 - Add gluster112 [23:13:54] [02puppet] 07paladox created branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [23:13:54] [url] Page not found · GitHub · GitHub | github.com [23:13:58] [02puppet] 07paladox opened pull request 03#2994: Add gluster112 - 13https://github.com/miraheze/puppet/pull/2994 [23:13:59] [url] Page not found · GitHub · GitHub | github.com [23:15:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-6 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a88eda3f3297...12dc84ffcf70 [23:15:02] [url] Comparing a88eda3f3297...12dc84ffcf70 · miraheze/puppet · GitHub | github.com [23:15:03] [02miraheze/puppet] 07paladox 0312dc84f - Update site.pp [23:15:03] [02puppet] 07paladox synchronize pull request 03#2994: Add gluster112 - 13https://github.com/miraheze/puppet/pull/2994 [23:15:04] [url] Page not found · GitHub · GitHub | github.com [23:15:11] [02puppet] 07paladox closed pull request 03#2994: Add gluster112 - 13https://github.com/miraheze/puppet/pull/2994 [23:15:11] ... [23:15:12] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-6 [23:15:14] [02puppet] 07paladox deleted branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet [23:15:15] ... [23:15:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/puppet/compare/bc72cc7a45c1...e8fe6e16b5b9 [23:15:16] [url] Comparing bc72cc7a45c1...e8fe6e16b5b9 · miraheze/puppet · GitHub | github.com [23:15:17] [02miraheze/puppet] 07paladox 03e8fe6e1 - Add gluster112 (#2994) [23:26:50] PROBLEM - gluster112 glusterd Volume on gluster112 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfsd' [23:28:49] RECOVERY - gluster112 glusterd Volume on gluster112 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfsd' [23:31:30] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.56, 2.74, 1.70 [23:31:56] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.87, 3.47, 2.09 [23:32:10] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1861103773 secs [23:33:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.40, 3.32, 2.04 [23:35:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.93, 2.90, 2.00 [23:35:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.87, 3.42, 2.25 [23:37:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.39, 2.68, 2.03 [23:37:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.01, 2.23 [23:40:11] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.76, 4.38, 3.50 [23:41:09] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 7.82, 4.68, 2.55 [23:41:26] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.64, 4.48, 3.01 [23:43:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.37, 3.70, 2.90 [23:43:29] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.48, 3.99, 3.35 [23:44:57] [02puppet] 07MacFan4000 opened pull request 03#2995: check_reverse_dns: allow name flattening for name cheap dns - 13https://github.com/miraheze/puppet/pull/2995 [23:44:58] [url] Page not found · GitHub · GitHub | github.com [23:45:03] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.55, 3.24, 2.45 [23:45:24] [02puppet] 07MacFan4000 edited pull request 03#2995: check_reverse_dns: allow cname flattening for namecheap dns - 13https://github.com/miraheze/puppet/pull/2995 [23:45:24] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 3.67, 4.06, 3.45 [23:45:25] [url] Page not found · GitHub · GitHub | github.com [23:45:54] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.35, 3.38, 3.47 [23:47:20] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.07, 3.86, 3.46 [23:47:48] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.14, 3.17, 3.39 [23:49:15] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 3.31, 4.14, 3.64 [23:49:17] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ssl/commit/2e36598c7059 [23:49:19] [02miraheze/ssl] 07MacFan4000 032e36598 - add ewgf.wiki [23:49:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.29, 4.09, 3.32 [23:49:23] [02ssl] 07MacFan4000 created branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [23:49:23] [url] Page not found · GitHub · GitHub | github.com [23:49:28] [02ssl] 07MacFan4000 opened pull request 03#613: add 2 certificates - 13https://github.com/miraheze/ssl/pull/613 [23:49:29] [url] Page not found · GitHub · GitHub | github.com [23:50:04] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.05408117175 secs [23:50:50] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 6.17, 4.20, 3.00 [23:51:17] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ssl/compare/2e36598c7059...0835aaf9a93c [23:51:18] [url] Comparing 2e36598c7059...0835aaf9a93c · miraheze/ssl · GitHub | github.com [23:51:19] [02miraheze/ssl] 07MacFan4000 030835aaf - add www.twistwoodtaleswiki.com [23:51:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.65, 3.99, 3.38 [23:51:22] [02ssl] 07MacFan4000 synchronize pull request 03#613: add 2 certificates - 13https://github.com/miraheze/ssl/pull/613 [23:51:22] [url] Page not found · GitHub · GitHub | github.com [23:51:24] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.87, 2.82, 3.99 [23:52:43] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0835aaf9a93c...12f56410e7ae [23:52:44] [url] Comparing 0835aaf9a93c...12f56410e7ae · miraheze/ssl · GitHub | github.com [23:52:44] [02miraheze/ssl] 07MacFan4000 0312f5641 - Update certs.yaml [23:52:46] [02ssl] 07MacFan4000 synchronize pull request 03#613: add 2 certificates - 13https://github.com/miraheze/ssl/pull/613 [23:52:47] ... [23:52:47] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.37, 3.47, 2.88 [23:53:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.09, 4.35, 3.58 [23:53:22] [02ssl] 07MacFan4000 closed pull request 03#613: add 2 certificates - 13https://github.com/miraheze/ssl/pull/613 [23:53:22] ... [23:53:25] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+2/-0/±1] 13https://github.com/miraheze/ssl/compare/e54997d1e625...6cafe4609c0b [23:53:25] [url] Comparing e54997d1e625...6cafe4609c0b · miraheze/ssl · GitHub | github.com [23:53:28] [02miraheze/ssl] 07MacFan4000 036cafe46 - add 2 certificates (#613) [23:53:31] [02miraheze/ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 [23:53:34] [02ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [23:53:34] [url] Page not found · GitHub · GitHub | github.com [23:54:44] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.77, 3.24, 2.87 [23:55:02] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.24, 3.84, 3.69 [23:55:19] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.77, 3.43, 3.34 [23:56:57] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 5.10, 4.26, 3.85 [23:59:17] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.00, 4.89, 3.92