[00:02:04] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.79, 3.81, 3.45 [00:02:33] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.52, 2.86, 2.24 [00:02:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.71, 4.18, 4.01 [00:03:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.95, 1.99, 1.99 [00:04:05] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.56, 1.75, 1.65 [00:04:33] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.67, 2.62, 2.22 [00:06:04] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.25, 1.51, 1.57 [00:08:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.80, 3.92, 3.97 [00:10:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.58, 4.78, 4.27 [00:11:16] RECOVERY - erikapedia.com - reverse DNS on sslhost is OK: SSL OK - erikapedia.com reverse DNS resolves to cp21.miraheze.org - NS RECORDS OK [00:17:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.69, 1.91, 1.83 [00:21:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.14, 3.52, 3.90 [00:22:02] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.47, 7.14, 6.19 [00:23:57] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.75, 7.26, 6.37 [00:27:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.91, 1.97 [00:28:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.83, 3.44, 3.89 [00:30:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.14, 3.90, 4.00 [00:33:35] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.14, 6.66, 6.44 [00:34:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.67, 3.91 [00:39:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.47, 3.00, 3.36 [00:42:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.31, 3.48, 3.67 [00:46:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.49, 3.63 [00:47:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 3.58, 3.44 [00:47:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.91, 2.32, 2.03 [00:48:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.99, 4.06, 3.82 [00:50:02] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.83, 1.41, 1.16 [00:51:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.96, 3.27, 3.39 [00:52:02] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.87, 1.17, 1.10 [00:56:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 4.00, 3.96 [00:58:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 4.10, 4.01 [01:02:26] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 3.76, 3.51 [01:04:23] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.25, 3.52, 3.45 [01:05:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.59, 10.16, 9.03 [01:06:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.28, 3.16, 3.33 [01:09:39] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.33, 9.51, 9.05 [01:12:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.22, 4.21, 3.70 [01:13:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.90, 2.00 [01:14:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.89, 3.58, 3.52 [01:17:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.28, 2.03, 2.03 [01:18:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.58, 3.37, 3.87 [01:19:02] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.50, 1.77, 1.49 [01:19:57] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.70, 3.10, 3.34 [01:21:02] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.19, 1.66, 1.49 [01:27:38] PROBLEM - wiki.chippyapps.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.chippyapps.com could not be found [01:27:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.44, 1.80, 1.96 [01:28:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.13, 2.88, 3.80 [01:30:50] PROBLEM - www.erikapedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.erikapedia.com could not be found [01:30:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.95, 2.75, 3.29 [01:34:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.59, 3.35, 3.66 [01:35:21] PROBLEM - erikapedia.com - LetsEncrypt on sslhost is CRITICAL: connect to address erikapedia.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [01:36:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.40, 3.38 [01:37:03] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.80, 1.84, 1.58 [01:38:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.94, 3.09, 3.26 [01:39:03] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.78, 1.47, 1.48 [01:39:07] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/0563ec7c881e...9c3ab0b46415 [01:39:07] [url] Comparing 0563ec7c881e...9c3ab0b46415 · miraheze/ssl · GitHub | github.com [01:39:08] [02miraheze/ssl] 07MirahezeSSLBot 039c3ab0b - Bot: Update SSL cert for pj-masks-info.cf [01:41:07] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/9c3ab0b46415...6e7dc2f38acc [01:41:07] [url] Comparing 9c3ab0b46415...6e7dc2f38acc · miraheze/ssl · GitHub | github.com [01:41:08] [02miraheze/ssl] 07MirahezeSSLBot 036e7dc2f - Bot: Update SSL cert for correypedia.org [01:42:13] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6e7dc2f38acc...5d74b5a17bec [01:42:13] [url] Comparing 6e7dc2f38acc...5d74b5a17bec · miraheze/ssl · GitHub | github.com [01:42:14] [02miraheze/ssl] 07MirahezeSSLBot 035d74b5a - Bot: Update SSL cert for sbs.wiki [01:42:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.91, 7.44, 5.99 [01:42:45] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/5d74b5a17bec...b33457a3abd4 [01:42:46] [url] Comparing 5d74b5a17bec...b33457a3abd4 · miraheze/ssl · GitHub | github.com [01:42:47] [02miraheze/ssl] 07MirahezeSSLBot 03b33457a - Bot: Update SSL cert for wiki.digitaldesignhq.com [01:43:19] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b33457a3abd4...4dd98d6fec4a [01:43:20] [url] Comparing b33457a3abd4...4dd98d6fec4a · miraheze/ssl · GitHub | github.com [01:43:21] [02miraheze/ssl] 07MirahezeSSLBot 034dd98d6 - Bot: Update SSL cert for wiki.apico.buzz [01:43:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4dd98d6fec4a...042e75291c77 [01:43:41] [url] Comparing 4dd98d6fec4a...042e75291c77 · miraheze/ssl · GitHub | github.com [01:43:42] [02miraheze/ssl] 07MirahezeSSLBot 03042e752 - Bot: Update SSL cert for steamdecklinux.wiki [01:44:27] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/042e75291c77...dccaffa80409 [01:44:27] [url] Comparing 042e75291c77...dccaffa80409 · miraheze/ssl · GitHub | github.com [01:44:28] [02miraheze/ssl] 07MirahezeSSLBot 03dccaffa - Bot: Update SSL cert for thestories.kr [01:44:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.21, 7.02, 6.02 [01:44:45] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/dccaffa80409...a38707b155e2 [01:44:46] [url] Comparing dccaffa80409...a38707b155e2 · miraheze/ssl · GitHub | github.com [01:44:47] [02miraheze/ssl] 07MirahezeSSLBot 03a38707b - Bot: Update SSL cert for www.obeymewiki.com [01:44:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.55, 4.06, 3.63 [01:45:48] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a38707b155e2...73745279fd8f [01:45:48] [url] Comparing a38707b155e2...73745279fd8f · miraheze/ssl · GitHub | github.com [01:45:49] [02miraheze/ssl] 07MirahezeSSLBot 037374527 - Bot: Update SSL cert for wiki.ravynos.com [01:46:16] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/73745279fd8f...aa1dff6215c4 [01:46:16] [url] Comparing 73745279fd8f...aa1dff6215c4 · miraheze/ssl · GitHub | github.com [01:46:17] [02miraheze/ssl] 07MirahezeSSLBot 03aa1dff6 - Bot: Update SSL cert for opendatascot.org [01:46:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.81, 6.26, 5.87 [01:46:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/aa1dff6215c4...603b70d0c067 [01:46:44] [url] Comparing aa1dff6215c4...603b70d0c067 · miraheze/ssl · GitHub | github.com [01:46:46] [02miraheze/ssl] 07MirahezeSSLBot 03603b70d - Bot: Update SSL cert for with.cpt-ra.bid [01:46:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.09, 3.34, 3.42 [01:47:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.40, 2.00, 1.91 [01:48:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.61, 3.16, 3.34 [01:50:06] PROBLEM - www.erikapedia.com - LetsEncrypt on sslhost is CRITICAL: connect to address www.erikapedia.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [01:50:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.64, 3.89 [01:55:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.43, 1.84, 1.93 [01:56:27] RECOVERY - opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Thu 01 Sep 2022 00:46:11 GMT +0000. [01:56:37] RECOVERY - sbs.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'sbs.wiki' will expire on Thu 01 Sep 2022 00:42:07 GMT +0000. [01:56:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.19, 3.83, 3.88 [01:56:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.65, 3.42 [01:57:10] RECOVERY - wiki.apico.buzz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.apico.buzz' will expire on Thu 01 Sep 2022 00:43:13 GMT +0000. [01:58:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.43, 3.71 [02:00:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.53, 3.41, 3.39 [02:01:34] RECOVERY - steamdecklinux.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'steamdecklinux.wiki' will expire on Thu 01 Sep 2022 00:43:35 GMT +0000. [02:02:41] RECOVERY - wiki.ravynos.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ravynos.com' will expire on Thu 01 Sep 2022 00:45:42 GMT +0000. [02:04:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.84, 3.77, 3.71 [02:04:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.43, 4.05, 3.63 [02:05:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.05, 1.79, 1.83 [02:06:39] RECOVERY - correypedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'correypedia.org' will expire on Thu 01 Sep 2022 00:41:01 GMT +0000. [02:06:55] RECOVERY - thestories.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'thestories.kr' will expire on Thu 01 Sep 2022 00:44:22 GMT +0000. [02:06:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.72, 3.88, 3.62 [02:07:53] RECOVERY - pj-masks-info.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'pj-masks-info.cf' will expire on Thu 01 Sep 2022 00:39:01 GMT +0000. [02:07:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.64, 1.77, 1.82 [02:07:59] RECOVERY - wiki.digitaldesignhq.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitaldesignhq.com' will expire on Thu 01 Sep 2022 00:42:40 GMT +0000. [02:08:08] RECOVERY - www.opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Thu 01 Sep 2022 00:46:11 GMT +0000. [02:08:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.55, 3.92, 3.65 [02:11:08] RECOVERY - with.cpt-ra.bid - LetsEncrypt on sslhost is OK: OK - Certificate 'with.cpt-ra.bid' will expire on Thu 01 Sep 2022 00:46:39 GMT +0000. [02:12:38] PROBLEM - erikapedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for erikapedia.com could not be found [02:12:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.87, 3.94 [02:13:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.12, 1.95, 1.87 [02:14:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.64, 4.21, 4.05 [02:14:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.55, 3.71, 3.69 [02:15:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.90, 1.86 [02:16:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.76, 3.91 [02:17:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.07, 1.94, 1.88 [02:20:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.98, 4.43, 4.10 [02:20:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.72, 4.13, 3.78 [02:22:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.66, 3.85, 3.72 [02:23:30] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.35, 7.53, 6.50 [02:24:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.97, 4.00 [02:25:09] RECOVERY - www.obeymewiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.obeymewiki.com' will expire on Thu 01 Sep 2022 00:44:40 GMT +0000. [02:25:25] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.75, 7.41, 6.60 [02:26:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 4.24, 4.10 [02:30:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.87, 3.99 [02:30:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.85, 3.77, 3.71 [02:31:12] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.55, 6.44, 6.48 [02:32:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 4.20, 4.10 [02:32:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.00, 3.36, 3.56 [02:34:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.79, 3.96 [02:36:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.72, 3.30, 3.13 [02:36:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.96, 4.32, 4.14 [02:38:06] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.08, 3.53, 3.23 [02:38:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.27, 3.59, 3.58 [02:39:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.74, 1.89, 2.00 [02:40:03] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.57, 3.32, 3.20 [02:40:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.14, 3.43, 3.53 [02:41:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.98, 2.02 [02:44:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.94, 3.93, 3.69 [02:45:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.73, 1.92, 1.99 [02:46:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.35, 3.62, 3.60 [02:47:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.55, 2.14, 2.06 [02:54:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.40, 3.23, 3.91 [02:58:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.39, 3.49, 3.16 [02:58:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.38, 3.66, 3.90 [03:00:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.74, 3.11, 3.06 [03:01:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.59, 1.84, 1.99 [03:04:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.99, 3.99 [03:04:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.21, 2.90, 3.27 [03:06:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.91, 4.49, 4.15 [03:17:01] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.44, 3.23 [03:17:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.49, 1.90, 1.85 [03:18:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.04, 3.34, 3.23 [03:19:02] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.36, 1.88, 1.32 [03:21:02] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.27, 1.60, 1.28 [03:25:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.78, 1.97, 1.95 [03:26:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.39, 3.84 [03:34:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.75, 2.59, 3.31 [03:47:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.20, 2.19, 1.93 [03:48:01] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.56, 1.87, 1.49 [03:52:01] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.26, 1.60, 1.47 [03:52:49] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.24, 6.27, 5.81 [03:53:51] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.34, 2.95, 1.60 [03:54:45] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.57, 6.02, 5.78 [03:55:51] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.82, 3.22, 1.87 [03:57:51] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.39, 2.67, 1.84 [03:58:15] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.41, 3.80, 3.29 [03:59:50] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.36, 2.88 [03:59:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.75, 1.94, 1.99 [04:00:13] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.94, 3.98, 3.42 [04:00:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.90, 7.05, 6.33 [04:01:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.66, 3.31, 2.91 [04:03:44] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.04, 2.80, 2.77 [04:04:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.96, 2.89, 3.11 [04:08:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.05, 6.75, 6.51 [04:10:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.58, 3.27 [04:11:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.83, 1.85 [04:13:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.90, 1.86, 1.85 [04:14:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.74, 3.31, 3.25 [04:15:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.21, 1.93, 1.87 [04:22:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.43, 3.08 [04:23:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.47, 3.28 [04:25:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.20, 3.71, 3.39 [04:26:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.42, 2.91, 2.94 [04:30:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.34, 3.81, 3.35 [04:31:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.09, 3.69, 3.51 [04:35:01] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.45, 3.55, 3.30 [04:36:59] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.61, 3.36 [04:37:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.86, 1.91, 2.00 [04:38:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.31, 3.37, 3.29 [04:39:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.71, 4.20, 3.77 [04:41:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.27, 3.91, 3.33 [04:42:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.95, 5.05, 3.94 [04:45:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.86, 3.49 [04:47:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.26, 2.01, 1.99 [04:48:08] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [04:48:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.92, 3.84, 3.88 [04:48:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.21, 3.91, 3.79 [04:49:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.42, 3.32, 3.37 [04:53:51] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.74, 2.97, 1.80 [04:54:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.70, 2.67, 3.35 [04:55:51] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 2.90, 2.83, 1.89 [04:55:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.92, 2.00 [04:56:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.55, 3.04, 3.40 [05:10:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.14, 6.64, 5.34 [05:11:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.15, 1.77, 1.81 [05:12:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.14, 6.22, 5.35 [05:13:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.69, 1.77 [05:14:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.30, 3.02 [05:16:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.90, 3.75, 3.21 [05:16:56] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [05:17:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.38, 1.93, 1.84 [05:18:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 4.00, 3.79, 3.28 [05:22:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.06, 3.17, 3.16 [05:25:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.99, 1.98, 1.94 [05:40:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.99, 3.52, 2.97 [05:42:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.46, 3.00, 2.84 [05:44:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.52, 6.42, 5.75 [05:46:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.80, 3.99, 3.24 [05:47:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.16, 1.85, 1.80 [05:48:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.97, 5.76, 5.70 [05:48:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.44, 3.74, 3.24 [05:50:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.35, 3.11, 3.06 [05:53:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.96, 1.90 [05:57:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.13, 2.06, 1.95 [06:03:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.61, 1.99, 1.97 [06:05:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.12, 4.14, 3.59 [06:05:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.33, 2.08, 2.00 [06:06:16] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.38, 3.90, 3.23 [06:08:15] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.95, 3.08, 3.01 [06:11:05] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.24, 3.45, 3.53 [06:14:57] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.89, 3.10, 3.36 [06:42:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.55, 3.43, 2.96 [06:44:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.90, 3.37, 3.00 [06:48:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.86, 3.35 [06:50:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.30, 3.37, 3.23 [07:13:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.78, 3.30, 3.02 [07:15:24] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.52, 3.16, 3.02 [07:25:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.50, 3.21 [07:25:13] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 3.36, 3.02 [07:26:33] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.08, 1.68, 1.29 [07:27:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.46, 3.25, 3.16 [07:27:11] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.89, 2.84, 2.87 [07:28:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.90, 1.75, 1.36 [07:30:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.47, 1.70, 1.39 [07:34:25] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.59, 1.97, 1.60 [07:38:26] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.81, 1.45, 1.47 [07:42:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.48, 3.83, 3.47 [07:46:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.68, 3.37, 3.37 [07:52:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.00, 6.55, 5.79 [07:54:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.61, 6.27, 5.78 [07:56:08] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.64, 2.04, 1.65 [07:59:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.59, 3.72, 3.50 [08:00:05] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.14, 1.66, 1.58 [08:01:28] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.55, 2.95, 3.24 [08:07:17] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.62, 3.43 [08:09:13] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.74, 3.24, 3.31 [08:27:40] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.81, 1.63, 1.50 [08:29:06] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.75, 3.75, 3.09 [08:29:31] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.65, 3.58, 3.19 [08:29:38] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.57, 1.27, 1.39 [08:31:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.16, 3.42, 3.05 [08:31:29] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.78, 3.31, 3.13 [08:33:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.91, 3.01, 2.95 [08:41:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.81, 3.35, 3.07 [08:43:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.88, 3.40, 3.12 [08:45:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.81, 3.31 [08:47:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.80, 3.40, 3.22 [08:55:14] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.15, 1.93, 1.63 [08:57:05] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 9.48, 4.32, 1.86 [08:57:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.72, 1.96, 1.69 [08:59:11] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.88, 1.57, 1.58 [09:03:03] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.36, 1.66, 1.47 [09:06:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.32, 3.72, 3.02 [09:09:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.10, 4.14, 3.46 [09:09:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.45, 4.20, 3.07 [09:10:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.21, 3.92, 3.29 [09:11:01] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.37, 2.03, 1.76 [09:11:08] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.22, 1.96, 1.42 [09:11:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.48, 3.85, 3.08 [09:12:58] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.48, 4.39, 3.55 [09:13:07] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.31, 1.71, 1.40 [09:13:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.09, 4.20, 3.35 [09:14:58] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.88, 2.00, 1.82 [09:14:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.36, 3.60, 3.36 [09:15:07] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.53, 1.28, 1.27 [09:15:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.50, 3.94, 3.35 [09:16:58] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.81, 3.06, 3.19 [09:17:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.06, 3.65, 3.66 [09:17:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.52, 3.03, 3.09 [09:23:03] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.83, 2.91, 3.35 [09:24:50] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.45, 1.55, 1.68 [09:28:46] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.59, 2.33, 1.99 [09:30:44] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.30, 1.98, 1.91 [09:34:41] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.11, 2.13, 1.98 [09:38:38] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.22, 1.77, 1.88 [09:46:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.14, 1.78, 1.82 [09:47:19] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [09:47:19] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:00:49] PROBLEM - db112 APT on db112 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [10:02:19] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.87, 1.76, 1.98 [10:02:46] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.01, 4.24, 3.27 [10:02:50] PROBLEM - db112 APT on db112 is CRITICAL: APT CRITICAL: 51 packages available for upgrade (6 critical updates). [10:04:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.19, 3.85, 3.24 [10:05:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.84, 1.99 [10:06:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.98, 3.23, 3.09 [10:07:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 1.77, 1.92, 2.01 [10:09:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.52, 1.77, 1.94 [10:10:13] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 4.05, 2.33, 2.05 [10:11:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.51, 2.04, 2.02 [10:12:11] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.40, 1.92, 1.93 [10:13:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.84, 1.95 [10:15:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.09, 1.88, 1.94 [10:16:07] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [10:18:26] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.44, 4.04, 3.47 [10:18:40] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 1.51, 2.03, 1.56 [10:20:40] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.95, 1.66, 1.48 [10:21:54] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.87, 3.60, 3.23 [10:22:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.66, 3.49, 3.38 [10:23:43] [02miraheze/landing] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/226d71316b3c...03c8649b28b4 [10:23:43] [url] Comparing 226d71316b3c...03c8649b28b4 · miraheze/landing · GitHub | github.com [10:23:45] [02miraheze/landing] 07Reception123 0303c8649 - rm $ sign causing issues with i18n [10:23:52] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.81, 3.05, 3.08 [10:24:12] !log [reception@mwtask111] starting deploy of {'config': True, 'l10n': True} to all [10:24:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:24:44] miraheze/landing - Reception123 the build passed. [10:25:46] !log [reception@mwtask111] finished deploy of {'config': True, 'l10n': True} to all - SUCCESS in 94s [10:25:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:26:00] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 4.19, 2.62, 2.10 [10:28:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.45, 3.95, 3.55 [10:29:45] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.77, 3.55, 3.33 [10:30:02] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.66, 3.50 [10:31:43] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.03, 3.03, 3.17 [10:31:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.80, 3.01, 3.28 [10:31:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.47, 1.96, 1.98 [10:33:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 6.63, 4.18, 2.80 [10:37:47] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.26, 3.43, 3.35 [10:39:43] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.11, 3.09, 3.25 [10:43:18] Reception123: why config & l10n [10:45:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.67, 1.66, 1.97 [10:47:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.23, 2.22, 2.14 [10:53:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.08, 1.52, 1.91 [10:55:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.31, 1.91, 2.01 [10:57:24] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.31, 2.18, 1.64 [10:57:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.52, 1.76, 1.97 [10:59:23] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.85, 1.68, 1.52 [10:59:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.09, 1.81, 1.98 [11:06:19] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.16, 2.85, 2.10 [11:09:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.00, 2.22, 2.00 [11:10:06] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.74, 6.91, 6.25 [11:11:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.06, 1.84, 1.82 [11:12:01] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.69, 6.48, 6.17 [11:13:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.44, 1.79, 1.81 [11:16:15] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.96, 1.52, 1.88 [11:17:07] !log [reception@mwtask111] starting deploy of {'landing': True} to all [11:17:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:17:17] !log [reception@mwtask111] finished deploy of {'landing': True} to all - SUCCESS in 10s [11:17:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:17:26] RhinosF1: seems like somehow I accidentally back scrolled and went with the last thing I did before [11:17:31] done now ^ [11:17:48] Ty Reception123 [11:19:33] no problem [11:19:59] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.28, 1.44, 1.65 [11:22:13] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.51, 1.14, 1.62 [11:25:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.55, 2.33, 1.98 [11:28:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 3.58, 3.29 [11:29:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.47, 1.85, 1.86 [11:30:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 3.88, 3.43 [11:32:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.54, 3.45, 3.34 [11:35:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.46, 1.79, 1.98 [11:38:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.11, 3.37, 3.35 [11:41:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.04, 1.80, 1.91 [11:41:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.49, 2.15, 1.91 [11:42:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.41, 3.39 [11:43:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.97, 3.58, 2.95 [11:43:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.57, 1.70, 1.86 [11:45:33] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.70, 3.18, 2.88 [11:47:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.53, 1.92, 1.90 [11:48:38] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.68, 3.51 [11:49:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.78, 2.11, 1.96 [11:50:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.22, 3.24, 3.38 [11:53:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.63, 1.90, 1.92 [11:55:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.82, 2.12, 1.96 [12:01:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.90, 3.35 [12:03:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.18, 4.12, 3.50 [12:03:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.51, 1.84, 1.91 [12:04:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.81, 3.54 [12:05:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.94, 3.69, 3.42 [12:08:18] PROBLEM - mon111 NTP time on mon111 is CRITICAL: NTP CRITICAL: Offset 11.77986094 secs [12:08:50] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.79, 3.18, 3.34 [12:09:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.88, 3.30, 3.32 [12:14:08] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.48, 1.54, 1.70 [12:14:50] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.41, 3.80, 3.51 [12:15:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.68, 7.40, 6.37 [12:16:50] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.22, 3.26, 3.35 [12:20:10] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.57, 1.57, 1.69 [12:21:01] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.72, 2.27, 1.95 [12:21:07] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.56, 8.56, 7.07 [12:23:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.84, 3.60, 3.28 [12:24:11] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.68, 2.03, 1.84 [12:24:58] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.20, 7.92, 7.15 [12:25:10] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.67, 3.39, 3.26 [12:25:39] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.44, 3.42 [12:26:48] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.87, 2.00, 1.95 [12:28:43] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.14, 2.03, 1.97 [12:29:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.05, 3.64, 3.42 [12:29:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.38, 3.30, 3.40 [12:30:50] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.37, 8.00, 7.38 [12:31:10] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.52, 3.25, 3.30 [12:32:10] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.49, 1.84, 1.89 [12:32:50] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.00, 7.52, 7.28 [12:34:30] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.30, 1.80, 1.91 [12:35:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.47, 3.92, 3.57 [12:35:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.56, 4.02, 3.44 [12:36:10] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.10, 1.86, 1.87 [12:37:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.32, 3.70, 3.53 [12:37:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.69, 3.38 [12:38:10] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.30, 1.57, 1.76 [12:38:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.05, 3.40, 3.41 [12:39:53] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.24, 1.68, 1.30 [12:40:10] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.61, 2.02, 1.91 [12:40:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.43, 3.24, 3.35 [12:40:49] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.21, 7.93, 7.44 [12:41:10] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.19, 3.32, 3.40 [12:41:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.04, 3.26, 3.27 [12:41:52] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.75, 1.77, 1.39 [12:42:13] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.15, 1.87, 1.88 [12:43:52] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.42, 1.68, 1.40 [12:45:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.47, 3.44 [12:46:01] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.14, 4.49, 3.81 [12:46:08] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.77, 1.83 [12:47:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.99, 4.21, 3.72 [12:48:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.27, 3.78, 3.53 [12:48:08] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.69, 2.15, 1.96 [12:49:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.14, 3.82, 3.64 [12:50:51] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.99, 3.40, 3.01 [12:51:58] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.90, 3.86, 3.54 [12:52:10] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.10, 1.82, 1.99 [12:52:49] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.43, 3.06, 2.93 [12:54:10] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.93, 2.12, 2.07 [12:58:49] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 4.92, 6.96, 7.76 [12:59:32] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.85, 3.81, 3.88 [12:59:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.87, 3.45, 3.58 [13:05:10] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.07, 2.90, 3.32 [13:05:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.08, 3.65, 3.76 [13:06:49] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.02, 4.97, 6.51 [13:07:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.35, 3.64 [13:07:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.20, 2.89, 3.30 [13:11:08] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 3.59, 3.66 [13:13:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.12, 3.11, 3.48 [13:15:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.92, 4.15, 3.84 [13:16:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.15, 3.86, 3.78 [13:22:50] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.74, 3.73 [13:24:10] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.08, 1.58, 1.89 [13:24:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.60, 3.68 [13:25:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.62, 3.46, 3.26 [13:26:11] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 4.40, 2.54, 2.20 [13:26:50] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.95, 3.81 [13:28:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.70, 3.95, 3.83 [13:29:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.22, 3.02, 3.15 [13:29:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.14, 3.94, 3.47 [13:31:28] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.08, 6.20, 5.55 [13:31:57] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.51, 3.30, 3.29 [13:32:08] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.82, 1.98 [13:32:50] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 3.65, 3.69 [13:33:24] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.07, 6.55, 5.76 [13:35:19] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.34, 5.80, 5.58 [13:35:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.49, 3.53, 3.31 [13:35:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.50, 3.40 [13:38:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.95, 3.87 [13:40:50] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.33, 4.57, 4.11 [13:45:43] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.02, 3.67, 3.54 [13:45:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.25, 3.40, 3.36 [13:47:29] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.93, 3.66 [13:47:46] RECOVERY - mon111 NTP time on mon111 is OK: NTP OK: Offset -0.005997091532 secs [13:47:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.43, 2.04, 1.92 [13:47:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.38, 1.82, 1.99 [13:49:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.32, 3.92, 3.58 [13:49:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.13, 1.99, 2.03 [13:50:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.18, 6.90, 5.95 [13:50:58] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 5.43, 3.88, 3.19 [13:51:26] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 4.14, 3.81 [13:52:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.57, 7.21, 6.19 [13:52:56] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.81, 3.71, 3.21 [13:53:24] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.33, 3.50, 3.62 [13:53:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.45, 3.48, 3.51 [13:54:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.82, 6.70, 6.13 [13:54:53] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.97, 3.37, 3.14 [13:55:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.91, 1.94 [13:57:20] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.70, 4.18, 3.84 [13:57:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.26, 3.96, 3.65 [13:59:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.90, 3.76, 3.61 [14:00:42] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 4.18, 3.62, 3.28 [14:01:17] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.79, 3.71, 3.75 [14:01:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.70, 4.17, 3.75 [14:02:39] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 3.18, 3.39, 3.24 [14:03:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.77, 3.65 [14:07:11] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.07, 3.63, 3.69 [14:07:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.07, 3.52, 3.54 [14:09:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.62, 3.32, 3.57 [14:09:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.48, 3.52 [14:09:56] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.34, 1.50, 1.70 [14:11:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.58, 4.13, 3.74 [14:13:06] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.55, 4.09, 3.79 [14:13:25] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.78, 3.58, 3.34 [14:13:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.10, 1.83, 1.79 [14:15:23] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.40, 3.28, 3.26 [14:17:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.39, 3.86, 3.78 [14:19:33] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.72, 4.08, 3.86 [14:20:02] [02miraheze/mw-config] 07dependabot[bot] pushed 031 commit to 03dependabot/github_actions/technote-space/workflow-conclusion-action-3 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/1b0d82e441b3 [14:20:03] [02miraheze/mw-config] 07dependabot[bot] 031b0d82e - Bump technote-space/workflow-conclusion-action from 2 to 3 [14:20:05] [02mw-config] 07dependabot[bot] opened pull request 03#4727: Bump technote-space/workflow-conclusion-action from 2 to 3 - 13https://github.com/miraheze/mw-config/pull/4727 [14:20:05] [url] Page not found · GitHub · GitHub | github.com [14:20:06] [02mw-config] 07dependabot[bot] created branch 03dependabot/github_actions/technote-space/workflow-conclusion-action-3 - 13https://github.com/miraheze/mw-config [14:20:06] [url] Page not found · GitHub · GitHub | github.com [14:20:08] [02mw-config] 07dependabot[bot] labeled pull request 03#4727: Bump technote-space/workflow-conclusion-action from 2 to 3 - 13https://github.com/miraheze/mw-config/pull/4727 [14:20:08] [url] Page not found · GitHub · GitHub | github.com [14:20:09] [02mw-config] 07dependabot[bot] labeled pull request 03#4727: Bump technote-space/workflow-conclusion-action from 2 to 3 - 13https://github.com/miraheze/mw-config/pull/4727 [14:20:09] [url] Page not found · GitHub · GitHub | github.com [14:20:55] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.13, 7.21, 6.47 [14:21:08] miraheze/mw-config - dependabot[bot] the build passed. [14:21:12] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.16, 3.75, 3.50 [14:21:20] [02mw-config] 07RhinosF1 closed pull request 03#4727: Bump technote-space/workflow-conclusion-action from 2 to 3 - 13https://github.com/miraheze/mw-config/pull/4727 [14:21:20] [url] Page not found · GitHub · GitHub | github.com [14:21:21] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/e0142712f208...f894b52fbe03 [14:21:22] [url] Comparing e0142712f208...f894b52fbe03 · miraheze/mw-config · GitHub | github.com [14:21:23] [02miraheze/mw-config] 07dependabot[bot] 03f894b52 - Bump technote-space/workflow-conclusion-action from 2 to 3 (#4727) [14:21:24] [02mw-config] 07RhinosF1 deleted branch 03dependabot/github_actions/technote-space/workflow-conclusion-action-3 - 13https://github.com/miraheze/mw-config [14:21:24] ... [14:21:26] [02miraheze/mw-config] 07RhinosF1 deleted branch 03dependabot/github_actions/technote-space/workflow-conclusion-action-3 [14:21:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.89, 1.85, 1.95 [14:22:28] miraheze/mw-config - RhinosF1 the build passed. [14:22:51] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.08, 7.18, 6.54 [14:22:51] !log [@mwtask111] starting deploy of {'config': True} to all [14:23:09] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.58, 3.33, 3.37 [14:23:21] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 29s [14:23:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:23:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.39, 1.92, 1.96 [14:24:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:27:57] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 1.71, 2.07, 1.69 [14:28:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.06, 6.59, 6.47 [14:29:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.30, 1.78, 1.97 [14:29:56] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.43, 1.77, 1.62 [14:31:55] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.21, 1.94, 1.70 [14:32:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.92, 7.38, 6.84 [14:35:54] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.04, 1.57, 1.61 [14:36:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.42, 7.63, 7.02 [14:37:14] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.31, 9.85, 8.66 [14:37:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.90, 1.95 [14:38:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.08, 7.58, 7.08 [14:39:42] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.44, 3.55, 3.41 [14:41:14] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.05, 9.40, 8.77 [14:41:39] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 3.12, 3.36, 3.35 [14:42:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.71, 7.88, 7.26 [14:42:45] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [14:44:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.37, 7.60, 7.24 [14:46:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.23, 7.70, 7.31 [14:48:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.28, 7.52, 7.29 [14:50:07] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [14:51:27] !log [@test101] starting deploy of {'config': True} to all [14:51:28] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [14:51:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:51:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:54:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.45, 6.13, 6.73 [14:55:07] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [15:01:58] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.85, 2.58, 1.66 [15:05:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.20, 1.88, 1.58 [15:05:57] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.18, 2.54, 1.76 [15:07:30] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.82, 6.86, 6.58 [15:07:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.79, 1.50, 1.48 [15:09:57] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.26, 1.75, 1.61 [15:10:39] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.45, 1.77, 1.43 [15:11:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.78, 1.98 [15:11:57] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.92, 1.53, 1.55 [15:12:38] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.45, 1.62, 1.41 [15:13:17] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.04, 7.33, 6.83 [15:13:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.70, 10.09, 9.54 [15:13:51] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.09, 9.84, 8.71 [15:15:12] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.66, 6.69, 6.65 [15:15:17] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.08, 9.27, 9.30 [15:15:50] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.56, 8.93, 8.51 [15:17:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.19, 1.88, 1.94 [15:23:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 2.24, 1.73 [15:23:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.44, 1.91, 1.97 [15:25:50] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.70, 1.59 [15:29:08] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [15:31:32] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:31:44] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:31:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.25, 2.72, 2.00 [15:31:59] PROBLEM - cp20 Stunnel HTTP for mw121 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:32:18] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:32:35] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:33:28] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15617 bytes in 0.244 second response time [15:33:38] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15617 bytes in 0.309 second response time [15:33:55] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:34:00] RECOVERY - cp20 Stunnel HTTP for mw121 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15611 bytes in 5.084 second response time [15:34:02] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:34:40] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 7.224 second response time [15:35:45] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.28, 1.89, 1.83 [15:35:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.37, 1.66, 1.98 [15:37:44] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.95, 1.52, 1.69 [15:37:58] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:38:13] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:38:20] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15617 bytes in 9.492 second response time [15:40:45] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [15:42:02] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15611 bytes in 5.756 second response time [15:42:18] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 5.224 second response time [15:42:19] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15611 bytes in 3.419 second response time [15:42:48] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15603 bytes in 1.357 second response time [15:42:59] [02puppet] 07Universal-Omega reviewed pull request 03#2644 commit - 13https://github.com/miraheze/puppet/pull/2644#discussion_r889061777 [15:42:59] [url] archive puppet-users, create letsencrypt-admins group by Reception123 · Pull Request #2644 · miraheze/puppet · GitHub | github.com [15:43:00] [02puppet] 07Universal-Omega reviewed pull request 03#2644 commit - 13https://github.com/miraheze/puppet/pull/2644#discussion_r889063144 [15:43:01] [url] archive puppet-users, create letsencrypt-admins group by Reception123 · Pull Request #2644 · miraheze/puppet · GitHub | github.com [15:43:15] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.41, 9.80, 9.05 [15:43:41] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.74, 1.76 [15:43:59] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.57, 1.34, 1.67 [15:45:03] [02puppet] 07JohnFLewis reviewed pull request 03#2644 commit - 13https://github.com/miraheze/puppet/pull/2644#discussion_r889065433 [15:45:04] [url] archive puppet-users, create letsencrypt-admins group by Reception123 · Pull Request #2644 · miraheze/puppet · GitHub | github.com [15:45:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.84, 10.15, 9.28 [15:45:41] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.54, 1.68 [15:47:25] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.82, 3.62, 3.10 [15:47:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.92, 2.10, 1.91 [15:48:14] [02puppet] 07Universal-Omega opened pull request 03#2646: letsencrypt: remove index from nginx - 13https://github.com/miraheze/puppet/pull/2646 [15:48:14] [url] Page not found · GitHub · GitHub | github.com [15:49:24] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 5.12, 4.14, 3.35 [15:51:15] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.16, 9.82, 9.46 [15:51:21] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.01, 3.76, 3.31 [15:55:16] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 3.02, 3.26, 3.20 [15:55:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.92, 1.96 [15:57:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 1.97, 1.97 [15:57:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.39, 2.04, 1.88 [15:58:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.93, 7.50, 6.70 [15:59:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.91, 1.94 [15:59:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.24, 1.82, 1.82 [16:00:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.63, 7.66, 6.87 [16:02:59] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.91, 3.57, 3.35 [16:03:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.43, 1.98, 1.95 [16:04:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 11.26, 8.57, 7.34 [16:04:57] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 3.07, 3.24, 3.25 [16:05:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.98, 1.95, 1.94 [16:05:58] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.69, 1.56, 1.68 [16:06:14] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.86, 1.71, 1.48 [16:06:20] [02puppet] 07Universal-Omega opened pull request 03#2647: letsencrypt: fix monitoring alerts (T9326) - 13https://github.com/miraheze/puppet/pull/2647 [16:06:20] [url] Page not found · GitHub · GitHub | github.com [16:07:00] [02puppet] 07Universal-Omega synchronize pull request 03#2647: letsencrypt: fix monitoring alerts (T9326) - 13https://github.com/miraheze/puppet/pull/2647 [16:07:01] [url] Page not found · GitHub · GitHub | github.com [16:08:13] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.16, 1.82, 1.55 [16:10:12] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.51, 1.65, 1.52 [16:11:24] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.54, 10.10, 9.14 [16:11:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.68, 2.27, 1.95 [16:12:41] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.70, 3.39, 3.31 [16:13:23] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.69, 10.94, 9.59 [16:14:38] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 3.40, 3.28, 3.27 [16:17:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.67, 2.06, 1.96 [16:21:15] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.50, 10.49, 9.94 [16:21:19] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.66, 10.16, 9.80 [16:25:15] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.06, 10.93, 10.21 [16:27:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.26, 9.83, 9.53 [16:29:07] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [16:29:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.77, 10.08, 10.09 [16:30:11] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.95, 1.72, 1.45 [16:34:11] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.91, 1.42, 1.40 [16:39:26] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.69, 9.84, 9.83 [16:40:17] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.57, 9.87, 9.45 [16:42:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.13, 7.31, 7.94 [16:44:18] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.31, 1.81, 1.47 [16:44:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 7.55, 7.69, 8.01 [16:46:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.88, 6.92, 7.69 [16:48:16] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.55, 1.65, 1.48 [16:48:17] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.49, 9.90, 9.67 [16:51:48] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.84, 9.79, 9.42 [16:53:44] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.50, 9.74, 9.45 [16:56:12] [02mw-config] 07ugochimobi opened pull request 03#4728: T9328: set base of wgMinervaShowCategories to true for criticalrolewiki - 13https://github.com/miraheze/mw-config/pull/4728 [16:56:12] [url] Page not found · GitHub · GitHub | github.com [16:56:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.10, 7.54, 7.49 [16:57:21] miraheze/mw-config - ugochimobi the build passed. [16:58:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.79, 7.14, 7.35 [17:00:38] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [17:01:36] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:01:51] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:03:34] Paged [17:03:36] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15617 bytes in 1.430 second response time [17:03:45] PROBLEM - prometheus101 Current Load on prometheus101 is CRITICAL: CRITICAL - load average: 2.06, 1.54, 0.86 [17:03:51] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 0.465 second response time [17:03:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.12, 1.54, 1.92 [17:05:38] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk[Grafana] !sre RESOLVED: MediaWiki Exception Rate https://grafana.miraheze.org/d/GtxbP1Xnk [17:05:44] RECOVERY - prometheus101 Current Load on prometheus101 is OK: OK - load average: 1.03, 1.28, 0.84 [17:05:50] No idea why job queue alerted [17:05:59] CosmicAlpha: that alert is a false positive ^ [17:06:08] We're under the limit and it's too quick anyway [17:06:24] We are out of workers though [17:06:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.01, 5.63, 6.55 [17:06:49] RhinosF1: because of prometheus load, check was to slow and non responsive I think. [17:07:12] CosmicAlpha: that's fun [17:08:22] CosmicAlpha: ye it's resolved [17:08:45] CosmicAlpha: could DB load have affected Prometheus [17:10:04] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:10:17] I can't see any useful data because it's missing [17:11:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.04, 1.72, 1.84 [17:12:05] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15611 bytes in 1.830 second response time [17:12:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.20, 6.60, 6.62 [17:13:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.52, 1.68, 1.81 [17:13:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.54, 1.73, 1.96 [17:14:21] PROBLEM - wiki.mostly.vet - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.mostly.vet' expires in 15 day(s) (Sun 19 Jun 2022 16:50:55 GMT +0000). [17:14:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.33, 5.99, 6.39 [17:17:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.13, 1.89, 1.86 [17:17:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.18, 2.00, 2.02 [17:22:17] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.52, 3.49, 3.12 [17:23:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.86, 1.97, 2.00 [17:24:15] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.74, 3.16, 3.03 [17:25:56] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.48, 1.94, 1.97 [17:25:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.01, 2.33, 2.13 [17:28:31] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/CentralAuth/schema/mysql/db_patches/patch-global_edit_count.sql [17:28:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:29:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.43, 1.85, 1.97 [17:30:09] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/CentralAuth/schema/mysql/db_patches/patch-globaluser-gu_enabled.sql [17:30:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:31:10] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/CentralAuth/schema/mysql/db_patches/patch-globaluser-timestamp.sql [17:31:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:32:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.48, 7.37, 6.81 [17:33:57] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.80, 10.77, 9.75 [17:34:38] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.10, 6.64, 6.62 [17:35:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.70, 2.42, 2.14 [17:36:03] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/CentralAuth/schema/mysql/db_patches/patch-gu_hidden_normalize.sql [17:36:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:36:32] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/CentralAuth/schema/mysql/db_patches/patch-localuser-lu_attached_timestamp.sql [17:36:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:37:32] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/CentralAuth/schema/mysql/db_patches/patch-renameuser_queue-timestamp.sql [17:37:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:39:46] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.24, 9.60, 9.58 [17:39:52] Ty CosmicAlpha [17:40:38] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [17:41:56] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.27, 1.88, 1.84 [17:41:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.56, 1.84, 1.97 [17:42:38] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.46, 6.99, 6.78 [17:43:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.64, 2.52, 2.20 [17:44:41] You're welcome RhinosF1 [17:44:55] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/extensions/FlaggedRevs/backend/schema/mysql/patch-drop-fr_img.sql [17:45:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:45:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.26, 10.13, 9.77 [17:45:41] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/extensions/FlaggedRevs/backend/schema/mysql/patch-flaggedtemplates-fr_title.sql [17:45:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:46:56] [02puppet] 07Reception123 closed pull request 03#2646: letsencrypt: remove index from nginx - 13https://github.com/miraheze/puppet/pull/2646 [17:46:56] [url] Page not found · GitHub · GitHub | github.com [17:46:57] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/c6bdc48ce436...74ce2f87c1ce [17:46:57] [url] Comparing c6bdc48ce436...74ce2f87c1ce · miraheze/puppet · GitHub | github.com [17:46:59] [02miraheze/puppet] 07Universal-Omega 0374ce2f8 - letsencrypt: remove index from nginx (#2646) [17:47:06] [02puppet] 07Reception123 closed pull request 03#2647: letsencrypt: fix monitoring alerts (T9326) - 13https://github.com/miraheze/puppet/pull/2647 [17:47:06] ... [17:47:07] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/74ce2f87c1ce...6411bdf86917 [17:47:08] [url] Comparing 74ce2f87c1ce...6411bdf86917 · miraheze/puppet · GitHub | github.com [17:47:09] [02miraheze/puppet] 07Universal-Omega 036411bdf - letsencrypt: fix monitoring alerts (T9326) (#2647) [17:48:42] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/extensions/TimedMediaHandler/sql/patch-transcode-transcode_timestamp.sql [17:48:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:49:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.75, 9.38, 9.60 [17:51:34] PROBLEM - matomo101 Current Load on matomo101 is WARNING: WARNING - load average: 3.75, 3.44, 3.20 [17:51:59] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.43, 1.82, 1.99 [17:52:02] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/extensions/Wikibase/repo/sql/mysql/archives/patch-wb_changes-change_object_id-index.sql [17:52:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:52:52] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.78, 1.72, 1.34 [17:53:13] RECOVERY - cp30 Stunnel HTTP for puppet111 on cp30 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.240 second response time [17:53:31] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 3.12, 3.40, 3.22 [17:53:59] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.59, 2.11, 2.07 [17:54:38] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.17, 7.80, 7.22 [17:54:51] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.17, 1.53, 1.31 [17:56:39] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --query "DROP TABLE IF EXISTS wb_changes_dispatch;" [17:56:48] RECOVERY - cp20 Stunnel HTTP for puppet111 on cp20 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.149 second response time [17:56:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:58:14] RECOVERY - cp21 Stunnel HTTP for puppet111 on cp21 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.012 second response time [17:59:29] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/extensions/WikiLove/patches/patch-wikilove_log-cleanup.sql [17:59:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:01:12] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/extensions/AbuseFilter/db_patches/mysql/patch-remove-afl_filter.sql [18:01:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:06:42] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/extensions/CheckUser/archives/patch-cu_changes-actor-comment.sql [18:06:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:07] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.10, 7.52, 7.74 [18:07:40] !log [universalomega@test101] sudo -u www-data php /srv/mediawiki/w/extensions/CheckUser/maintenance/fixTrailingSpacesInLogs.php --wiki=betawiki (END - exit=0) [18:08:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:09:01] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.02, 7.52, 7.70 [18:10:38] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/GlobalBlocking/sql/mysql/patch-add-gb_by_central_id.sql [18:10:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:11:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.07, 7.23, 7.57 [18:11:13] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/GlobalBlocking/sql/mysql/patch-globalblocks-gb_anon_only.sql [18:11:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:12:12] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.08, 1.54, 1.08 [18:12:17] [02puppet] 07MacFan4000 closed pull request 03#2645: ssl-acme: skip checking the host key - 13https://github.com/miraheze/puppet/pull/2645 [18:12:17] [url] Page not found · GitHub · GitHub | github.com [18:12:21] [02puppet] 07MacFan4000 reopened pull request 03#2645: ssl-acme: skip checking the host key - 13https://github.com/miraheze/puppet/pull/2645 [18:12:21] ... [18:12:57] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:13:20] !log [universalomega@test101] sudo -u www-data php /srv/mediawiki/w/extensions/GlobalBlocking/maintenance/PopulateCentralId.php --wiki=betawiki (END - exit=0) [18:13:39] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:14:07] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.28, 1.36, 1.07 [18:14:39] Reception123, RhinosF1: That is all SQL I could find for 1.38. May have missed something though. [18:14:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:14:58] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15603 bytes in 6.273 second response time [18:15:06] Thanks CosmicAlpha ! [18:15:29] You're welcome! [18:15:50] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:28] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:43] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:17:00] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.55, 6.94, 7.25 [18:17:07] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [18:17:09] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:17:15] [02puppet] 07MacFan4000 commented on pull request 03#2645: ssl-acme: skip checking the host key - 13https://github.com/miraheze/puppet/pull/2645#issuecomment-1146238328 [18:17:16] [url] ssl-acme: skip checking the host key by MacFan4000 · Pull Request #2645 · miraheze/puppet · GitHub | github.com [18:17:16] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:17:45] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15603 bytes in 0.020 second response time [18:17:55] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22337 bytes in 9.331 second response time [18:18:07] [02puppet] 07MacFan4000 edited a comment on pull request 03#2645: ssl-acme: skip checking the host key - 13https://github.com/miraheze/puppet/pull/2645#issuecomment-1146238328 [18:18:07] [url] ssl-acme: skip checking the host key by MacFan4000 · Pull Request #2645 · miraheze/puppet · GitHub | github.com [18:19:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.15, 6.66, 7.12 [18:21:00] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.68, 7.24, 7.26 [18:21:30] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15611 bytes in 9.393 second response time [18:22:07] RECOVERY - cp31 Stunnel HTTP for puppet111 on cp31 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.254 second response time [18:23:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.77, 6.55, 7.01 [18:23:26] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15611 bytes in 8.008 second response time [18:24:48] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15603 bytes in 0.844 second response time [18:24:48] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15611 bytes in 0.185 second response time [18:25:00] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.62, 5.95, 6.74 [18:25:10] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.61, 2.85, 1.87 [18:25:47] [02puppet] 07RhinosF1 commented on pull request 03#2645: ssl-acme: skip checking the host key - 13https://github.com/miraheze/puppet/pull/2645#issuecomment-1146245213 [18:25:48] [url] ssl-acme: skip checking the host key by MacFan4000 · Pull Request #2645 · miraheze/puppet · GitHub | github.com [18:27:10] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 2.38, 2.61, 1.90 [18:39:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.81, 1.25, 1.91 [18:39:42] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.81, 6.92, 6.72 [18:41:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.36, 1.53, 1.92 [18:41:36] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.33, 6.74, 6.68 [18:42:50] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [18:47:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.18, 1.76, 1.95 [18:49:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.56, 2.19, 2.09 [18:51:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.24, 1.85, 1.97 [18:57:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.89, 2.09, 2.03 [18:59:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.28, 9.56, 9.33 [19:01:54] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.48, 10.97, 9.60 [19:03:43] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.86, 9.81, 9.48 [19:03:53] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.49, 10.72, 9.67 [19:05:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.21, 1.79, 1.97 [19:05:56] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.86, 9.78, 9.46 [19:07:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.58, 10.34, 9.82 [19:08:50] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures [19:09:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.92, 1.88, 1.92 [19:09:43] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.29, 9.95, 9.77 [19:12:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.66, 10.03, 9.20 [19:14:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.24, 10.13, 9.36 [19:15:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.32, 1.90, 1.94 [19:18:22] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [19:18:22] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:21:48] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.29, 7.16, 6.80 [19:22:07] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [19:22:48] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.62, 1.73, 1.34 [19:23:59] RECOVERY - wiki.chippyapps.com - reverse DNS on sslhost is OK: SSL OK - wiki.chippyapps.com reverse DNS resolves to cp21.miraheze.org - CNAME OK [19:24:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.01, 1.46, 1.29 [19:25:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.08, 1.66, 1.76 [19:29:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.36, 1.68, 1.77 [19:35:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.28, 1.80, 1.79 [19:35:27] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 2.59, 1.88, 1.34 [19:36:21] [02miraheze/.github] 07dependabot[bot] pushed 031 commit to 03dependabot/github_actions/workflow-templates/technote-space/workflow-conclusion-action-3 [+0/-0/±1] 13https://github.com/miraheze/.github/commit/a5f2b81a073c [19:36:22] [02miraheze/.github] 07dependabot[bot] 03a5f2b81 - Bump technote-space/workflow-conclusion-action in /workflow-templates [19:36:24] [02.github] 07dependabot[bot] created branch 03dependabot/github_actions/workflow-templates/technote-space/workflow-conclusion-action-3 - 13https://github.com/miraheze/.github [19:36:25] [02.github] 07dependabot[bot] opened pull request 03#10: Bump technote-space/workflow-conclusion-action from 2 to 3 in /workflow-templates - 13https://github.com/miraheze/.github/pull/10 [19:36:25] [url] Page not found · GitHub · GitHub | github.com [19:36:27] [02.github] 07dependabot[bot] labeled pull request 03#10: Bump technote-space/workflow-conclusion-action from 2 to 3 in /workflow-templates - 13https://github.com/miraheze/.github/pull/10 [19:36:27] [url] Page not found · GitHub · GitHub | github.com [19:37:07] [02miraheze/.github] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/.github/compare/3bca4264a733...df9b876461e7 [19:37:07] [url] Comparing 3bca4264a733...df9b876461e7 · miraheze/.github · GitHub | github.com [19:37:08] [02miraheze/.github] 07dependabot[bot] 03df9b876 - Bump technote-space/workflow-conclusion-action in /workflow-templates (#10) [19:37:10] [02.github] 07Universal-Omega closed pull request 03#10: Bump technote-space/workflow-conclusion-action from 2 to 3 in /workflow-templates - 13https://github.com/miraheze/.github/pull/10 [19:37:10] [url] Page not found · GitHub · GitHub | github.com [19:37:11] [02miraheze/.github] 07Universal-Omega deleted branch 03dependabot/github_actions/workflow-templates/technote-space/workflow-conclusion-action-3 [19:37:13] [02.github] 07Universal-Omega deleted branch 03dependabot/github_actions/workflow-templates/technote-space/workflow-conclusion-action-3 - 13https://github.com/miraheze/.github [19:37:26] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/30397c0b7f12...db901491787a [19:37:26] [url] Comparing 30397c0b7f12...db901491787a · miraheze/CreateWiki · GitHub | github.com [19:37:27] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.51, 1.79, 1.37 [19:37:27] [02miraheze/CreateWiki] 07Universal-Omega 03db90149 - Update workflow [19:37:29] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/b50590360c16...4f11c37b89fe [19:37:29] [url] Comparing b50590360c16...4f11c37b89fe · miraheze/DataDump · GitHub | github.com [19:37:30] [02miraheze/DataDump] 07Universal-Omega 034f11c37 - Update workflow [19:37:32] [02miraheze/CustomHeader] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CustomHeader/compare/2771c57eb706...af912f52ebd5 [19:37:32] [url] Comparing 2771c57eb706...af912f52ebd5 · miraheze/CustomHeader · GitHub | github.com [19:37:33] [02miraheze/CustomHeader] 07Universal-Omega 03af912f5 - Update workflow [19:37:35] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/372ab616fbc3...8d03a49872f4 [19:37:35] [url] Comparing 372ab616fbc3...8d03a49872f4 · miraheze/ManageWiki · GitHub | github.com [19:37:36] [02miraheze/ManageWiki] 07Universal-Omega 038d03a49 - Update workflow [19:37:38] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/7501dcf9ba22...4d8930dba349 [19:37:38] [url] Comparing 7501dcf9ba22...4d8930dba349 · miraheze/IncidentReporting · GitHub | github.com [19:37:39] [02miraheze/IncidentReporting] 07Universal-Omega 034d8930d - Update workflow [19:37:41] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/2e1f2cd65e7b...39af2839367c [19:37:41] [url] Comparing 2e1f2cd65e7b...39af2839367c · miraheze/RemovePII · GitHub | github.com [19:37:42] [02miraheze/RemovePII] 07Universal-Omega 0339af283 - Update workflow [19:37:44] [02miraheze/PDFEmbed] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/a06c03fe6183...43b8b461502c [19:37:44] [url] Comparing a06c03fe6183...43b8b461502c · miraheze/PDFEmbed · GitHub | github.com [19:37:45] [02miraheze/PDFEmbed] 07Universal-Omega 0343b8b46 - Update workflow [19:37:47] [02miraheze/YouTube] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/YouTube/compare/1ec02476605d...c1cfc2c8a954 [19:37:47] [url] Comparing 1ec02476605d...c1cfc2c8a954 · miraheze/YouTube · GitHub | github.com [19:37:48] [02miraheze/YouTube] 07Universal-Omega 03c1cfc2c - Update workflow [19:37:50] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/0e9a33907e4e...ce2084182e49 [19:37:50] [url] Comparing 0e9a33907e4e...ce2084182e49 · miraheze/MirahezeMagic · GitHub | github.com [19:37:51] [02miraheze/MirahezeMagic] 07Universal-Omega 03ce20841 - Update workflow [19:37:53] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/2b32eb5751c8...1264123b9ed2 [19:37:53] [url] Comparing 2b32eb5751c8...1264123b9ed2 · miraheze/MatomoAnalytics · GitHub | github.com [19:37:54] [02miraheze/MatomoAnalytics] 07Universal-Omega 031264123 - Update workflow [19:37:56] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/d5a661229867...35e7c4f4fcab [19:37:56] [url] Comparing d5a661229867...35e7c4f4fcab · miraheze/GlobalNewFiles · GitHub | github.com [19:37:57] [02miraheze/GlobalNewFiles] 07Universal-Omega 0335e7c4f - Update workflow [19:37:59] [02miraheze/RottenLinks] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RottenLinks/compare/9643ad29c27f...4b51d7e74391 [19:37:59] [url] Comparing 9643ad29c27f...4b51d7e74391 · miraheze/RottenLinks · GitHub | github.com [19:38:00] [02miraheze/RottenLinks] 07Universal-Omega 034b51d7e - Update workflow [19:38:02] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/4acc72cd1dc3...cb3b1571130f [19:38:02] [url] Comparing 4acc72cd1dc3...cb3b1571130f · miraheze/WikiDiscover · GitHub | github.com [19:38:03] [02miraheze/WikiDiscover] 07Universal-Omega 03cb3b157 - Update workflow [19:38:38] [02miraheze/SpriteSheet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/4a6b7e54be8e...7933643b42c2 [19:38:38] [url] Comparing 4a6b7e54be8e...7933643b42c2 · miraheze/SpriteSheet · GitHub | github.com [19:38:39] [02miraheze/SpriteSheet] 07Universal-Omega 037933643 - Update workflow [19:39:00] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.30, 8.29, 7.49 [19:39:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.64, 1.73, 1.77 [19:39:27] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.30, 1.68, 1.38 [19:41:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.39, 2.02, 1.88 [19:47:08] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [19:49:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.40, 1.86, 1.92 [19:51:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.67, 2.24, 2.05 [19:51:28] miraheze/MirahezeMagic - Universal-Omega the build has errored. [19:51:53] I'll fix that in a minute. [19:53:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 5.96, 7.58, 7.72 [19:59:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.36, 1.75, 1.91 [19:59:23] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:25] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:48] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:59:59] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:00:10] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:02:22] miraheze/CreateWiki - Universal-Omega the build passed. [20:03:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.88, 1.25, 1.66 [20:03:55] miraheze/CustomHeader - Universal-Omega the build passed. [20:04:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.40, 10.21, 9.61 [20:05:27] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.93, 10.25, 9.37 [20:05:30] miraheze/ManageWiki - Universal-Omega the build passed. [20:05:53] miraheze/PDFEmbed - Universal-Omega the build passed. [20:06:09] miraheze/WikiDiscover - Universal-Omega the build passed. [20:06:15] miraheze/RemovePII - Universal-Omega the build passed. [20:06:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.29, 9.80, 9.55 [20:06:18] miraheze/IncidentReporting - Universal-Omega the build passed. [20:06:24] miraheze/DataDump - Universal-Omega the build passed. [20:06:28] miraheze/SpriteSheet - Universal-Omega the build passed. [20:06:33] miraheze/YouTube - Universal-Omega the build passed. [20:06:40] miraheze/RottenLinks - Universal-Omega the build passed. [20:06:46] miraheze/MatomoAnalytics - Universal-Omega the build passed. [20:06:49] miraheze/GlobalNewFiles - Universal-Omega the build passed. [20:07:26] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.64, 9.10, 9.05 [20:07:39] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15603 bytes in 8.926 second response time [20:07:50] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15603 bytes in 8.016 second response time [20:08:13] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15603 bytes in 6.347 second response time [20:08:53] [discord] what's up? [20:09:00] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.94, 5.49, 6.58 [20:11:57] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:12:12] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:12:31] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 9.914 second response time [20:12:35] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:13:59] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.63, 3.15, 2.41 [20:14:01] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15611 bytes in 9.544 second response time [20:16:46] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15617 bytes in 7.300 second response time [20:18:28] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15603 bytes in 3.370 second response time [20:18:59] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15617 bytes in 0.032 second response time [20:19:52] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 2.94, 3.22, 2.71 [20:20:08] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [20:23:01] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.05, 6.72, 6.49 [20:24:04] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.05, 1.96, 1.58 [20:25:00] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.94, 6.75, 6.55 [20:26:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.77, 1.91, 1.61 [20:27:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.99, 1.58, 1.47 [20:27:16] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.52, 9.88, 8.90 [20:27:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.37, 10.01, 9.74 [20:28:01] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.40, 1.70, 1.57 [20:29:00] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.34, 7.20, 6.76 [20:29:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.26, 1.40, 1.42 [20:29:15] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.33, 9.32, 8.79 [20:29:43] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.18, 10.80, 10.06 [20:30:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.87, 9.83, 8.58 [20:31:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.79, 6.96, 6.72 [20:31:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.93, 10.85, 10.17 [20:32:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.15, 9.42, 8.59 [20:32:44] [02miraheze/ssl] 07dependabot[bot] pushed 031 commit to 03dependabot/github_actions/technote-space/workflow-conclusion-action-3 [+0/-0/±1] 13https://github.com/miraheze/ssl/commit/fca661f19a19 [20:32:46] [02miraheze/ssl] 07dependabot[bot] 03fca661f - Bump technote-space/workflow-conclusion-action from 2 to 3 [20:32:47] [02ssl] 07dependabot[bot] created branch 03dependabot/github_actions/technote-space/workflow-conclusion-action-3 - 13https://github.com/miraheze/ssl [20:32:47] [url] Page not found · GitHub · GitHub | github.com [20:32:49] [02ssl] 07dependabot[bot] opened pull request 03#542: Bump technote-space/workflow-conclusion-action from 2 to 3 - 13https://github.com/miraheze/ssl/pull/542 [20:32:49] [url] Page not found · GitHub · GitHub | github.com [20:32:50] [02ssl] 07dependabot[bot] labeled pull request 03#542: Bump technote-space/workflow-conclusion-action from 2 to 3 - 13https://github.com/miraheze/ssl/pull/542 [20:32:50] [url] Page not found · GitHub · GitHub | github.com [20:33:00] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.77, 6.59, 6.62 [20:33:12] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.41, 1.76, 1.59 [20:35:43] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.07, 11.39, 10.52 [20:37:43] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.53, 10.14, 10.17 [20:39:09] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.18, 11.09, 9.95 [20:39:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.52, 1.28, 1.47 [20:41:08] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.66, 10.36, 9.81 [20:41:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.30, 10.18, 10.18 [20:42:50] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [20:43:43] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.38, 9.98, 10.12 [20:45:06] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.53, 9.96, 9.80 [20:45:25] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.08, 10.97, 9.57 [20:47:22] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.60, 10.12, 9.44 [20:52:21] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.17, 6.88, 6.70 [20:54:15] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.40, 6.58, 6.60 [20:55:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.37, 9.93, 9.56 [20:57:43] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.92, 9.85, 9.57 [20:58:28] PROBLEM - matomo101 Current Load on matomo101 is CRITICAL: CRITICAL - load average: 4.09, 3.63, 3.28 [21:00:27] RECOVERY - matomo101 Current Load on matomo101 is OK: OK - load average: 2.57, 3.21, 3.17 [21:04:42] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.07, 6.68, 6.51 [21:06:36] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.86, 6.77, 6.56 [21:08:30] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.62, 6.37, 6.45 [21:10:08] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [21:10:50] RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:23:42] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.86, 7.08, 6.63 [21:25:33] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.37, 1.79, 1.43 [21:27:27] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.40, 1.81, 1.50 [21:29:21] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.38, 1.69, 1.48 [21:35:05] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.26, 7.46, 7.05 [21:37:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.18, 7.22, 7.03 [21:40:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.53, 3.21, 3.90 [21:40:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.72, 3.56, 4.00 [21:41:00] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.78, 6.45, 6.76 [21:42:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.37, 3.88, 4.08 [21:42:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.17, 3.68, 3.99 [21:51:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.54, 7.22, 7.00 [21:53:00] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.41, 7.36, 7.06 [21:55:11] PROBLEM - test101 Puppet on test101 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg] [21:57:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.96, 7.72, 7.27 [21:57:12] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.15, 1.76, 1.40 [21:59:12] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.87, 1.42, 1.32 [22:01:56] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.79, 2.15, 1.67 [22:03:28] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.74, 10.21, 9.13 [22:03:55] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.87, 1.96, 1.65 [22:05:28] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.57, 9.40, 8.95 [22:05:54] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.80, 1.56, 1.54 [22:06:43] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.45, 10.38, 9.66 [22:10:32] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.15, 9.38, 9.46 [22:14:46] [discord] I think I'm gonna help with T9163 [22:15:03] [discord] Finally might be able to test extensions :p [22:18:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.13, 3.33, 3.96 [22:19:00] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.37, 5.72, 6.47 [22:21:42] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.39, 1.61, 1.38 [22:21:53] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-15/±0] 13https://github.com/miraheze/landing/commit/b5e8226f1ff6 [22:21:53] [url] Page not found · GitHub · GitHub | github.com [22:21:54] [02miraheze/landing] 07Universal-Omega 03b5e8226 - Delete webfonts directory [22:21:56] [02landing] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/landing [22:21:56] [url] Page not found · GitHub · GitHub | github.com [22:22:08] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-6/±0] 13https://github.com/miraheze/landing/compare/b5e8226f1ff6...6383024ad705 [22:22:08] [url] Comparing b5e8226f1ff6...6383024ad705 · miraheze/landing · GitHub | github.com [22:22:10] [02miraheze/landing] 07Universal-Omega 036383024 - Delete js directory [22:22:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.02, 3.86, 4.00 [22:22:20] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-1/±0] 13https://github.com/miraheze/landing/compare/6383024ad705...7c65c9c0b39d [22:22:21] [url] Comparing 6383024ad705...7c65c9c0b39d · miraheze/landing · GitHub | github.com [22:22:22] [02miraheze/landing] 07Universal-Omega 037c65c9c - Delete all.min.css [22:22:30] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-1/±0] 13https://github.com/miraheze/landing/compare/7c65c9c0b39d...d4bee1784074 [22:22:30] [url] Comparing 7c65c9c0b39d...d4bee1784074 · miraheze/landing · GitHub | github.com [22:22:32] [02miraheze/landing] 07Universal-Omega 03d4bee17 - Delete miraheze.min.css [22:22:41] RECOVERY - test101 Puppet on test101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [22:23:22] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/landing/compare/d4bee1784074...ce861055ce6a [22:23:22] [url] Comparing d4bee1784074...ce861055ce6a · miraheze/landing · GitHub | github.com [22:23:23] [02miraheze/landing] 07Universal-Omega 03ce86105 - Create styles.css [22:23:41] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.07, 1.35, 1.31 [22:24:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.72, 3.92 [22:25:19] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/landing/compare/ce861055ce6a...ccc61ef6057a [22:25:19] [url] Comparing ce861055ce6a...ccc61ef6057a · miraheze/landing · GitHub | github.com [22:25:20] [02miraheze/landing] 07Universal-Omega 03ccc61ef - . [22:25:39] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://github.com/miraheze/landing/compare/ccc61ef6057a...1e72d358771e [22:25:40] [url] Comparing ccc61ef6057a...1e72d358771e · miraheze/landing · GitHub | github.com [22:25:41] [02miraheze/landing] 07Universal-Omega 031e72d35 - Add [22:25:52] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-1/±0] 13https://github.com/miraheze/landing/compare/1e72d358771e...79210689646e [22:25:52] [url] Comparing 1e72d358771e...79210689646e · miraheze/landing · GitHub | github.com [22:25:53] [02miraheze/landing] 07Universal-Omega 037921068 - . [22:26:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.73, 3.90 [22:26:39] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/79210689646e...6e58af030cca [22:26:39] [url] Comparing 79210689646e...6e58af030cca · miraheze/landing · GitHub | github.com [22:26:40] [02miraheze/landing] 07Universal-Omega 036e58af0 - Update styles.css [22:29:41] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/6e58af030cca...8a9c02acab3d [22:29:41] [url] Comparing 6e58af030cca...8a9c02acab3d · miraheze/landing · GitHub | github.com [22:29:42] [02miraheze/landing] 07Universal-Omega 038a9c02a - Update index.php [22:31:25] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.81, 1.99 [22:34:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.25, 3.50, 3.88 [22:34:54] [discord] ogkgk [22:35:30] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 6.86, 6.53, 6.37 [22:37:24] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.77, 6.47, 6.36 [22:39:25] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.17, 1.82, 1.90 [22:41:12] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.32, 6.99, 6.60 [22:41:25] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.87, 1.91 [22:42:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.00, 3.23, 3.88 [22:43:06] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.42, 6.78, 6.57 [22:43:35] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [22:43:35] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:47:25] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.48, 1.97, 1.93 [22:50:10] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.22, 2.67, 3.35 [22:51:00] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 10.15, 7.99, 7.07 [22:52:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 3.55, 3.58 [22:54:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.70, 3.20, 3.45 [22:55:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.38, 7.73, 7.18 [22:58:01] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/8a9c02acab3d...a4f1b421ab8b [22:58:02] [url] Comparing 8a9c02acab3d...a4f1b421ab8b · miraheze/landing · GitHub | github.com [22:58:03] [02miraheze/landing] 07Universal-Omega 03a4f1b42 - Update styles.css [22:59:03] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/a4f1b421ab8b...8eafb91fe7b3 [22:59:04] [url] Comparing a4f1b421ab8b...8eafb91fe7b3 · miraheze/landing · GitHub | github.com [22:59:05] [02miraheze/landing] 07Universal-Omega 038eafb91 - Update index.php [23:00:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.65, 3.32, 3.87 [23:02:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.33, 3.18, 3.35 [23:02:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.95, 4.25, 4.16 [23:03:56] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 10.30, 5.96, 3.03 [23:04:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.81, 4.00 [23:05:56] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.94, 5.35, 3.18 [23:06:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.72, 3.93 [23:07:00] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.73, 7.95, 7.36 [23:07:25] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.64, 1.85, 1.98 [23:07:56] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 1.29, 3.82, 2.88 [23:08:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.12, 3.49, 3.82 [23:11:00] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.19, 7.83, 7.47 [23:12:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.32, 3.56, 3.38 [23:12:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.32, 4.02, 3.97 [23:14:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.53, 3.45, 3.36 [23:14:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.06, 3.58, 3.82 [23:16:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.19, 3.93, 3.53 [23:16:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.78, 4.37, 4.10 [23:17:25] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.52, 2.16, 2.05 [23:17:35] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/8eafb91fe7b3...13c01828c578 [23:17:35] [url] Comparing 8eafb91fe7b3...13c01828c578 · miraheze/landing · GitHub | github.com [23:17:36] [02miraheze/landing] 07Universal-Omega 0313c0182 - Update styles.css [23:18:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.38, 3.69, 3.50 [23:18:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.98, 4.16, 3.66 [23:18:25] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/13c01828c578...787cd40fc2ac [23:18:25] [url] Comparing 13c01828c578...787cd40fc2ac · miraheze/landing · GitHub | github.com [23:18:26] [02miraheze/landing] 07Universal-Omega 03787cd40 - Update index.php [23:20:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.39, 3.93, 3.60 [23:24:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.31, 3.74, 3.62 [23:26:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 3.65, 3.58 [23:26:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.84, 3.81 [23:28:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.31, 4.00, 3.87 [23:32:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.77, 3.69, 3.81 [23:33:00] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 4.91, 5.87, 6.66 [23:34:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.94, 4.00, 3.87 [23:36:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.28, 3.64, 3.73 [23:37:27] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/787cd40fc2ac...9ff11a2cd855 [23:37:27] [url] Comparing 787cd40fc2ac...9ff11a2cd855 · miraheze/landing · GitHub | github.com [23:37:28] [02miraheze/landing] 07Universal-Omega 039ff11a2 - Update styles.css [23:40:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.29, 3.55, 3.67 [23:41:06] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [23:42:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.67, 4.00, 3.82 [23:42:24] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/9ff11a2cd855...e96bf94dc4a8 [23:42:24] [url] Comparing 9ff11a2cd855...e96bf94dc4a8 · miraheze/landing · GitHub | github.com [23:42:25] [02miraheze/landing] 07Universal-Omega 03e96bf94 - Update index.php [23:42:50] PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [23:43:56] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/e96bf94dc4a8...5d0b96625dec [23:43:56] [url] Comparing e96bf94dc4a8...5d0b96625dec · miraheze/landing · GitHub | github.com [23:43:57] [02miraheze/landing] 07Universal-Omega 035d0b966 - Update styles.css [23:44:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.19, 4.34, 3.95 [23:46:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.22, 3.89, 3.83 [23:48:10] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.86, 4.62, 4.13 [23:52:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.09, 3.52, 3.86 [23:54:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.78, 3.91 [23:56:10] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.23, 3.74, 3.92 [23:56:19] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.47, 3.77 [23:59:25] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.41, 1.74, 1.95