[00:00:23] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/J4MvB [00:00:25] [02miraheze/ManageWiki] 07Universal-Omega 03a27d1dc - Update ext.managewiki.oouiform.reviewChanges.js [00:00:26] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [00:01:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.32, 7.31, 7.24 [00:01:17] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.86, 7.22, 6.93 [00:01:50] miraheze/ManageWiki - Universal-Omega the build passed. [00:02:11] PROBLEM - you.r-fit.cc - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - you.r-fit.cc All nameservers failed to answer the query. [00:03:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.12, 7.95, 7.21 [00:03:16] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 13.12, 8.78, 7.74 [00:04:01] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.78, 20.72, 18.77 [00:04:14] RECOVERY - cp12 Disk Space on cp12 is OK: DISK OK - free space: / 8187 MB (21% inode=96%); [00:06:02] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 30.82, 23.04, 19.77 [00:06:16] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/J4MJe [00:06:17] [02miraheze/ManageWiki] 07Universal-Omega 03dab5228 - re-word [00:06:19] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [00:07:17] miraheze/ManageWiki - Universal-Omega the build passed. [00:08:03] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.71, 22.33, 19.91 [00:08:25] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/J4MJ2 [00:08:27] [02miraheze/ManageWiki] 07Universal-Omega 0364dec97 - Update ext.managewiki.oouiform.reviewChanges.js [00:08:28] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [00:09:52] miraheze/ManageWiki - Universal-Omega the build passed. [00:11:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.34, 7.85, 7.90 [00:11:23] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/J4MUT [00:11:25] [02miraheze/ManageWiki] 07Universal-Omega 037f1453d - Update ext.managewiki.oouiform.reviewChanges.js [00:11:26] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [00:12:22] miraheze/ManageWiki - Universal-Omega the build passed. [00:12:38] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/J4MU8 [00:12:40] [02miraheze/ManageWiki] 07Universal-Omega 03ec59f05 - Update ext.managewiki.oouiform.reviewChanges.js [00:12:41] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [00:12:53] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.22, 7.59, 7.81 [00:14:48] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.25, 7.79, 7.85 [00:15:08] miraheze/ManageWiki - Universal-Omega the build passed. [00:15:16] PROBLEM - with.cpt-ra.bid - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 148, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 129, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 66, in check_records nameserversans = dns_resolver.query(root_domain, 'NS') File "/usr/lib/python [00:15:16] t-packages/dns/resolver.py", line 898, in query raise NoNameservers(request=request, errors=errors)dns.resolver.NoNameservers: All nameservers failed to answer the query cpt-ra.bid. IN NS: Server 1.1.1.1 UDP port 53 answered SERVFAIL [00:15:58] PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 8 minutes ago with 0 failures [00:16:44] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.75, 7.69, 7.80 [00:18:03] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.20, 20.11, 19.87 [00:18:40] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.98, 7.79, 7.80 [00:18:54] RECOVERY - you.r-fit.cc - LetsEncrypt on sslhost is OK: OK - Certificate 'you.r-fit.cc' will expire on Tue 14 Sep 2021 05:08:07 GMT +0000. [00:19:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.37, 6.82, 7.22 [00:22:02] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.91, 24.16, 21.77 [00:22:09] RECOVERY - with.cpt-ra.bid - reverse DNS on sslhost is OK: SSL OK - with.cpt-ra.bid reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:22:29] RECOVERY - you.r-fit.cc - reverse DNS on sslhost is OK: SSL OK - you.r-fit.cc reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:22:34] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.70, 7.26, 7.64 [00:24:02] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.94, 23.35, 21.76 [00:24:43] RECOVERY - with.cpt-ra.bid - LetsEncrypt on sslhost is OK: OK - Certificate 'with.cpt-ra.bid' will expire on Fri 22 Oct 2021 03:26:46 GMT +0000. [00:25:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.74, 7.02, 7.27 [00:31:14] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.12, 5.74, 6.62 [00:32:22] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.58, 6.05, 6.78 [00:35:15] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.39, 7.83, 7.29 [00:36:07] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [00:36:09] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/J4MLb [00:36:10] [02miraheze/ManageWiki] 07Universal-Omega 03163b816 - Update ext.managewiki.oouiform.reviewChanges.js [00:36:21] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.63, 7.56, 7.39 [00:37:08] miraheze/ManageWiki - Universal-Omega the build passed. [00:37:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.29, 6.89, 7.02 [00:38:07] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 19.09, 19.20, 20.26 [00:42:22] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.82, 6.00, 6.73 [00:45:14] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.48, 6.30, 6.71 [01:05:02] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.78, 9.23, 7.60 [01:05:41] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.59, 8.31, 7.05 [01:07:38] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.89, 7.66, 6.96 [01:13:31] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.46, 8.15, 7.38 [01:17:24] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.35, 8.00, 7.50 [01:18:34] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.48, 7.87, 7.84 [01:19:20] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.67, 8.41, 7.71 [01:20:29] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.92, 9.12, 8.30 [01:24:22] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.91, 7.75, 7.95 [01:29:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.85, 7.95, 7.85 [01:30:20] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.78, 7.46, 7.67 [01:33:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.58, 8.64, 8.07 [01:37:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.07, 7.72, 7.84 [01:39:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.11, 8.28, 8.01 [01:44:21] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.79, 7.45, 7.87 [01:45:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.74, 7.81, 7.89 [01:47:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.46, 8.40, 8.10 [01:53:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.07, 7.53, 7.90 [01:58:20] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.20, 7.23, 7.25 [02:00:21] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.95, 7.14, 7.22 [02:01:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.39, 7.13, 7.45 [02:03:51] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/J4Mgh [02:03:52] [02miraheze/ManageWiki] 07Universal-Omega 0371d2d83 - Update ext.managewiki.oouiform.confirmClose.js [02:03:53] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [02:04:22] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 14.44, 9.53, 8.06 [02:06:07] miraheze/ManageWiki - Universal-Omega the build passed. [02:08:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.69, 7.81, 7.69 [02:08:23] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.90, 6.51, 5.84 [02:10:21] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.07, 6.39, 5.88 [02:13:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.03, 7.56, 7.96 [02:17:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.58, 7.97, 7.99 [02:25:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.39, 7.27, 7.75 [02:26:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.76, 5.96, 6.73 [02:33:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.20, 6.84, 7.26 [02:35:14] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.82, 8.88, 7.58 [02:37:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.96, 7.45, 7.47 [02:39:05] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.85, 7.25, 7.21 [02:39:43] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+1/-1/±0] 13https://git.io/J4MMc [02:39:45] [02miraheze/ManageWiki] 07Universal-Omega 038a0313c - Rename ext.managewiki.oouiform.js to ext.managewiki.oouiform.tabs.js [02:39:46] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [02:40:40] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/J4MM7 [02:40:41] miraheze/ManageWiki - Universal-Omega the build passed. [02:40:41] [02miraheze/ManageWiki] 07Universal-Omega 03670e6a1 - Update extension.json [02:40:43] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [02:41:37] miraheze/ManageWiki - Universal-Omega the build passed. [02:44:54] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.03, 5.84, 6.59 [02:45:14] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.31, 5.53, 6.55 [02:54:39] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.80, 7.71, 6.95 [02:55:15] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.49, 7.95, 7.18 [02:56:35] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.63, 7.82, 7.10 [02:59:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.44, 7.18, 7.10 [03:00:27] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.52, 6.69, 6.80 [03:05:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.10, 8.06, 7.40 [03:09:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.20, 7.36, 7.27 [03:10:21] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.65, 7.26, 6.01 [03:11:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.94, 7.71, 7.39 [03:12:21] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.06, 7.97, 6.42 [03:13:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.80, 7.71, 7.43 [03:16:21] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.53, 7.00, 6.40 [03:18:22] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.15, 6.02, 6.12 [03:20:45] PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 178.96 ms [03:21:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.25, 7.97, 7.65 [03:21:23] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 190.64 ms [03:21:55] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 185.52 ms [03:22:18] PROBLEM - ping6 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 182.73 ms [03:22:45] RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 96.41 ms [03:23:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.38, 7.46, 7.51 [03:23:26] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 91.61 ms [03:23:57] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 90.28 ms [03:24:21] RECOVERY - ping6 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 95.15 ms [03:37:17] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.81, 6.08, 6.68 [03:54:14] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/J4DmB [03:54:15] [02miraheze/ManageWiki] 07Universal-Omega 03b741841 - Update ManageWikiOOUIForm.php [03:54:17] [02ManageWiki] 07Universal-Omega synchronize pull request 03#290: Add review changes dialog - 13https://git.io/J4Xld [03:55:14] miraheze/ManageWiki - Universal-Omega the build passed. [03:55:51] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.91, 6.51, 6.21 [03:57:47] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.49, 6.02, 6.06 [04:05:05] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.19, 7.52, 6.31 [04:05:32] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.38, 7.12, 6.45 [04:07:01] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.00, 6.88, 6.22 [04:08:57] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.83, 6.44, 6.13 [04:13:16] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.36, 6.70, 6.53 [04:21:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.29, 6.87, 6.57 [04:21:57] PROBLEM - ping6 on dbbackup1 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 194.89 ms [04:22:36] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 192.98 ms [04:22:48] PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 196.41 ms [04:23:14] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.06, 6.11, 6.32 [04:23:33] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 180.37 ms [04:24:00] PROBLEM - ping6 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 167.70 ms [04:29:40] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 91.02 ms [04:30:09] RECOVERY - ping6 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 92.90 ms [04:30:40] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 91.33 ms [04:30:46] RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 94.33 ms [04:41:10] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.40, 7.73, 6.83 [04:41:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.90, 8.66, 7.19 [04:43:05] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.45, 7.35, 6.81 [04:43:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.00, 7.86, 7.08 [04:45:01] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.07, 6.69, 6.64 [04:50:54] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.41, 6.79, 6.62 [04:51:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.25, 7.46, 7.10 [04:53:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.87, 7.55, 7.18 [04:55:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.50, 8.19, 7.48 [04:56:45] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.23, 7.06, 6.77 [04:58:40] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.48, 7.21, 6.87 [05:00:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.77, 6.76, 6.75 [05:01:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.51, 7.76, 7.59 [05:03:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.52, 8.75, 7.96 [05:06:27] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.49, 7.36, 7.07 [05:07:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.22, 7.88, 7.85 [05:10:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.46, 6.52, 6.77 [05:12:22] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://git.io/J4D14 [05:12:24] [02miraheze/puppet] 07Reception123 037e52833 - add private key for OAuth2 [05:12:25] [02puppet] 07Reception123 created branch 03Reception123-patch-2 - 13https://git.io/vbiAS [05:12:27] [02puppet] 07Reception123 opened pull request 03#1822: add private key for OAuth2 - 13https://git.io/J4D1R [05:15:14] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.73, 5.52, 6.72 [05:19:01] [02puppet] 07Reception123 closed pull request 03#1822: add private key for OAuth2 - 13https://git.io/J4D1R [05:19:02] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J4Dye [05:19:04] [02miraheze/puppet] 07Reception123 03b608eb6 - add private key for OAuth2 (#1822) [05:35:41] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.75, 6.87, 6.34 [05:37:36] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.49, 5.91, 6.04 [05:39:21] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±2] 13https://git.io/J4DFE [05:39:23] [02miraheze/mw-config] 07Reception123 0366dffb7 - update keys/path [05:39:24] [02mw-config] 07Reception123 synchronize pull request 03#4012: Add OAuth2 public key - 13https://git.io/J4XzZ [05:40:22] miraheze/mw-config - Reception123 the build passed. [05:51:11] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.95, 7.04, 6.58 [05:52:09] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.13, 7.00, 6.56 [05:53:07] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.84, 6.54, 6.45 [05:54:05] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.97, 6.24, 6.34 [06:03:48] [02mw-config] 07Reception123 closed pull request 03#4012: Add OAuth2 public key - 13https://git.io/J4XzZ [06:03:49] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/J4yep [06:03:51] [02miraheze/mw-config] 07Reception123 033ef54f6 - Add OAuth2 public key (#4012) [06:04:47] miraheze/mw-config - Reception123 the build passed. [06:04:52] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.53, 8.41, 7.14 [06:06:39] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.08, 7.86, 7.00 [06:10:04] [02mw-config] 07Universal-Omega reviewed pull request 03#4012 commit - 13https://git.io/J4yJv [06:12:45] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+1/-1/±0] 13https://git.io/J4yUk [06:12:47] [02miraheze/mw-config] 07Reception123 036717d0b - Rename OAuth2-publickey.key.pub to OAuth2.key.pub [06:12:55] [02mw-config] 07Reception123 reviewed pull request 03#4012 commit - 13https://git.io/J4yUY [06:13:01] [02mw-config] 07Reception123 reviewed pull request 03#4012 commit - 13https://git.io/J4yUY [06:13:26] [02mw-config] 07Universal-Omega deleted branch 03Reception123-patch-1 - 13https://git.io/vbvb3 [06:13:27] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Reception123-patch-1 [06:13:37] [02mw-config] 07Universal-Omega reviewed pull request 03#4012 commit - 13https://git.io/J4yUE [06:13:49] miraheze/mw-config - Reception123 the build passed. [06:16:26] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.50, 7.77, 7.86 [06:18:23] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.07, 8.93, 8.23 [06:26:06] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.98, 7.42, 7.93 [06:28:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.13, 7.34, 7.83 [06:33:01] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J4ymS [06:33:02] [02miraheze/mw-config] 07Reception123 033f95e4d - try to fix error [06:33:58] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.76, 7.13, 7.43 [06:34:00] miraheze/mw-config - Reception123 the build passed. [06:35:54] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.60, 7.26, 7.45 [06:42:20] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.27, 7.07, 7.22 [06:44:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.47, 6.92, 7.16 [06:49:26] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.00, 7.89, 7.43 [06:50:20] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.68, 7.62, 7.33 [06:51:23] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.69, 7.45, 7.34 [06:53:18] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.21, 7.54, 7.37 [06:55:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.47, 7.68, 7.45 [06:59:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.34, 7.92, 7.58 [07:01:44] !log composer install/update on mw* for OAuth [07:01:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:04:59] @Reception123 oh, I assume Oauth2 fix is live now? [07:05:28] @MarkusRost: yes it is. [07:05:48] @MarkusRost Yes, after all this time it should finally work. Please let me know if it does, though I was able to get to the login screen so that's a good sign [07:06:53] Great, I'm restarting my bot and then give it a test [07:09:52] @Reception123 - 500: Error while getting the mediawiki profile: It was not possible to parse your key, reason: error:0909006C:PEM routines:get_name:no start line [07:11:16] Gonna check where I'm making that request to make sure it's not on my side [07:12:41] Hm, I'll check if it works with wikimedia wikis [07:12:52] I think it's an error with our key, it seems to be unable to parse the key. I could be wrong though. [07:13:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.58, 7.52, 7.82 [07:13:30] yeah, wikimedia sides work fine [07:14:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.65, 7.43, 7.87 [07:14:27] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J4yEj [07:14:29] [02miraheze/mw-config] 07Reception123 03822f08b - Revert "try to fix error" [07:15:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.16, 7.98, 7.94 [07:15:25] miraheze/mw-config - Reception123 the build passed. [07:18:22] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.79, 7.99, 7.98 [07:20:00] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.01, 19.79, 17.56 [07:21:59] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.58, 18.61, 17.40 [07:22:09] @MarkusRost Mind trying again? If it still doesn't work I'll try regenerating the key [07:23:06] same error [07:25:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.23, 7.17, 7.88 [07:28:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.11, 7.02, 7.81 [07:30:00] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J4yoV [07:30:02] [02miraheze/mw-config] 07Reception123 034704f33 - generate new key [07:30:58] miraheze/mw-config - Reception123 the build passed. [07:33:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.28, 7.15, 7.41 [07:34:20] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 12.43, 8.77, 8.16 [07:35:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.94, 7.82, 7.65 [07:38:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.37, 7.82, 7.93 [07:45:14] should I try again? [07:45:57] you can but I don't think it will work because weirdly it tells me that OAuth2.key.pub is not a public key file. [07:46:20] I have no idea why this is so complex, it seemed easy [07:46:51] it worked on test3 yesterday, did you use a different way to generate the key now? [07:47:33] no, that's the thing. It was the same way, which is why I'm confused as to why it won't work here [07:48:09] and for some reason this time it also generated a different kind of public key [07:48:15] what I did was: [07:48:17] reception@jobrunner3:~$ ssh-keygen -t rsa -b 4096 -m PEM -f OAuth2.key [07:48:17] reception@jobrunner3:~$ openssl rsa -in OAuth2.key -pubout -outform PEM -out OAuth2.key.pub [07:49:14] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.97, 5.72, 6.65 [07:49:32] ok it did just work, but I feel like a found a major issue on my side 😅 Apparently I'm now @revi [07:49:51] oh it did, that's great then :) finally [07:49:57] what issue did you find on your side heh? [07:50:19] I someone how verified as revi instead of me [07:50:20] I am Markus and Revi [07:50:37] lol I wonder how that happened [07:50:48] lol https://usercontent.irccloud-cdn.com/file/xuS204R5/image.png [07:51:38] I have no idea how that happened, it's definitely on my side [07:52:34] Can we move this to a private place [07:56:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.52, 5.76, 6.64 [07:57:01] Oh yeah, OAuth2 is working now so here is everything fine [08:02:10] PROBLEM - arquivo.ucmg.ml - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'arquivo.ucmg.ml' expires in 15 day(s) (Thu 12 Aug 2021 07:55:09 GMT +0000). [08:05:51] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J4ybM [08:05:52] [02miraheze/ssl] 07MirahezeSSLBot 03aa64c83 - Bot: Update SSL cert for arquivo.ucmg.ml [08:06:23] @MarkusRost: I'd like to know a bit more about how it mixes users up [08:07:48] I'm not sure, I currently suspect it's an issue on my side where I'm giving the wrong code to the wrong user [08:17:58] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.11, 7.88, 6.96 [08:18:41] Can you keep us updated before it rolls out [08:19:54] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.57, 7.39, 6.89 [08:21:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.38, 7.39, 6.60 [08:21:51] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.42, 6.61, 6.66 [08:22:18] Send you a DM @RhinosF1 [08:23:19] Replied [08:23:35] I am going into a meeting but will see emails [08:26:52] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.77, 6.62, 6.54 [08:29:15] RECOVERY - arquivo.ucmg.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'arquivo.ucmg.ml' will expire on Mon 25 Oct 2021 07:05:42 GMT +0000. [08:35:23] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.37, 7.22, 6.77 [08:36:32] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.40, 7.06, 6.73 [08:37:19] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.10, 6.66, 6.60 [08:38:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.58, 6.71, 6.65 [08:55:51] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-1/±0] 13https://git.io/J4Sn7 [08:55:53] [02miraheze/mw-config] 07Universal-Omega 038867e1a - Delete testpublic.pub [08:55:54] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [08:55:56] [02mw-config] 07Universal-Omega opened pull request 03#4013: Delete testpublic.pub - 13https://git.io/J4Sn5 [08:56:35] @RhinosF1: ^ [08:56:52] [02mw-config] 07RhinosF1 closed pull request 03#4013: Delete testpublic.pub - 13https://git.io/J4Sn5 [08:56:54] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-1/±0] 13https://git.io/J4ScB [08:56:55] [02miraheze/mw-config] 07Universal-Omega 03b429202 - Delete testpublic.pub (#4013) [08:56:57] [02mw-config] 07RhinosF1 deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [08:56:58] [02miraheze/mw-config] 07RhinosF1 deleted branch 03Universal-Omega-patch-3 [08:57:02] Done Universal_Omega [08:57:03] miraheze/mw-config - Universal-Omega the build passed. [08:57:29] RhinosF1: thanks! I was mobile right now anyway, and also wasn't sure if it was still needed so thanks for merging. [08:57:51] miraheze/mw-config - RhinosF1 the build passed. [08:58:01] No I just didn't want messy files on test3 that weren't needed [08:58:10] Reception123 got another key now [08:58:13] Ah makes sense then. [09:20:12] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.81, 7.23, 6.44 [09:20:54] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.23, 6.66, 5.98 [09:22:07] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.31, 6.38, 6.21 [09:26:41] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.64, 6.33, 6.08 [09:29:55] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.11, 6.68, 6.37 [09:31:52] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.83, 6.62, 6.41 [09:35:46] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.30, 7.57, 6.89 [09:36:23] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.01, 8.88, 7.37 [09:38:20] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.39, 7.66, 7.11 [09:39:37] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.53, 6.42, 6.58 [09:42:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.64, 6.44, 6.76 [09:51:08] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/J4SDE [09:51:09] [02miraheze/ssl] 07Reception123 03d067140 - add steamdecklinux.wiki cert [10:03:24] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/J4SHN [10:03:25] [02miraheze/mediawiki] 07Reception123 03a2cfed7 - Update ContactPage [10:05:03] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.16, 6.60, 6.34 [10:05:14] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.76, 7.40, 6.69 [10:06:35] [02mediawiki] 07RhinosF1 commented on commit 03a2cfed7da3c0b0595e6c793861a8e1c0ad90afb3 - 13https://git.io/J4S7I [10:09:57] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [10:11:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.66, 7.39, 6.98 [10:12:48] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.89, 6.54, 6.50 [10:12:59] !log [rhinos@test3] enabled puppet [10:13:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:13:14] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.44, 6.75, 6.80 [10:13:40] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [10:13:57] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [10:20:54] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.81, 7.69, 7.13 [10:21:01] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.49, 7.31, 6.79 [10:24:46] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.60, 6.46, 6.74 [10:24:54] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.24, 6.59, 6.61 [10:30:34] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.11, 6.85, 6.77 [10:32:29] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.49, 6.42, 6.63 [10:35:11] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [10:35:33] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 21 seconds ago with 0 failures [10:36:22] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.48, 7.49, 7.11 [10:37:51] [02puppet] 07RhinosF1 opened pull request 03#1823: Update default.vcl - 13https://git.io/J49Js [10:38:54] [02puppet] 07Reception123 closed pull request 03#1823: Update default.vcl - 13https://git.io/J49Js [10:38:56] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J49JQ [10:38:57] [02miraheze/puppet] 07RhinosF1 03b7a7344 - Update default.vcl (#1823) [10:40:14] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.34, 6.43, 6.77 [10:40:29] PROBLEM - ping4 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 149.02 ms [10:40:31] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 161.60 ms [10:41:03] PROBLEM - ping4 on dbbackup1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 212.04 ms [10:46:28] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 103.63 ms [10:46:32] RECOVERY - ping4 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 97.65 ms [10:47:04] RECOVERY - ping4 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 90.75 ms [10:47:15] [02puppet] 07RhinosF1 opened pull request 03#1824: Update default.vcl - 13https://git.io/J49Ia [10:47:27] Reception123: ^ [10:50:08] [02puppet] 07Reception123 closed pull request 03#1824: Update default.vcl - 13https://git.io/J49Ia [10:50:10] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J49te [10:50:11] [02miraheze/puppet] 07RhinosF1 0377c2853 - Update default.vcl (#1824) [10:51:57] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.02, 7.07, 6.72 [10:53:06] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.83, 7.24, 6.50 [10:53:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.94, 6.91, 6.70 [10:55:02] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.32, 6.53, 6.33 [10:55:58] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.34, 6.42, 6.53 [11:01:58] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.36, 6.94, 6.74 [11:03:58] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.49, 8.24, 7.23 [11:05:51] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.85, 6.79, 6.48 [11:05:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.85, 7.74, 7.17 [11:07:47] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.99, 6.56, 6.44 [11:11:56] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.51, 6.27, 6.75 [11:20:31] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.60, 7.50, 6.91 [11:21:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.11, 7.02, 6.91 [11:24:24] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.25, 6.64, 6.67 [11:25:56] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.53, 6.56, 6.74 [11:30:28] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J49Rd [11:30:29] [02miraheze/mw-config] 07RhinosF1 03bb3e010 - LS: revoke all sessions [11:30:47] !log logging all users out [11:30:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:31:24] miraheze/mw-config - RhinosF1 the build passed. [11:33:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.89, 7.19, 6.83 [11:35:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.40, 7.28, 6.91 [11:36:10] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 7.32, 8.36, 7.44 [11:38:01]