[00:00:07] miraheze/mw-config - Universal-Omega the build passed. [00:00:09] miraheze/mw-config - Universal-Omega the build passed. [00:00:37] miraheze/mw-config - Universal-Omega the build passed. [00:02:31] how often are the wikis databases updated? [00:04:23] RECOVERY - cp12 Disk Space on cp12 is OK: DISK OK - free space: / 8250 MB (21% inode=96%); [00:05:00] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 33.66, 23.79, 18.26 [00:05:32] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.47, 7.51, 6.32 [00:05:53] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.06, 7.71, 6.43 [00:07:00] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.66, 23.01, 18.72 [00:07:06] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.58, 3.14, 2.36 [00:07:31] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.86, 6.49, 6.09 [00:07:53] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.84, 7.71, 6.62 [00:09:05] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 3.02, 3.05, 2.42 [00:09:21] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JWylB [00:09:22] [02miraheze/mw-config] 07Universal-Omega 03c29a938 - Update LocalExtensions.php [00:09:24] [02mw-config] 07Universal-Omega synchronize pull request 03#4002: Allow GlobalUsage to be used for shared uploads - 13https://git.io/JWDpS [00:10:19] miraheze/mw-config - Universal-Omega the build passed. [00:10:19] Hispano76: What do you mean? [00:11:02] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.66, 21.87, 19.11 [00:13:00] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.27, 22.12, 19.58 [00:13:53] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.44, 6.23, 6.31 [00:21:31] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.76, 7.06, 6.16 [00:21:52] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.63, 6.84, 6.55 [00:23:00] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.87, 20.07, 20.19 [00:23:31] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.74, 6.52, 6.07 [00:23:53] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.89, 5.95, 6.27 [00:52:09] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.07, 1.96, 1.42 [00:56:00] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.27, 1.64, 1.42 [01:28:03] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.63, 6.67, 5.65 [01:30:02] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.45, 7.15, 5.94 [01:33:00] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 35.78, 22.93, 16.76 [01:33:37] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.86, 8.05, 6.17 [01:34:04] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.83, 7.59, 6.46 [01:35:37] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.08, 7.23, 6.10 [01:37:01] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 15.21, 23.10, 18.63 [01:37:37] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.04, 6.56, 6.00 [01:38:05] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.23, 6.55, 6.28 [01:43:00] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.01, 18.85, 18.07 [02:23:31] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.97, 1.76, 1.33 [02:25:28] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.93, 1.41, 1.25 [02:39:03] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.40, 1.79, 1.54 [02:41:03] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.79, 1.42, 1.43 [02:53:38] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.09, 6.55, 5.71 [02:55:37] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.33, 6.10, 5.64 [03:23:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.39, 3.52, 3.06 [03:25:10] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.28, 3.05, 2.94 [03:58:31] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 10.85, 8.34, 6.62 [04:06:15] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.91, 7.57, 7.07 [04:10:05] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.95, 6.16, 6.60 [04:15:05] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.40, 20.83, 16.57 [04:15:07] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.46, 7.02, 5.89 [04:15:17] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.03, 7.32, 6.43 [04:15:28] PROBLEM - electrowiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for electrowiki.org could not be found [04:15:31] PROBLEM - wiki.patriam.cc - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.patriam.cc could not be found [04:15:41] PROBLEM - phab-storage.bots.miraheze.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for phab-storage.bots.miraheze.wiki could not be found [04:15:42] PROBLEM - www.burnout.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.burnout.wiki could not be found [04:15:43] PROBLEM - pwiki.drydraytonvillagehall.org.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pwiki.drydraytonvillagehall.org.uk could not be found [04:15:44] PROBLEM - wiki.make717.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.make717.org could not be found [04:15:44] PROBLEM - encyclopediaofastrobiology.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for encyclopediaofastrobiology.org could not be found [04:15:46] PROBLEM - tep.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tep.wiki could not be found [04:15:47] PROBLEM - miraheze.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.com could not be found [04:15:49] PROBLEM - nonbinary.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for nonbinary.wiki could not be found [04:15:50] PROBLEM - lukaibrisimovic.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lukaibrisimovic.org could not be found [04:15:51] PROBLEM - wiki.misslessfighters.club - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.misslessfighters.club could not be found [04:15:52] PROBLEM - froggy.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for froggy.info could not be found [04:15:53] PROBLEM - wiki.erisly.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.erisly.com could not be found [04:15:54] PROBLEM - aman.awiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for aman.awiki.org could not be found [04:15:55] PROBLEM - wiki.thunis.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.thunis.eu could not be found [04:15:56] PROBLEM - wiki.xysspon.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.xysspon.com could not be found [04:15:58] PROBLEM - wiki.consid.vn - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.consid.vn could not be found [04:15:59] PROBLEM - viileapedia.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for viileapedia.ga could not be found [04:15:59] PROBLEM - iceria.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for iceria.org could not be found [04:15:59] PROBLEM - wikimas.kr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikimas.kr could not be found [04:16:00] PROBLEM - www.sdiy.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.sdiy.info could not be found [04:16:01] PROBLEM - johanloopmans.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for johanloopmans.nl could not be found [04:16:03] PROBLEM - www.wikimicrofinanza.it - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.wikimicrofinanza.it could not be found [04:16:03] PROBLEM - wiki.valkyrienskies.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.valkyrienskies.org could not be found [04:16:10] PROBLEM - wiki.tigcity.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.tigcity.tk could not be found [04:16:11] PROBLEM - arru.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for arru.xyz could not be found [04:16:13] PROBLEM - uncyclopediakr.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for uncyclopediakr.miraheze.org could not be found [04:16:15] PROBLEM - vmcodex.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vmcodex.net could not be found [04:16:16] PROBLEM - www.portalsofphereon.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.portalsofphereon.com could not be found [04:16:17] PROBLEM - www.ethene.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.ethene.wiki could not be found [04:16:19] PROBLEM - wiki.mxlinuxusers.de - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mxlinuxusers.de could not be found [04:16:20] PROBLEM - wiki.chouverse.cludisciples.cyou - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.chouverse.cludisciples.cyou could not be found [04:16:22] PROBLEM - rangpurpedia.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rangpurpedia.xyz could not be found [04:17:00] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.49, 18.91, 16.36 [04:17:05] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.76, 6.13, 5.70 [04:19:16] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.44, 6.46, 6.28 [04:22:08] RECOVERY - electrowiki.org - reverse DNS on sslhost is OK: SSL OK - electrowiki.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:12] RECOVERY - wiki.patriam.cc - reverse DNS on sslhost is OK: SSL OK - wiki.patriam.cc reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:30] RECOVERY - phab-storage.bots.miraheze.wiki - reverse DNS on sslhost is OK: SSL OK - phab-storage.bots.miraheze.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:33] RECOVERY - www.burnout.wiki - reverse DNS on sslhost is OK: SSL OK - www.burnout.wiki reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:35] RECOVERY - wiki.make717.org - reverse DNS on sslhost is OK: SSL OK - wiki.make717.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:35] RECOVERY - encyclopediaofastrobiology.org - reverse DNS on sslhost is OK: SSL OK - encyclopediaofastrobiology.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:35] RECOVERY - pwiki.drydraytonvillagehall.org.uk - reverse DNS on sslhost is OK: SSL OK - pwiki.drydraytonvillagehall.org.uk reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:37] RECOVERY - wiki.xysspon.com - reverse DNS on sslhost is OK: SSL OK - wiki.xysspon.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:40] RECOVERY - miraheze.com - reverse DNS on sslhost is OK: SSL OK - miraheze.com reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:40] RECOVERY - tep.wiki - reverse DNS on sslhost is OK: SSL OK - tep.wiki reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:40] RECOVERY - viileapedia.ga - reverse DNS on sslhost is OK: SSL OK - viileapedia.ga reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:42] RECOVERY - iceria.org - reverse DNS on sslhost is OK: SSL OK - iceria.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:43] RECOVERY - lukaibrisimovic.org - reverse DNS on sslhost is OK: SSL OK - lukaibrisimovic.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:45] RECOVERY - wikimas.kr - reverse DNS on sslhost is OK: SSL OK - wikimas.kr reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:45] RECOVERY - nonbinary.wiki - reverse DNS on sslhost is OK: SSL OK - nonbinary.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:45] RECOVERY - www.sdiy.info - reverse DNS on sslhost is OK: SSL OK - www.sdiy.info reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:50] RECOVERY - wiki.misslessfighters.club - reverse DNS on sslhost is OK: SSL OK - wiki.misslessfighters.club reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:50] RECOVERY - www.wikimicrofinanza.it - reverse DNS on sslhost is OK: SSL OK - www.wikimicrofinanza.it reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:51] RECOVERY - froggy.info - reverse DNS on sslhost is OK: SSL OK - froggy.info reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:22:55] RECOVERY - wiki.valkyrienskies.org - reverse DNS on sslhost is OK: SSL OK - wiki.valkyrienskies.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:56] RECOVERY - aman.awiki.org - reverse DNS on sslhost is OK: SSL OK - aman.awiki.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:57] RECOVERY - wiki.erisly.com - reverse DNS on sslhost is OK: SSL OK - wiki.erisly.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:22:58] RECOVERY - wiki.thunis.eu - reverse DNS on sslhost is OK: SSL OK - wiki.thunis.eu reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:23:00] RECOVERY - wiki.consid.vn - reverse DNS on sslhost is OK: SSL OK - wiki.consid.vn reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:23:01] RECOVERY - vmcodex.net - reverse DNS on sslhost is OK: SSL OK - vmcodex.net reverse DNS resolves to cp13.miraheze.org - CNAME FLAT [04:23:02] RECOVERY - www.portalsofphereon.com - reverse DNS on sslhost is OK: SSL OK - www.portalsofphereon.com reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:23:03] RECOVERY - www.ethene.wiki - reverse DNS on sslhost is OK: SSL OK - www.ethene.wiki reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:23:03] RECOVERY - johanloopmans.nl - reverse DNS on sslhost is OK: SSL OK - johanloopmans.nl reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:23:07] RECOVERY - wiki.tigcity.tk - reverse DNS on sslhost is OK: SSL OK - wiki.tigcity.tk reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:23:09] RECOVERY - arru.xyz - reverse DNS on sslhost is OK: SSL OK - arru.xyz reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:23:10] RECOVERY - wiki.mxlinuxusers.de - reverse DNS on sslhost is OK: SSL OK - wiki.mxlinuxusers.de reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:23:10] RECOVERY - wiki.chouverse.cludisciples.cyou - reverse DNS on sslhost is OK: SSL OK - wiki.chouverse.cludisciples.cyou reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:23:15] RECOVERY - rangpurpedia.xyz - reverse DNS on sslhost is OK: SSL OK - rangpurpedia.xyz reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:23:17] RECOVERY - uncyclopediakr.miraheze.org - reverse DNS on sslhost is OK: SSL OK - uncyclopediakr.miraheze.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [04:42:35] PROBLEM - mabi.myomi.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'mabi.myomi.net' expires in 15 day(s) (Tue 03 Aug 2021 04:39:46 GMT +0000). [04:42:40] PROBLEM - wiki.consid.vn - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.consid.vn' expires in 15 day(s) (Tue 03 Aug 2021 04:34:13 GMT +0000). [04:44:42] PROBLEM - thepolicyhub.org.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'thepolicyhub.org.uk' expires in 15 day(s) (Tue 03 Aug 2021 04:37:30 GMT +0000). [04:48:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JWS6M [04:48:44] [02miraheze/ssl] 07MirahezeSSLBot 038efe4ee - Bot: Update SSL cert for mabi.myomi.net [04:49:14] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JWS6F [04:49:15] [02miraheze/ssl] 07MirahezeSSLBot 03f48df53 - Bot: Update SSL cert for wiki.consid.vn [04:50:37] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JWSiW [04:50:39] [02miraheze/ssl] 07MirahezeSSLBot 03b1f2757 - Bot: Update SSL cert for thepolicyhub.org.uk [05:03:05] RECOVERY - mabi.myomi.net - LetsEncrypt on sslhost is OK: OK - Certificate 'mabi.myomi.net' will expire on Sat 16 Oct 2021 03:48:34 GMT +0000. [05:31:24] RECOVERY - wiki.consid.vn - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.consid.vn' will expire on Sat 16 Oct 2021 03:49:06 GMT +0000. [05:32:38] RECOVERY - thepolicyhub.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'thepolicyhub.org.uk' will expire on Sat 16 Oct 2021 03:50:30 GMT +0000. [05:59:41] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.64, 6.81, 5.68 [06:01:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.28, 5.93, 5.49 [06:20:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JW9eh [06:20:14] [02miraheze/services] 07MirahezeSSLBot 03dd368e6 - BOT: Updating services config for wikis [06:56:25] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.41, 4.38, 2.69 [06:58:25] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 1.80, 3.36, 2.52 [13:05:32] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.63, 7.20, 5.77 [13:06:20] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.19, 7.01, 5.60 [13:07:32] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.27, 6.07, 5.53 [13:08:19] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.95, 6.41, 5.57 [13:53:04] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.93, 1.62, 1.00 [13:55:05] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.50, 1.20, 0.92 [14:05:53] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.31, 8.11, 6.51 [14:05:53] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.85, 6.68, 5.83 [14:07:48] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.66, 6.04, 5.68 [14:07:54] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 4.92, 6.85, 6.24 [14:09:39] PROBLEM - savage-wiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for savage-wiki.com could not be found [14:09:41] PROBLEM - mh142.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mh142.com could not be found [14:09:41] PROBLEM - rothwell-leeds.co.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rothwell-leeds.co.uk could not be found [14:09:42] PROBLEM - wiki.caker18.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.caker18.com could not be found [14:09:43] PROBLEM - wiki.cdntennis.ca - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.cdntennis.ca could not be found [14:09:43] PROBLEM - miraheze.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.wiki could not be found [14:09:44] PROBLEM - wiki.scvo.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.scvo.org could not be found [14:09:47] PROBLEM - tools1.miraheze.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tools1.miraheze.wiki could not be found [14:09:48] PROBLEM - rupowerrangersfanon.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rupowerrangersfanon.tk could not be found [14:09:54] PROBLEM - wiki.etn.link - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.etn.link could not be found [14:09:54] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.09, 5.85, 5.94 [14:16:27] RECOVERY - tools1.miraheze.wiki - reverse DNS on sslhost is OK: SSL OK - tools1.miraheze.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [14:16:29] RECOVERY - rupowerrangersfanon.tk - reverse DNS on sslhost is OK: SSL OK - rupowerrangersfanon.tk reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [14:16:36] RECOVERY - savage-wiki.com - reverse DNS on sslhost is OK: SSL OK - savage-wiki.com reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [14:16:36] RECOVERY - mh142.com - reverse DNS on sslhost is OK: SSL OK - mh142.com reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [14:16:37] RECOVERY - rothwell-leeds.co.uk - reverse DNS on sslhost is OK: SSL OK - rothwell-leeds.co.uk reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [14:16:39] RECOVERY - wiki.caker18.com - reverse DNS on sslhost is OK: SSL OK - wiki.caker18.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:16:41] RECOVERY - wiki.etn.link - reverse DNS on sslhost is OK: SSL OK - wiki.etn.link reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:16:41] RECOVERY - wiki.cdntennis.ca - reverse DNS on sslhost is OK: SSL OK - wiki.cdntennis.ca reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:16:42] RECOVERY - miraheze.wiki - reverse DNS on sslhost is OK: SSL OK - miraheze.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [14:16:42] RECOVERY - wiki.scvo.org - reverse DNS on sslhost is OK: SSL OK - wiki.scvo.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:19:53] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.83, 7.55, 6.45 [14:21:53] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.75, 6.91, 6.36 [14:23:53] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.03, 6.17, 6.15 [15:51:34] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.33, 6.34, 5.51 [15:53:32] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.25, 5.87, 5.43 [16:21:33] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.72, 6.88, 6.24 [16:25:32] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.01, 6.24, 6.17 [16:35:31] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.65, 7.73, 6.76 [16:37:31] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.13, 6.99, 6.60 [16:39:32] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.93, 6.58, 6.49 [16:49:32] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.42, 8.59, 7.19 [16:50:10] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.37, 7.57, 6.67 [16:50:57] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.16, 7.66, 6.84 [16:51:54] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.37, 8.00, 6.88 [16:52:10] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.45, 8.07, 6.94 [16:54:10] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.13, 7.52, 6.87 [16:56:10] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 13.95, 9.90, 7.81 [16:58:38] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.37, 7.90, 7.34 [16:59:31] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.49, 7.71, 7.70 [17:01:53] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.67, 7.62, 7.50 [17:02:08] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.38, 7.43, 7.37 [17:03:32] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.98, 7.67, 7.64 [17:03:52] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.95, 8.30, 7.75 [17:04:08] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.01, 7.77, 7.48 [17:06:08] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.77, 7.53, 7.44 [17:07:53] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.11, 7.68, 7.69 [17:09:32] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.42, 7.53, 7.73 [17:10:08] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.24, 5.80, 6.61 [17:14:07] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.05, 6.21, 6.80 [17:20:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.66, 6.76, 6.86 [17:21:55] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.93, 6.17, 6.71 [17:22:05] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.20, 6.62, 6.80 [17:25:31] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.31, 6.45, 6.75 [17:25:53] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.15, 7.38, 7.06 [17:27:52] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.08, 6.70, 6.84 [17:28:06] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.76, 6.84, 6.83 [17:29:52] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.90, 6.38, 6.70 [17:32:05] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.49, 6.36, 6.66 [17:35:52] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 8.00, 7.55, 7.06 [17:39:45] Evening Voidwalker [17:39:55] hi [17:41:53] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.07, 6.57, 6.80 [17:45:17] Hehe, I'm now on IRC [17:49:15] Only caught one killed process on jobrunner3 last night, which spookily, isn't in graylog. Anyway, looks like php-fpm was killed last night, among other things. [17:49:53] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.70, 7.56, 7.01 [17:51:03] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JW7q0 [17:51:05] [02miraheze/mw-config] 07Universal-Omega 038c17ab4 - Update LocalWiki.php [17:51:06] [02mw-config] 07Universal-Omega synchronize pull request 03#4002: Allow GlobalUsage to be used for shared uploads - 13https://git.io/JWDpS [17:51:53] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.33, 6.92, 6.83 [17:52:00] miraheze/mw-config - Universal-Omega the build passed. [17:55:53] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.67, 6.53, 6.73 [17:57:06] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JW7Ys [17:57:07] [02miraheze/mw-config] 07Universal-Omega 032256f83 - Update LocalExtensions.php [17:57:09] [02mw-config] 07Universal-Omega synchronize pull request 03#4002: Allow GlobalUsage to be used for shared uploads - 13https://git.io/JWDpS [17:58:00] miraheze/mw-config - Universal-Omega the build passed. [17:59:04] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JW7YA [17:59:06] [02miraheze/mw-config] 07Universal-Omega 036268f3f - Update LocalWiki.php [17:59:07] [02mw-config] 07Universal-Omega synchronize pull request 03#4002: Allow GlobalUsage to be used for shared uploads - 13https://git.io/JWDpS [18:00:03] miraheze/mw-config - Universal-Omega the build passed. [18:05:31] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.77, 7.09, 6.45 [18:06:49] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.46, 7.18, 6.97 [18:09:32] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.65, 6.34, 6.30 [18:12:48] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.24, 6.28, 6.63 [18:14:45] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.28, 6.80, 6.49 [18:16:40] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.97, 6.19, 6.31 [18:34:03] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.02, 7.21, 6.48 [18:36:04] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.69, 6.19, 6.19 [18:40:14] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JW7ll [18:40:16] [02miraheze/ManageWiki] 07Universal-Omega 03b6b948a - Fix PHP Notice: Undefined property: RemoteWiki::$errors [18:40:17] [02ManageWiki] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vpSns [18:40:19] [02ManageWiki] 07Universal-Omega opened pull request 03#280: Fix PHP Notice: Undefined property: RemoteWiki::$errors - 13https://git.io/JW7l4 [18:41:14] miraheze/ManageWiki - Universal-Omega the build passed. [18:41:26] [02ManageWiki] 07Universal-Omega closed pull request 03#280: Fix PHP Notice: Undefined property: RemoteWiki::$errors - 13https://git.io/JW7l4 [18:41:27] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JW7lS [18:41:29] [02miraheze/ManageWiki] 07Universal-Omega 0325f0bb5 - Fix PHP Notice: Undefined property: RemoteWiki::$errors (#280) [18:41:30] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [18:41:32] [02ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vpSns [18:42:17] miraheze/ManageWiki - Universal-Omega the build passed. [19:08:22] [02ManageWiki] 07Universal-Omega closed pull request 03#278: ManageWikiExtensions: support description and name messages - 13https://git.io/Jna7W [19:08:23] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JW7EN [19:08:25] [02miraheze/ManageWiki] 07Universal-Omega 03985f6ec - ManageWikiExtensions: support description and name messages (#278) [19:08:26] [02ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vpSns [19:08:28] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [19:09:16] miraheze/ManageWiki - Universal-Omega the build passed. [19:10:55] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JW7uc [19:10:57] [02miraheze/mediawiki] 07Universal-Omega 038a1c751 - Update ManageWiki [19:11:34] [02mw-config] 07Universal-Omega closed pull request 03#3990: Update extension names to ExtensionRegistry names - 13https://git.io/JctAo [19:11:35] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JW7uu [19:11:37] [02miraheze/mw-config] 07Universal-Omega 0302ea08c - Update extension names to ExtensionRegistry names (#3990) [19:11:41] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-5 - 13https://git.io/vbvb3 [19:11:43] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-5 [19:12:29] miraheze/mw-config - Universal-Omega the build passed. [19:26:53] [02CreateWiki] 07Universal-Omega closed pull request 03#226: Use Html::successBox and Html::errorBox - 13https://git.io/Jc2ff [19:26:55] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JW72L [19:26:56] [02miraheze/CreateWiki] 07Universal-Omega 03358a37b - Use Html::successBox and Html::errorBox (#226) [19:26:58] [02CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vpJTL [19:26:59] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [19:27:46] miraheze/CreateWiki - Universal-Omega the build passed. [19:30:31] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-5 [+0/-0/±1] 13https://git.io/JW72X [19:30:33] [02miraheze/mw-config] 07Universal-Omega 0378b502a - Move Approved Revs to antispam section [19:30:34] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-5 - 13https://git.io/vbvb3 [19:30:36] [02mw-config] 07Universal-Omega opened pull request 03#4003: Move Approved Revs to antispam section - 13https://git.io/JW721 [19:31:34] miraheze/mw-config - Universal-Omega the build passed. [19:31:45] [02mw-config] 07Universal-Omega closed pull request 03#4003: Move Approved Revs to antispam section - 13https://git.io/JW721 [19:31:47] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JW72x [19:31:48] [02miraheze/mw-config] 07Universal-Omega 0390aeb17 - Move Approved Revs to antispam section (#4003) [19:31:50] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-5 [19:31:51] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-5 - 13https://git.io/vbvb3 [19:32:37] miraheze/mw-config - Universal-Omega the build passed. [19:50:19] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.34, 7.31, 6.21 [19:52:15] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.88, 7.39, 6.37 [19:53:24] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.35, 7.11, 6.14 [19:56:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.13, 6.38, 6.20 [19:57:25] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.30, 6.72, 6.23 [20:04:31] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.14, 7.53, 6.69 [20:04:52] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.42, 7.84, 6.91 [20:05:43] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.03, 7.17, 6.52 [20:06:29] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.65, 7.71, 6.87 [20:06:48] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.49, 7.27, 6.80 [20:07:37] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.34, 6.98, 6.54 [20:10:42] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.66, 6.17, 6.49 [20:11:37] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.69, 6.50, 6.46 [20:14:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.09, 6.59, 6.67 [20:20:23] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.27, 6.93, 6.75 [20:22:23] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.01, 7.54, 7.01 [20:24:23] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.72, 7.47, 7.06 [20:26:25] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.14, 6.91, 6.51 [20:28:22] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.43, 6.60, 6.79 [20:30:27] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.40, 6.54, 6.45 [20:49:13] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JW7MF [20:49:14] [02miraheze/ManageWiki] 07Universal-Omega 0343d5569 - Update ManageWikiFormFactory.php [20:49:16] [02ManageWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vpSns [20:49:27] [02ManageWiki] 07Universal-Omega opened pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [20:50:25] miraheze/ManageWiki - Universal-Omega the build passed. [20:54:48] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JW7yJ [20:54:49] [02miraheze/ManageWiki] 07Universal-Omega 038ec9d3c - Update ManageWikiFormFactory.php [20:54:51] [02ManageWiki] 07Universal-Omega synchronize pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [20:55:43] miraheze/ManageWiki - Universal-Omega the build passed. [20:57:01] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JW7yl [20:57:03] [02miraheze/CreateWiki] 07Universal-Omega 034e70883 - Support additional buttons for forms [20:57:04] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vpJTL [20:57:06] [02CreateWiki] 07Universal-Omega opened pull request 03#227: Support additional buttons for forms - 13https://git.io/JW7y4 [20:58:00] miraheze/CreateWiki - Universal-Omega the build passed. [21:03:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.62, 7.37, 6.30 [21:04:32] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JW7Sm [21:04:33] [02miraheze/ManageWiki] 07Universal-Omega 0337b2f8f - Update ManageWikiFormFactory.php [21:04:35] [02ManageWiki] 07Universal-Omega synchronize pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [21:04:43] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.18, 6.53, 5.99 [21:05:44] Universal_Omega: have you deployed anything? [21:05:54] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.99, 6.33, 6.05 [21:06:29] miraheze/ManageWiki - Universal-Omega the build passed. [21:06:36] RhinosF1: Yes, the ManageWiki descriptions. [21:06:38] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.32, 5.61, 5.71 [21:07:02] Universal_Omega: you might wanna rollback [21:07:11] Why? [21:07:23] Universal_Omega: https://phabricator.miraheze.org/T7661 [21:07:24] [url] ⚓ T7661 MediaWIki/ManageWiki Error | phabricator.miraheze.org [21:08:49] RhinosF1: I do not think it is related, but looking (nothing in this change should've broken wikibase like that) [21:10:39] RhinosF1: If it were the error would be on test3 also I think (which it does not seem to be) [21:10:53] looking at trace [21:13:13] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JW79G [21:13:15] [02miraheze/ManageWiki] 07Universal-Omega 03e53bced - Update ManageWikiFormFactoryBuilder.php [21:13:16] [02ManageWiki] 07Universal-Omega synchronize pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [21:14:10] miraheze/ManageWiki - Universal-Omega the build passed. [21:15:29] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JW795 [21:15:31] [02miraheze/ManageWiki] 07Universal-Omega 03329d3cd - Update ManageWikiFormFactory.php [21:15:32] [02ManageWiki] 07Universal-Omega synchronize pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [21:16:05] Universal_Omega: it's wikibase client wikis [21:16:28] miraheze/ManageWiki - Universal-Omega the build passed. [21:18:06] RhinosF1: Looking but again, I have no idea how this change would effect that. [21:21:12] RhinosF1: Um... it happens on mw* but not on test3 when proxying. Both have my change live also. [21:21:15] Universal_Omega: is it taking extension(-client|-repo) into account [21:21:50] RhinosF1: Yes I included `extension*.json` for that reason. [21:22:41] hmm, it's not happening to me, on any of my wikis [21:23:14] Universal_Omega: git hash doesn't match [21:24:03] I see I think it happens to wikis that have Wikibase Repo [21:25:38] Universal_Omega: Can I reset ManageWiki on test3 [21:25:47] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.84, 1.86, 1.36 [21:25:54] It happens if you have WikibaseClient but not WikibaseRepo for some reason. [21:25:59] RhinosF1: sure. [21:26:15] puppet is disabled on test3 still for some reason [21:26:37] +Universal_Omega: Hmm, I see [21:27:03] Voidwalker: running [21:27:26] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [21:27:43] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.38, 1.64, 1.33 [21:30:37] Voidwalker: puppet is very slow [21:31:16] The last Puppet run was at Thu Jul 15 23:03:22 UTC 2021 (4221 minutes ago). Puppet is disabled. reason not specified [21:32:22] RhinosF1: Happens when Citeoid is enabled but WikibaseRepo is not. [21:32:46] Universal_Omega: dodgy dependancy or? [21:33:29] Citoid is calling WikibaseRepo https://github.com/wikimedia/mediawiki-extensions-Citoid/blob/ed30d8ae01dfc221c8367e94d2395ba5708a05a4/includes/CitoidHooks.php#L46-L53 [21:33:30] [url] mediawiki-extensions-Citoid/CitoidHooks.php at ed30d8ae01dfc221c8367e94d2395ba5708a05a4 · wikimedia/mediawiki-extensions-Citoid · GitHub | github.com [21:33:50] looks like class_exists is not a sufficient check for this [21:34:13] Voidwalker: how amazingly fun. [21:34:28] what I want to know is why this became a problem now [21:34:42] Voidwalker: change in how we load stuff [21:35:10] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JW75f [21:35:11] [02miraheze/services] 07MirahezeSSLBot 03d4b1496 - BOT: Updating services config for wikis [21:35:20] oh, well, sounds like the php code is registered but the extension isn't loaded [21:35:23] that's the problem [21:35:40] but also, how is this only a problem on ManageWiki/extensions? [21:35:50] Voidwalker: is that acceptable [21:36:51] well clearly not, unless we want to update the upstream stuff and hope this is the only case of someone using class_exists to check if another extension is loaded [21:39:10] hmm, this might be caused by having the ExtensionRegistry reading all of the extension stuff [21:39:27] Voidwalker: https://codesearch.wmcloud.org/search/?q=if%20%5C(%20class_exists%5C(&i=nope&files=&excludeFiles=&repos= [21:39:28] [url] MediaWiki code search | codesearch.wmcloud.org [21:40:47] Universal_Omega: ^ [21:41:42] The problem is using ExtensionRegistry is loading the php classes and namespaces and I don't think we want that to happen [21:50:05] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.01, 6.46, 5.64 [21:51:26] Voidwalker: can we not rollback now we know the cause? [21:52:00] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.71, 6.19, 5.64 [21:52:22] Universal_Omega, I'll leave that to you, I have to go for 20-30 minutes [21:52:39] I need to sleep at some point too [22:18:22] PROBLEM - cp12 Disk Space on cp12 is WARNING: DISK WARNING - free space: / 4236 MB (10% inode=96%); [22:19:48] or I guess I'm doing it unless I can come up with a fix real quick [22:20:30] Yes [22:20:36] Don't ask me why I'm still awake [22:20:53] It's too warm to sleep and my brain is in stupid too many thoughts mode [22:34:34] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.59, 7.49, 5.82 [22:35:31] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.86, 6.52, 5.51 [22:35:37] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.30, 6.81, 5.71 [22:36:32] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.96, 6.77, 5.76 [22:37:31] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.07, 6.06, 5.47 [22:37:38] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.58, 5.91, 5.51 [23:04:14] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JW5f9 [23:04:16] [02miraheze/ManageWiki] 07Universal-Omega 03705dd64 - Use ExtensionProcessor not ExtensionRegistry to fix trying to load everything [23:04:17] [02ManageWiki] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vpSns [23:04:22] [02ManageWiki] 07Universal-Omega opened pull request 03#282: Use ExtensionProcessor not ExtensionRegistry to fix trying to load everything - 13https://git.io/JW5fH [23:04:33] Voidwalker, RhinosF1: ^ [23:05:15] miraheze/ManageWiki - Universal-Omega the build has errored. [23:05:16] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JW5fA [23:05:17] [02miraheze/ManageWiki] 07Universal-Omega 03cd42ea0 - Update ManageWikiFormFactoryBuilder.php [23:05:19] [02ManageWiki] 07Universal-Omega synchronize pull request 03#282: Use ExtensionProcessor not ExtensionRegistry to fix trying to load everything - 13https://git.io/JW5fH [23:05:33] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.36, 6.05, 5.37 [23:06:14] miraheze/ManageWiki - Universal-Omega the build passed. [23:07:31] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.40, 5.40, 5.22 [23:08:58] Do test on test3 before deploying though [23:09:46] Voidwalker: I did already, it is live there now. [23:10:41] cool well, then +2 [23:11:52] [02ManageWiki] 07Universal-Omega closed pull request 03#282: Use ExtensionProcessor not ExtensionRegistry to fix trying to load everything - 13https://git.io/JW5fH [23:11:54] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JW5JV [23:11:55] [02miraheze/ManageWiki] 07Universal-Omega 03c42499a - Use ExtensionProcessor not ExtensionRegistry to fix trying to load everything (#282) [23:11:57] [02ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vpSns [23:11:58] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [23:12:49] miraheze/ManageWiki - Universal-Omega the build passed. [23:13:29] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JW5J9 [23:13:30] [02miraheze/mediawiki] 07Universal-Omega 03f0467aa - Update ManageWiki [23:15:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JW5Jp [23:15:13] [02miraheze/services] 07MirahezeSSLBot 031cc348d - BOT: Updating services config for wikis [23:42:52] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://git.io/JW5IF [23:42:53] [02miraheze/ManageWiki] 07Universal-Omega 03ac5f744 - Create ManageWikiOOUIForm.php [23:42:55] [02ManageWiki] 07Universal-Omega synchronize pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [23:43:51] miraheze/ManageWiki - Universal-Omega the build passed. [23:44:03] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JW5Lq [23:44:04] [02miraheze/ManageWiki] 07Universal-Omega 0393b5d16 - Update ManageWikiFormFactory.php [23:44:06] [02ManageWiki] 07Universal-Omega synchronize pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [23:44:58] miraheze/ManageWiki - Universal-Omega the build passed. [23:45:07] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JW5LZ [23:45:09] [02miraheze/ManageWiki] 07Universal-Omega 03b3d742e - Update extension.json [23:45:10] [02ManageWiki] 07Universal-Omega synchronize pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [23:46:06] miraheze/ManageWiki - Universal-Omega the build passed. [23:51:56] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JW5to [23:51:58] [02miraheze/ManageWiki] 07Universal-Omega 03bbcf28b - Update ManageWikiOOUIForm.php [23:51:59] [02ManageWiki] 07Universal-Omega synchronize pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [23:52:50] miraheze/ManageWiki - Universal-Omega the build passed. [23:54:01] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JW5tN [23:54:02] [02miraheze/ManageWiki] 07Universal-Omega 033230aad - Update ManageWikiOOUIForm.php [23:54:04] [02ManageWiki] 07Universal-Omega synchronize pull request 03#281: Redesign form submission - 13https://git.io/JW7MN [23:54:54] miraheze/ManageWiki - Universal-Omega the build passed.