[00:00:15] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.50, 6.11, 6.29 [00:00:54] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 5 datacenters are down: 128.199.139.216/cpweb, 51.38.69.175/cpweb, 2001:41d0:801:2000::58af/cpweb, 51.222.25.132/cpweb, 2607:5300:205:200::1c30/cpweb [00:01:02] PROBLEM - vitriol.spoon.army - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vitriol.spoon.army could not be found [00:01:07] PROBLEM - wikipariksha.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikipariksha.com could not be found [00:01:08] PROBLEM - adadevelopersacademy.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for adadevelopersacademy.wiki could not be found [00:01:09] PROBLEM - threedomwiki.pcast.site - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for threedomwiki.pcast.site could not be found [00:02:31] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.70, 21.40, 19.01 [00:02:48] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 51.38.69.175/cpweb [00:03:01] PROBLEM - lakehub.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lakehub.ga could not be found [00:03:05] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.83, 3.15, 2.34 [00:03:07] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Puppet has 11 failures. Last run 2 minutes ago with 11 failures. Failed resources (up to 3 shown) [00:03:10] PROBLEM - thelonsdalebattalion.co.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for thelonsdalebattalion.co.uk could not be found [00:03:12] PROBLEM - cp3 Stunnel Http for mw9 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:03:21] PROBLEM - wikiru.wildterra2.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikiru.wildterra2.com could not be found [00:03:22] PROBLEM - wiki.sdbx.dev - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.sdbx.dev could not be found [00:03:25] PROBLEM - wiki.nowchess.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nowchess.org could not be found [00:03:25] PROBLEM - mabi.myomi.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mabi.myomi.net could not be found [00:03:37] PROBLEM - wiki.newnormal.fans - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.newnormal.fans could not be found [00:03:40] PROBLEM - commons.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for commons.gyaanipedia.com could not be found [00:03:41] PROBLEM - www.johanloopmans.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.johanloopmans.nl could not be found [00:03:48] PROBLEM - wiki.patriam.cc - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.patriam.cc could not be found [00:03:48] PROBLEM - permanentfuturelab.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for permanentfuturelab.wiki could not be found [00:03:51] PROBLEM - wiki.mcpirevival.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mcpirevival.tk could not be found [00:03:56] RECOVERY - cp12 Disk Space on cp12 is OK: DISK OK - free space: / 8249 MB (21% inode=96%); [00:04:58] RECOVERY - wiki.triplescripts.org - reverse DNS on sslhost is OK: SSL OK - wiki.triplescripts.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:04:59] RECOVERY - history.sdtef.org - reverse DNS on sslhost is OK: SSL OK - history.sdtef.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:05:00] PROBLEM - baharna.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for baharna.org could not be found [00:05:01] PROBLEM - wiki.wikimedia.cat - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.wikimedia.cat could not be found [00:05:01] PROBLEM - archive.stellurgists.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for archive.stellurgists.wiki could not be found [00:05:03] PROBLEM - www.hoolehistoryheritagesociety.org.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.hoolehistoryheritagesociety.org.uk could not be found [00:05:03] PROBLEM - wiki.ciptamedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.ciptamedia.org could not be found [00:05:04] PROBLEM - en.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.gyaanipedia.com could not be found [00:05:05] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 3.01, 3.11, 2.43 [00:05:10] RECOVERY - cp3 Stunnel Http for mw9 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15403 bytes in 0.981 second response time [00:05:42] PROBLEM - mw8 MediaWiki Rendering on mw8 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:05:48] PROBLEM - cp12 Stunnel Http for mw8 on cp12 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 344 bytes in 0.278 second response time [00:06:13] PROBLEM - wiki.seredrau.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.seredrau.xyz could not be found [00:06:14] PROBLEM - thestarsareright.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for thestarsareright.org could not be found [00:06:16] PROBLEM - animatedfeet.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for animatedfeet.miraheze.org could not be found [00:06:16] PROBLEM - wiki.villagecollaborative.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.villagecollaborative.net could not be found [00:06:18] PROBLEM - wmworld.sktz.live - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wmworld.sktz.live could not be found [00:06:23] PROBLEM - wiki.lefrenchmelee.fr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.lefrenchmelee.fr could not be found [00:06:26] PROBLEM - wiki.slimelab.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.slimelab.net could not be found [00:06:27] PROBLEM - hololive.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hololive.wiki could not be found [00:06:35] PROBLEM - cp13 Stunnel Http for mw8 on cp13 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:06:50] PROBLEM - cp3 Stunnel Http for mw8 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:06:54] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:07:12] PROBLEM - ethene.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ethene.wiki could not be found [00:07:22] PROBLEM - civwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for civwiki.org could not be found [00:07:23] PROBLEM - miraheze.gq - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.gq could not be found [00:07:51] RECOVERY - vitriol.spoon.army - reverse DNS on sslhost is OK: SSL OK - vitriol.spoon.army reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:07:56] RECOVERY - cp12 Stunnel Http for mw8 on cp12 is OK: HTTP OK: HTTP/1.1 200 OK - 15403 bytes in 9.645 second response time [00:07:58] RECOVERY - wikipariksha.com - reverse DNS on sslhost is OK: SSL OK - wikipariksha.com reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:08:00] RECOVERY - adadevelopersacademy.wiki - reverse DNS on sslhost is OK: SSL OK - adadevelopersacademy.wiki reverse DNS resolves to cp12.miraheze.org - NS RECORDS OK [00:08:05] RECOVERY - threedomwiki.pcast.site - reverse DNS on sslhost is OK: SSL OK - threedomwiki.pcast.site reverse DNS resolves to cp12.miraheze.org - CNAME OK [00:08:22] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.42, 22.05, 20.13 [00:08:36] RECOVERY - cp13 Stunnel Http for mw8 on cp13 is OK: HTTP OK: HTTP/1.1 200 OK - 15403 bytes in 4.339 second response time [00:08:53] RECOVERY - cp3 Stunnel Http for mw8 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15403 bytes in 1.139 second response time [00:09:04] PROBLEM - graylog2 Current Load on graylog2 is CRITICAL: CRITICAL - load average: 4.69, 3.65, 2.80 [00:09:11] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JBu6G [00:09:13] [02miraheze/ManageWiki] 07Universal-Omega 0385a3d51 - Update ManageWikiFormFactoryBuilder.php [00:09:14] [02ManageWiki] 07Universal-Omega synchronize pull request 03#294: Support wiki descriptions - 13https://git.io/JBleV [00:09:39] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JBu6E [00:09:40] [02miraheze/ManageWiki] 07Universal-Omega 03d0d72fb - Update qqq.json [00:09:42] [02ManageWiki] 07Universal-Omega synchronize pull request 03#294: Support wiki descriptions - 13https://git.io/JBleV [00:09:43] RECOVERY - lakehub.ga - reverse DNS on sslhost is OK: SSL OK - lakehub.ga reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:09:49] RECOVERY - mw8 MediaWiki Rendering on mw8 is OK: HTTP OK: HTTP/1.1 200 OK - 19986 bytes in 1.514 second response time [00:10:02] RECOVERY - wiki.sdbx.dev - reverse DNS on sslhost is OK: SSL OK - wiki.sdbx.dev reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:10:03] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JBu66 [00:10:05] [02miraheze/ManageWiki] 07Universal-Omega 03e7ae69e - Update en.json [00:10:06] [02ManageWiki] 07Universal-Omega synchronize pull request 03#294: Support wiki descriptions - 13https://git.io/JBleV [00:10:09] RECOVERY - wiki.nowchess.org - reverse DNS on sslhost is OK: SSL OK - wiki.nowchess.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:10:11] RECOVERY - thelonsdalebattalion.co.uk - reverse DNS on sslhost is OK: SSL OK - thelonsdalebattalion.co.uk reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:10:13] miraheze/ManageWiki - Universal-Omega the build passed. [00:10:14] RECOVERY - mabi.myomi.net - reverse DNS on sslhost is OK: SSL OK - mabi.myomi.net reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:10:16] RECOVERY - wikiru.wildterra2.com - reverse DNS on sslhost is OK: SSL OK - wikiru.wildterra2.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:10:29] RECOVERY - wiki.patriam.cc - reverse DNS on sslhost is OK: SSL OK - wiki.patriam.cc reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:10:30] RECOVERY - wiki.newnormal.fans - reverse DNS on sslhost is OK: SSL OK - wiki.newnormal.fans reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:10:33] RECOVERY - permanentfuturelab.wiki - reverse DNS on sslhost is OK: SSL OK - permanentfuturelab.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:10:35] RECOVERY - commons.gyaanipedia.com - reverse DNS on sslhost is OK: SSL OK - commons.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:10:36] RECOVERY - wiki.mcpirevival.tk - reverse DNS on sslhost is OK: SSL OK - wiki.mcpirevival.tk reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:10:38] RECOVERY - www.johanloopmans.nl - reverse DNS on sslhost is OK: SSL OK - www.johanloopmans.nl reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:10:42] miraheze/ManageWiki - Universal-Omega the build passed. [00:10:55] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:11:06] miraheze/ManageWiki - Universal-Omega the build passed. [00:11:49] RECOVERY - baharna.org - reverse DNS on sslhost is OK: SSL OK - baharna.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:11:52] RECOVERY - archive.stellurgists.wiki - reverse DNS on sslhost is OK: SSL OK - archive.stellurgists.wiki reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:11:52] RECOVERY - wiki.wikimedia.cat - reverse DNS on sslhost is OK: SSL OK - wiki.wikimedia.cat reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:11:53] RECOVERY - www.hoolehistoryheritagesociety.org.uk - reverse DNS on sslhost is OK: SSL OK - www.hoolehistoryheritagesociety.org.uk reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:11:56] RECOVERY - wiki.ciptamedia.org - reverse DNS on sslhost is OK: SSL OK - wiki.ciptamedia.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:11:57] RECOVERY - en.gyaanipedia.com - reverse DNS on sslhost is OK: SSL OK - en.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:12:20] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 32.56, 24.32, 21.28 [00:12:58] RECOVERY - thestarsareright.org - reverse DNS on sslhost is OK: SSL OK - thestarsareright.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:12:59] RECOVERY - wiki.seredrau.xyz - reverse DNS on sslhost is OK: SSL OK - wiki.seredrau.xyz reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:03] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.32, 3.70, 3.02 [00:13:04] RECOVERY - animatedfeet.miraheze.org - reverse DNS on sslhost is OK: SSL OK - animatedfeet.miraheze.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:13:05] RECOVERY - wiki.villagecollaborative.net - reverse DNS on sslhost is OK: SSL OK - wiki.villagecollaborative.net reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:08] RECOVERY - wmworld.sktz.live - reverse DNS on sslhost is OK: SSL OK - wmworld.sktz.live reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:17] [02WikiDiscover] 07Universal-Omega closed pull request 03#54: Support description - 13https://git.io/JBEor [00:13:17] RECOVERY - wiki.lefrenchmelee.fr - reverse DNS on sslhost is OK: SSL OK - wiki.lefrenchmelee.fr reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:18] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JBuiO [00:13:19] RECOVERY - wiki.slimelab.net - reverse DNS on sslhost is OK: SSL OK - wiki.slimelab.net reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:20] [02miraheze/WikiDiscover] 07Universal-Omega 03c192de8 - Support description (#54) [00:13:21] RECOVERY - hololive.wiki - reverse DNS on sslhost is OK: SSL OK - hololive.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:13:21] [02miraheze/WikiDiscover] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [00:13:23] [02WikiDiscover] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vhUAp [00:13:29] [02ManageWiki] 07Universal-Omega closed pull request 03#294: Support wiki descriptions - 13https://git.io/JBleV [00:13:31] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://git.io/JBui3 [00:13:32] [02miraheze/ManageWiki] 07Universal-Omega 03b4f4643 - Support wiki descriptions (#294) [00:13:34] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [00:13:35] [02ManageWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vpSns [00:13:54] RECOVERY - ethene.wiki - reverse DNS on sslhost is OK: SSL OK - ethene.wiki reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:14:13] RECOVERY - civwiki.org - reverse DNS on sslhost is OK: SSL OK - civwiki.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:14:14] RECOVERY - miraheze.gq - reverse DNS on sslhost is OK: SSL OK - miraheze.gq reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:14:16] miraheze/WikiDiscover - Universal-Omega the build passed. [00:14:19] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.96, 22.89, 21.11 [00:14:22] miraheze/ManageWiki - Universal-Omega the build passed. [00:15:03] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 2.74, 3.39, 2.99 [00:20:20] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 26.20, 21.95, 21.02 [00:24:20] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.28, 22.25, 21.39 [00:25:36] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.84, 6.69, 6.47 [00:27:30] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.01, 6.88, 6.55 [00:27:41] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.65, 7.36, 6.56 [00:29:25] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.68, 6.90, 6.60 [00:29:39] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.87, 7.30, 6.65 [00:31:04] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:31:21] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.40, 6.41, 6.46 [00:31:42] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.36, 7.31, 6.70 [00:32:19] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.40, 19.11, 20.34 [00:33:42] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.76, 7.00, 6.67 [00:35:43] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.50, 6.31, 6.44 [00:39:01] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [00:39:15] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.13, 20.40, 20.62 [00:41:10] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 27.71, 21.52, 20.91 [00:43:06] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 24.00, 21.27, 20.84 [00:45:01] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.49, 18.78, 20.00 [00:48:32] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.70, 6.93, 6.58 [00:54:17] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.69, 6.68, 6.64 [00:59:10] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±2] 13https://git.io/JBuQq [00:59:12] [02miraheze/mediawiki] 07Universal-Omega 03b8b5e05 - Update ManageWiki and WikiDiscover [01:07:00] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [01:07:40] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.11, 7.31, 6.90 [01:11:29] PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:11:29] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.93, 6.36, 6.62 [01:12:42] PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:13:12] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:14:42] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [01:15:08] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [01:15:18] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.04, 7.09, 6.86 [01:15:26] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:16:01] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.61, 19.99, 19.22 [01:18:03] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 34.61, 24.26, 20.79 [01:19:05] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.08, 7.58, 7.06 [01:20:35] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.76, 4.87, 3.11 [01:20:48] !log sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki=loginwiki on mw* / jbr* / test3 [01:20:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:22:19] PROBLEM - meta.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for meta.gyaanipedia.com could not be found [01:22:20] PROBLEM - pastport.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pastport.org could not be found [01:22:22] PROBLEM - www.hoolehistoryheritagesociety.org.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.hoolehistoryheritagesociety.org.uk could not be found [01:22:23] PROBLEM - wiki.macc.nyc - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.macc.nyc could not be found [01:22:33] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.36, 4.59, 3.21 [01:22:55] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.50, 7.73, 7.24 [01:25:56] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.60, 23.63, 22.79 [01:26:43] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.27, 7.42, 7.19 [01:27:20] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.92, 7.28, 6.65 [01:29:12] RECOVERY - www.hoolehistoryheritagesociety.org.uk - reverse DNS on sslhost is OK: SSL OK - www.hoolehistoryheritagesociety.org.uk reverse DNS resolves to cp13.miraheze.org - CNAME OK [01:29:14] RECOVERY - meta.gyaanipedia.com - reverse DNS on sslhost is OK: SSL OK - meta.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [01:29:18] RECOVERY - pastport.org - reverse DNS on sslhost is OK: SSL OK - pastport.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [01:29:21] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.62, 6.99, 6.63 [01:29:23] RECOVERY - wiki.macc.nyc - reverse DNS on sslhost is OK: SSL OK - wiki.macc.nyc reverse DNS resolves to cp13.miraheze.org - CNAME OK [01:30:31] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 4.91, 6.50, 6.88 [01:32:26] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.14, 7.39, 7.16 [01:35:20] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.95, 6.32, 6.51 [01:36:15] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.71, 6.76, 6.97 [01:38:12] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.99, 6.29, 6.79 [01:39:24] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.89, 18.03, 20.06 [01:40:57] [02MirahezeMagic] 07Universal-Omega commented on pull request 03#267: T6471: Create rebuildVersionCache.php - 13https://git.io/JBzeC [01:41:09] [02MirahezeMagic] 07Universal-Omega closed pull request 03#267: T6471: Create rebuildVersionCache.php - 13https://git.io/Jn6sA [01:41:11] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JBzel [01:41:12] [02miraheze/MirahezeMagic] 07Universal-Omega 0301292e8 - T6471: Create rebuildVersionCache.php (#267) [01:41:14] [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/fQRGX [01:41:15] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [01:42:03] miraheze/MirahezeMagic - Universal-Omega the build passed. [01:43:04] [02mw-config] 07Universal-Omega edited pull request 03#3987: T6471: Set wgGitInfoCacheDirectory - 13https://git.io/JckWv [01:45:11] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.84, 20.14, 20.29 [01:47:06] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.91, 17.84, 19.43 [01:51:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.91, 6.77, 7.82 [02:00:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.05, 7.08, 7.97 [02:03:58] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.64, 8.87, 8.08 [02:04:10] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.40, 8.64, 8.32 [02:09:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.45, 7.67, 7.92 [02:10:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.82, 7.08, 7.80 [02:13:58] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.57, 7.50, 7.72 [02:17:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.76, 7.37, 7.62 [02:18:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.88, 7.38, 7.54 [02:19:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.27, 7.93, 7.78 [02:22:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.41, 7.62, 7.61 [02:23:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.97, 7.81, 7.82 [02:26:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.20, 7.88, 7.69 [02:27:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.99, 8.34, 8.03 [02:29:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.78, 7.90, 7.89 [02:31:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.24, 8.07, 7.96 [02:33:58] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.97, 7.90, 7.89 [02:38:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.97, 7.33, 7.75 [02:47:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.57, 7.78, 7.67 [02:50:10] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.44, 8.30, 7.82 [02:50:22] https://phabricator.miraheze.org/T7716 [02:50:23] [url] ⚓ T7716 Polls not working (awfulmovies.miraheze.org) | phabricator.miraheze.org [02:57:20] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.85, 7.58, 6.61 [02:59:13] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.73, 7.04, 6.52 [03:01:07] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.74, 6.59, 6.41 [03:24:32] MarioMario456: Already seen. I'll look tomorrow if no one else does first. [03:28:03] !log GDPR script [03:28:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:43:05] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.03, 1.65, 1.28 [03:45:02] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.99, 1.32, 1.20 [04:06:12] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.27, 7.00, 6.37 [04:06:20] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.06, 21.35, 18.43 [04:08:12] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.52, 6.30, 6.18 [04:08:20] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.41, 18.85, 17.85 [04:12:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.06, 6.25, 7.71 [04:14:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.38, 7.38, 7.94 [04:16:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.68, 6.94, 7.70 [04:20:10] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.81, 7.38, 7.62 [04:22:10] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.68, 6.30, 7.20 [04:27:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.04, 6.32, 7.59 [04:28:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.00, 5.52, 6.62 [04:33:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.04, 7.58, 7.62 [04:34:10] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.70, 8.80, 7.50 [04:35:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.46, 6.79, 7.33 [04:36:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.54, 7.82, 7.30 [04:38:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.02, 8.80, 7.73 [04:40:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.74, 7.59, 7.41 [04:41:57] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.52, 5.89, 6.78 [04:48:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.06, 6.36, 6.80 [04:48:30] PROBLEM - wiki.elgeis.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.elgeis.com' expires in 15 day(s) (Sun 15 Aug 2021 04:46:27 GMT +0000). [04:49:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JBzAA [04:49:26] [02miraheze/ssl] 07MirahezeSSLBot 035511ff7 - Bot: Update SSL cert for wiki.elgeis.com [04:53:33] PROBLEM - wiki.park-city.club - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.park-city.club' expires in 15 day(s) (Sun 15 Aug 2021 04:50:39 GMT +0000). [04:53:53] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JBzpv [04:53:55] [02miraheze/ssl] 07MirahezeSSLBot 03c95c7a4 - Bot: Update SSL cert for wiki.park-city.club [04:54:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.25, 7.09, 6.91 [04:54:42] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.39, 6.99, 6.88 [04:56:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.34, 6.68, 6.77 [04:56:37] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.37, 6.56, 6.72 [05:05:22] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.89, 9.63, 7.76 [05:07:06] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.47, 7.23, 7.02 [05:09:14] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.02, 7.46, 7.23 [05:12:57] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.70, 6.47, 6.74 [05:16:59] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.27, 6.05, 6.68 [05:20:47] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.62, 7.96, 7.20 [05:22:43] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 8.00, 7.83, 7.24 [05:22:47] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.39, 6.98, 6.93 [05:24:39] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.92, 8.24, 7.46 [05:24:42] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.19, 7.35, 7.07 [05:25:33] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.82, 6.39, 5.89 [05:26:35] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.74, 7.95, 7.44 [05:26:37] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.54, 6.61, 6.83 [05:27:29] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.84, 6.19, 5.89 [05:28:34] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.56, 6.59, 6.79 [05:29:55] RECOVERY - wiki.elgeis.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.elgeis.com' will expire on Thu 28 Oct 2021 03:49:16 GMT +0000. [05:33:58] RECOVERY - wiki.park-city.club - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.park-city.club' will expire on Thu 28 Oct 2021 03:53:45 GMT +0000. [05:34:20] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.48, 7.87, 7.45 [05:36:20] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.85, 6.96, 6.97 [05:38:12] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.52, 7.58, 7.45 [05:38:18] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.95, 6.37, 6.76 [05:46:10] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.35, 5.88, 6.69 [05:50:11] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.85, 6.80, 6.86 [05:51:59] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.55, 6.64, 6.41 [05:53:56] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.21, 6.43, 6.36 [05:54:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.82, 6.10, 6.60 [06:01:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.03, 6.82, 6.48 [06:03:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.20, 8.28, 7.04 [06:05:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.85, 7.97, 7.08 [06:06:08] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.35, 7.56, 7.05 [06:13:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.64, 8.69, 7.61 [06:14:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.95, 7.66, 7.22 [06:21:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.79, 7.57, 7.61 [06:22:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.79, 7.69, 7.58 [06:24:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.18, 7.82, 7.63 [06:25:58] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.17, 8.32, 7.88 [06:27:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.76, 7.74, 7.72 [06:30:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.39, 7.78, 7.75 [06:31:58] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.88, 7.85, 7.68 [06:32:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.81, 8.35, 7.95 [06:33:53] RECOVERY - mail2 APT on mail2 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:33:58] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.46, 7.49, 7.56 [06:35:58] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.60, 7.63, 7.59 [06:37:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.30, 7.43, 7.52 [06:38:08] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.77, 7.74, 7.88 [06:42:08] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.07, 6.99, 7.46 [06:43:57] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.32, 7.46, 7.36 [06:44:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.85, 7.31, 7.52 [06:44:12] RECOVERY - graylog2 APT on graylog2 is OK: APT OK: 3 packages available for upgrade (0 critical updates). [06:45:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.19, 6.58, 7.05 [06:47:58] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.54, 7.59, 7.36 [06:50:11] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.03, 8.26, 7.77 [06:51:00] RECOVERY - puppet3 APT on puppet3 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:51:58] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.82, 7.55, 7.48 [06:52:11] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.67, 7.55, 7.57 [06:54:10] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.01, 8.11, 7.77 [06:56:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.47, 7.83, 7.70 [07:00:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.33, 8.23, 7.83 [07:03:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.08, 8.20, 7.57 [07:05:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.67, 7.78, 7.48 [07:08:09] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.14, 7.90, 7.96 [07:15:56] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.08, 5.83, 6.63 [07:19:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.08, 6.70, 6.81 [07:26:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.48, 5.93, 6.66 [07:27:56] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.89, 6.58, 6.79 [07:31:10] PROBLEM - kk.uncyc.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'kk.uncyc.tk' expires in 7 day(s) (Sat 07 Aug 2021 07:25:50 GMT +0000). [07:35:06] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.28, 7.38, 6.91 [07:35:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.87, 7.16, 6.97 [07:37:02] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.36, 6.40, 6.62 [07:37:58] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.62, 6.49, 6.74 [07:47:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.49, 6.90, 6.68 [07:49:57] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.19, 6.80, 6.68 [07:53:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.34, 7.42, 6.96 [07:54:33] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.12, 6.92, 6.36 [07:56:29] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.76, 6.53, 6.28 [07:57:24] [02ssl] 07RhinosF1 synchronize pull request 03#419: kk.uncyc.tk: wiki does not exist - 13https://git.io/JcgfH [07:57:40] Reception123: ^ [07:57:57] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.89, 6.44, 6.65 [08:01:56] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.72, 7.10, 6.92 [08:02:19] [02ssl] 07Reception123 closed pull request 03#419: kk.uncyc.tk: wiki does not exist - 13https://git.io/JcgfH [08:02:21] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JBg5r [08:02:22] [02miraheze/ssl] 07RhinosF1 03202a5b2 - kk.uncyc.tk: wiki does not exist (#419) [08:03:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.23, 7.81, 7.19 [08:06:15] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.45, 7.82, 6.99 [08:07:58] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.23, 7.69, 7.36 [08:10:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.52, 6.18, 6.51 [08:15:59] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.01, 6.09, 6.69 [08:18:12] [02puppet] 07Universal-Omega opened pull request 03#1828: Remove cron for updateSpecialPages.php - 13https://git.io/JBgxZ [08:19:14] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JBgxo [08:19:16] [02miraheze/mw-config] 07Universal-Omega 030ee7e13 - Remove wgMiserMode [08:19:17] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [08:19:19] [02mw-config] 07Universal-Omega opened pull request 03#4021: Remove wgMiserMode - 13https://git.io/JBgx6 [08:19:59] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.17, 6.94, 6.91 [08:20:16] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.90, 6.65, 6.48 [08:20:20] miraheze/mw-config - Universal-Omega the build passed. [08:22:10] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.05, 6.39, 6.40 [08:23:56] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.61, 6.60, 6.77 [08:26:59] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-3 [+0/-0/±1] 13https://git.io/JBgjz [08:27:01] [02miraheze/mw-config] 07RhinosF1 03ab7e74d - LS: Set wgWikiDiscoverUseDescriptions to true [08:27:02] [02mw-config] 07RhinosF1 created branch 03RhinosF1-patch-3 - 13https://git.io/vbvb3 [08:28:50] [02mw-config] 07RhinosF1 opened pull request 03#4022: LS: Set wgWikiDiscoverUseDescriptions to true - 13https://git.io/JB2en [08:28:59] !log deploying mw-config#4022 to test3 [08:29:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:29:47] miraheze/mw-config - RhinosF1 the build passed. [08:30:20] Universal_Omega: looks to display fine [08:31:33] [02mw-config] 07RhinosF1 commented on pull request 03#4022: LS: Set wgWikiDiscoverUseDescriptions to true - 13https://git.io/JB2vn [08:31:39] [02mw-config] 07RhinosF1 closed pull request 03#4022: LS: Set wgWikiDiscoverUseDescriptions to true - 13https://git.io/JB2en [08:31:40] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JB2vC [08:31:42] [02miraheze/mw-config] 07RhinosF1 035947c33 - LS: Set wgWikiDiscoverUseDescriptions to true (#4022) [08:31:43] [02mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-3 - 13https://git.io/vbvb3 [08:31:45] [02miraheze/mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-3 [08:32:00] PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: deploying mw-config@ab7e4d, last run 28 minutes ago with 0 failures [08:32:14] RhinosF1: great thanks for deploying then! [08:32:30] miraheze/mw-config - RhinosF1 the build passed. [08:33:06] !log [rhinos@test3] enabled puppet [08:33:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:33:27] [02mw-config] 07Universal-Omega commented on pull request 03#4022: LS: Set wgWikiDiscoverUseDescriptions to true - 13https://git.io/JB2fe [08:33:56] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 51 seconds ago with 0 failures [08:35:34] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.20, 6.87, 6.66 [08:35:35] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.03, 7.34, 6.56 [08:37:30] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.60, 7.49, 6.71 [08:39:27] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.35, 6.62, 6.61 [08:41:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.96, 6.69, 6.57 [08:41:43] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JB2Ug [08:41:45] [02miraheze/mw-config] 07RhinosF1 03225491a - ignore: key files [08:42:11] Reception123: fyii ^ [08:42:39] miraheze/mw-config - RhinosF1 the build passed. [08:43:37] ack, thanks [08:44:10] Reception123: I'm trying to work out how we can do deploys in a staging system [08:46:28] oh how do you mean? [08:46:31] Reception123: but to know if it will work I probably need to super break test3 [08:47:36] ah [08:53:58] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.58, 7.08, 6.80 [08:55:53] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.42, 6.77, 6.72 [09:03:19] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-3 [+0/-0/±1] 13https://git.io/JB2qL [09:03:20] [02miraheze/mw-config] 07RhinosF1 0373d5763 - test3: test a theory [09:03:22] [02mw-config] 07RhinosF1 created branch 03RhinosF1-patch-3 - 13https://git.io/vbvb3 [09:03:23] [02mw-config] 07RhinosF1 opened pull request 03#4023: test3: test a theory - 13https://git.io/JB2qm [09:04:23] miraheze/mw-config - RhinosF1 the build passed. [09:05:29] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.51, 7.57, 6.94 [09:06:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.23, 7.59, 6.91 [09:07:23] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.37, 7.48, 6.98 [09:08:24] [02mw-config] 07RhinosF1 edited pull request 03#4023: test3: test a theory - 13https://git.io/JB2qm [09:11:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.48, 6.54, 6.69 [09:11:17] !log [rhinos@test3] Disabling puppet for new mw deploy testing [09:11:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:12:04] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.79, 6.47, 6.67 [09:15:58] PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: new mw deploy testing, last run 4 minutes ago with 0 failures [09:20:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.37, 6.81, 6.71 [09:20:58] [02mw-config] 07RhinosF1 commented on pull request 03#4023: test3: test a theory - 13https://git.io/JB2Zw [09:20:59] [02mw-config] 07RhinosF1 closed pull request 03#4023: test3: test a theory - 13https://git.io/JB2qm [09:21:01] [02miraheze/mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-3 [09:21:02] [02mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-3 - 13https://git.io/vbvb3 [09:22:04] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.63, 6.41, 6.58 [09:33:20]