[00:02:40] RECOVERY - cp12 Disk Space on cp12 is OK: DISK OK - free space: / 8093 MB (20% inode=96%); [00:02:43] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Puppet has 6 failures. Last run 2 minutes ago with 6 failures. Failed resources (up to 3 shown) [00:02:57] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.17, 6.01, 6.79 [00:03:55] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 35.86, 27.30, 22.52 [00:05:40] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.38.69.175/cpweb, 2001:41d0:801:2000::58af/cpweb, 51.222.25.132/cpweb, 2607:5300:205:200::1c30/cpweb [00:05:44] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 6 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb, 51.38.69.175/cpweb, 2001:41d0:801:2000::58af/cpweb, 51.222.25.132/cpweb, 2607:5300:205:200::1c30/cpweb [00:06:32] PROBLEM - cp13 Stunnel Http for mw9 on cp13 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:06:33] PROBLEM - dcmultiverse.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dcmultiverse.miraheze.org could not be found [00:06:39] PROBLEM - wiki.mussa.id - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mussa.id could not be found [00:06:40] PROBLEM - wiki.umbranet.mandelbrotgames.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.umbranet.mandelbrotgames.com could not be found [00:06:41] PROBLEM - pwiki.drydraytonvillagehall.org.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pwiki.drydraytonvillagehall.org.uk could not be found [00:06:48] PROBLEM - cp13 Stunnel Http for mw8 on cp13 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:06:53] PROBLEM - cp12 Stunnel Http for mw8 on cp12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:06:56] PROBLEM - www.stardewmodding.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.stardewmodding.wiki could not be found [00:06:56] PROBLEM - petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for petrawiki.org could not be found [00:06:57] PROBLEM - rothwell-leeds.co.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rothwell-leeds.co.uk could not be found [00:06:59] PROBLEM - wikimoma.art - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikimoma.art could not be found [00:06:59] PROBLEM - pornwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pornwiki.org could not be found [00:07:00] PROBLEM - wiki.wilderyogi.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.wilderyogi.eu could not be found [00:07:01] PROBLEM - files.petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for files.petrawiki.org could not be found [00:07:04] PROBLEM - fc.songcontests.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for fc.songcontests.eu could not be found [00:07:04] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 13.75, 9.47, 7.91 [00:07:05] PROBLEM - wiki.s23.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.s23.org could not be found [00:07:09] PROBLEM - usaha.click - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for usaha.click could not be found [00:07:16] PROBLEM - mabi.myomi.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mabi.myomi.net could not be found [00:07:17] PROBLEM - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.gesamtschule-nordkirchen.de could not be found [00:07:24] PROBLEM - en.petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.petrawiki.org could not be found [00:07:25] PROBLEM - cubashpedia.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cubashpedia.cf could not be found [00:07:26] PROBLEM - files.pornwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for files.pornwiki.org could not be found [00:07:27] PROBLEM - mw9 MediaWiki Rendering on mw9 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:07:41] PROBLEM - cp3 Stunnel Http for mw9 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:07:59] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.46, 23.89, 22.31 [00:08:01] PROBLEM - cp12 Stunnel Http for mw9 on cp12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:08:43] RECOVERY - cp13 Stunnel Http for mw8 on cp13 is OK: HTTP OK: HTTP/1.1 200 OK - 15403 bytes in 0.128 second response time [00:08:47] PROBLEM - wiki.worldsofweary.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.worldsofweary.com could not be found [00:08:49] PROBLEM - wiki.vinesh.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.vinesh.eu.org could not be found [00:08:50] RECOVERY - cp12 Stunnel Http for mw8 on cp12 is OK: HTTP OK: HTTP/1.1 200 OK - 15403 bytes in 0.346 second response time [00:08:51] PROBLEM - zh.internetpedia.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for zh.internetpedia.tk could not be found [00:08:53] PROBLEM - wiki.etn.link - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.etn.link could not be found [00:08:54] PROBLEM - archive.a2b2.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for archive.a2b2.org could not be found [00:08:55] PROBLEM - miraheze.gq - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.gq could not be found [00:08:55] PROBLEM - uncyclopediakr.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for uncyclopediakr.miraheze.org could not be found [00:08:56] PROBLEM - marthaspeaks.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for marthaspeaks.miraheze.org could not be found [00:09:22] PROBLEM - franchise.franchising.org.ua - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for franchise.franchising.org.ua could not be found [00:09:22] PROBLEM - wiki.chouverse.cludisciples.cyou - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.chouverse.cludisciples.cyou could not be found [00:09:33] RECOVERY - mw9 MediaWiki Rendering on mw9 is OK: HTTP OK: HTTP/1.1 200 OK - 19984 bytes in 9.859 second response time [00:09:43] RECOVERY - cp3 Stunnel Http for mw9 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15403 bytes in 5.310 second response time [00:09:44] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:09:58] RECOVERY - cp12 Stunnel Http for mw9 on cp12 is OK: HTTP OK: HTTP/1.1 200 OK - 15403 bytes in 0.897 second response time [00:10:17] PROBLEM - wiki.ct777.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.ct777.cf could not be found [00:10:19] PROBLEM - heavyironmodding.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for heavyironmodding.org could not be found [00:10:20] PROBLEM - www.zenbuddhism.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.zenbuddhism.info could not be found [00:10:20] PROBLEM - test2.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for test2.miraheze.org could not be found [00:10:21] PROBLEM - www.fraterniterebellion.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.fraterniterebellion.com could not be found [00:10:27] PROBLEM - icinga.bots.miraheze.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for icinga.bots.miraheze.wiki could not be found [00:10:27] PROBLEM - poserdazfreebies.orain.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for poserdazfreebies.orain.org could not be found [00:10:28] PROBLEM - www.programming.red - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.programming.red could not be found [00:10:33] PROBLEM - madzebrascience.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for madzebrascience.wiki could not be found [00:10:34] PROBLEM - wiki.yumeka.icu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.yumeka.icu could not be found [00:10:35] PROBLEM - speleo.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for speleo.wiki could not be found [00:10:35] PROBLEM - wiki.cyberfurs.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.cyberfurs.org could not be found [00:10:36] PROBLEM - wiki.graalmilitary.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.graalmilitary.com could not be found [00:10:39] PROBLEM - wmworld.sktz.live - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wmworld.sktz.live could not be found [00:10:39] RECOVERY - cp13 Stunnel Http for mw9 on cp13 is OK: HTTP OK: HTTP/1.1 200 OK - 15403 bytes in 0.031 second response time [00:10:41] PROBLEM - matttest.mtwiki.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for matttest.mtwiki.cf could not be found [00:10:43] PROBLEM - wildcard.bots.miraheze.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wildcard.bots.miraheze.wiki could not be found [00:11:27] [02mw-config] 07Universal-Omega commented on pull request 03#4026: DynamicPageList edit for my wiki - 13https://git.io/JBreM [00:11:32] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:11:59] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 33.45, 26.30, 23.45 [00:12:55] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.18, 7.64, 7.79 [00:13:22] RECOVERY - dcmultiverse.miraheze.org - reverse DNS on sslhost is OK: SSL OK - dcmultiverse.miraheze.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:13:31] RECOVERY - wiki.umbranet.mandelbrotgames.com - reverse DNS on sslhost is OK: SSL OK - wiki.umbranet.mandelbrotgames.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:37] RECOVERY - wiki.mussa.id - reverse DNS on sslhost is OK: SSL OK - wiki.mussa.id reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:40] RECOVERY - www.stardewmodding.wiki - reverse DNS on sslhost is OK: SSL OK - www.stardewmodding.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:13:41] RECOVERY - pwiki.drydraytonvillagehall.org.uk - reverse DNS on sslhost is OK: SSL OK - pwiki.drydraytonvillagehall.org.uk reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:42] RECOVERY - rothwell-leeds.co.uk - reverse DNS on sslhost is OK: SSL OK - rothwell-leeds.co.uk reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:13:46] RECOVERY - files.petrawiki.org - reverse DNS on sslhost is OK: SSL OK - files.petrawiki.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:13:54] RECOVERY - petrawiki.org - reverse DNS on sslhost is OK: SSL OK - petrawiki.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:13:54] RECOVERY - wiki.s23.org - reverse DNS on sslhost is OK: SSL OK - wiki.s23.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:55] RECOVERY - fc.songcontests.eu - reverse DNS on sslhost is OK: SSL OK - fc.songcontests.eu reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:57] RECOVERY - wikimoma.art - reverse DNS on sslhost is OK: SSL OK - wikimoma.art reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:13:58] RECOVERY - pornwiki.org - reverse DNS on sslhost is OK: SSL OK - pornwiki.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:13:59] RECOVERY - mabi.myomi.net - reverse DNS on sslhost is OK: SSL OK - mabi.myomi.net reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:13:59] RECOVERY - wiki.wilderyogi.eu - reverse DNS on sslhost is OK: SSL OK - wiki.wilderyogi.eu reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:14:01] RECOVERY - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is OK: SSL OK - wiki.gesamtschule-nordkirchen.de reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:14:02] RECOVERY - usaha.click - reverse DNS on sslhost is OK: SSL OK - usaha.click reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:14:18] RECOVERY - cubashpedia.cf - reverse DNS on sslhost is OK: SSL OK - cubashpedia.cf reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:14:22] RECOVERY - en.petrawiki.org - reverse DNS on sslhost is OK: SSL OK - en.petrawiki.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:14:26] RECOVERY - files.pornwiki.org - reverse DNS on sslhost is OK: SSL OK - files.pornwiki.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:15:41] RECOVERY - wiki.worldsofweary.com - reverse DNS on sslhost is OK: SSL OK - wiki.worldsofweary.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:15:46] RECOVERY - zh.internetpedia.tk - reverse DNS on sslhost is OK: SSL OK - zh.internetpedia.tk reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:15:47] RECOVERY - wiki.vinesh.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.vinesh.eu.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:15:49] RECOVERY - wiki.etn.link - reverse DNS on sslhost is OK: SSL OK - wiki.etn.link reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:15:49] RECOVERY - archive.a2b2.org - reverse DNS on sslhost is OK: SSL OK - archive.a2b2.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:15:51] RECOVERY - uncyclopediakr.miraheze.org - reverse DNS on sslhost is OK: SSL OK - uncyclopediakr.miraheze.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:15:53] RECOVERY - miraheze.gq - reverse DNS on sslhost is OK: SSL OK - miraheze.gq reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:15:54] RECOVERY - marthaspeaks.miraheze.org - reverse DNS on sslhost is OK: SSL OK - marthaspeaks.miraheze.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:16:02] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JBrvl [00:16:04] [02miraheze/mw-config] 07Universal-Omega 03d6fdd73 - remove commented cp10 and cp11 IPs [00:16:09] RECOVERY - franchise.franchising.org.ua - reverse DNS on sslhost is OK: SSL OK - franchise.franchising.org.ua reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:16:23] RECOVERY - wiki.chouverse.cludisciples.cyou - reverse DNS on sslhost is OK: SSL OK - wiki.chouverse.cludisciples.cyou reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:16:24] [02mw-config] 07Njsmooth commented on pull request 03#4026: DynamicPageList edit for my wiki - 13https://git.io/JBrv0 [00:17:00] RECOVERY - wiki.ct777.cf - reverse DNS on sslhost is OK: SSL OK - wiki.ct777.cf reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:17:04] miraheze/mw-config - Universal-Omega the build passed. [00:17:05] RECOVERY - www.zenbuddhism.info - reverse DNS on sslhost is OK: SSL OK - www.zenbuddhism.info reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:17:05] RECOVERY - test2.miraheze.org - reverse DNS on sslhost is OK: SSL OK - test2.miraheze.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:17:06] RECOVERY - heavyironmodding.org - reverse DNS on sslhost is OK: SSL OK - heavyironmodding.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:17:07] RECOVERY - www.fraterniterebellion.com - reverse DNS on sslhost is OK: SSL OK - www.fraterniterebellion.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:17:13] RECOVERY - wiki.yumeka.icu - reverse DNS on sslhost is OK: SSL OK - wiki.yumeka.icu reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:17:15] RECOVERY - speleo.wiki - reverse DNS on sslhost is OK: SSL OK - speleo.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:17:16] RECOVERY - wiki.cyberfurs.org - reverse DNS on sslhost is OK: SSL OK - wiki.cyberfurs.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:17:18] RECOVERY - icinga.bots.miraheze.wiki - reverse DNS on sslhost is OK: SSL OK - icinga.bots.miraheze.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:17:18] RECOVERY - poserdazfreebies.orain.org - reverse DNS on sslhost is OK: SSL OK - poserdazfreebies.orain.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:17:23] RECOVERY - www.programming.red - reverse DNS on sslhost is OK: SSL OK - www.programming.red reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:17:27] RECOVERY - matttest.mtwiki.cf - reverse DNS on sslhost is OK: SSL OK - matttest.mtwiki.cf reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:17:31] RECOVERY - wildcard.bots.miraheze.wiki - reverse DNS on sslhost is OK: SSL OK - wildcard.bots.miraheze.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:17:33] RECOVERY - madzebrascience.wiki - reverse DNS on sslhost is OK: SSL OK - madzebrascience.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:17:34] RECOVERY - wiki.graalmilitary.com - reverse DNS on sslhost is OK: SSL OK - wiki.graalmilitary.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:17:37] RECOVERY - wmworld.sktz.live - reverse DNS on sslhost is OK: SSL OK - wmworld.sktz.live reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:19:24] If I would like to request a change to the value of a config (wgOAuth2RefreshTokenTTL) where is the best place to do that? [00:20:38] https://phabricator.miraheze.org probably [00:20:39] [url] Main Page | phabricator.miraheze.org [00:20:56] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.26, 5.55, 6.64 [00:21:08] Alright, time for another OAuth2 related task... [00:21:26] Extension:OAuth has really weird default values for that setting [00:21:33] [02mw-config] 07Universal-Omega commented on pull request 03#4026: DynamicPageList edit for my wiki - 13https://git.io/JBrfy [00:25:25] [02mw-config] 07Njsmooth opened pull request 03#4028: Custom DPL3 Settings for my wiki - 13https://git.io/JBrUq [00:26:16] miraheze/mw-config - Njsmooth the build passed. [00:32:04] Alright, I made a task: https://phabricator.miraheze.org/T7722 [00:32:05] [url] ⚓ T7722 Change OAuth2 refresh token expiry time to reasonable length | phabricator.miraheze.org [00:32:37] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:37:06] PROBLEM - christipedia.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for christipedia.nl could not be found [00:37:06] PROBLEM - wiki.lefrenchmelee.fr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.lefrenchmelee.fr could not be found [00:37:12] PROBLEM - puardian.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for puardian.xyz could not be found [00:38:33] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.08, 6.68, 5.86 [00:40:01] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 15.86, 21.60, 23.59 [00:42:23] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.56, 6.98, 6.19 [00:43:55] RECOVERY - puardian.xyz - reverse DNS on sslhost is OK: SSL OK - puardian.xyz reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:44:04] RECOVERY - wiki.lefrenchmelee.fr - reverse DNS on sslhost is OK: SSL OK - wiki.lefrenchmelee.fr reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:44:05] RECOVERY - christipedia.nl - reverse DNS on sslhost is OK: SSL OK - christipedia.nl reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:44:17] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.67, 6.45, 6.09 [00:52:10] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 31.63, 22.69, 21.90 [00:54:09] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 17.56, 20.13, 21.05 [00:58:08] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.29, 17.73, 19.89 [01:03:54] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 3.29, 2.19, 1.40 [01:05:54] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.44, 1.89, 1.39 [01:07:54] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.00, 1.58, 1.33 [01:13:47] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.66, 7.06, 6.43 [01:19:31] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.48, 6.10, 6.28 [01:28:17] [02mediawiki] 07Universal-Omega closed pull request 03#2550: Bump extensions/VoteNY from `32ecd7a` to `084ac2e` - 13https://git.io/J4ash [01:28:19] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/VoteNY-084ac2e [01:28:20] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/VoteNY-084ac2e - 13https://git.io/vbL5b [01:28:22] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBrng [01:28:23] [02miraheze/mediawiki] 07dependabot[bot] 036a5282d - Bump extensions/VoteNY from `32ecd7a` to `084ac2e` (#2550) [01:28:30] [02mediawiki] 07Universal-Omega closed pull request 03#2549: Bump extensions/DarkMode from `4dac883` to `e0969b6` - 13https://git.io/J4asb [01:28:31] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBrnw [01:28:33] [02miraheze/mediawiki] 07dependabot[bot] 037afd954 - Bump extensions/DarkMode from `4dac883` to `e0969b6` (#2549) [01:28:34] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/DarkMode-e0969b6 [01:28:36] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/DarkMode-e0969b6 - 13https://git.io/vbL5b [01:28:43] [02mediawiki] 07Universal-Omega closed pull request 03#2548: Bump extensions/TimedMediaHandler from `68402b0` to `6f03ad0` - 13https://git.io/J4asd [01:28:45] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBrny [01:28:46] [02miraheze/mediawiki] 07dependabot[bot] 03440749f - Bump extensions/TimedMediaHandler from `68402b0` to `6f03ad0` (#2548) [01:28:48] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/TimedMediaHandler-6f03ad0 [01:28:49] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/TimedMediaHandler-6f03ad0 - 13https://git.io/vbL5b [01:28:59] [02mediawiki] 07Universal-Omega closed pull request 03#2547: Bump skins/MonoBook from `ee4c89a` to `082990f` - 13https://git.io/J4asH [01:29:00] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBrce [01:29:01] [02miraheze/mediawiki] 07dependabot[bot] 03401c89a - Bump skins/MonoBook from `ee4c89a` to `082990f` (#2547) [01:29:03] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/MonoBook-082990f [01:29:04] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/MonoBook-082990f - 13https://git.io/vbL5b [01:29:19] [02mediawiki] 07Universal-Omega closed pull request 03#2542: Bump extensions/WikiDiscover from `291df22` to `026307b` - 13https://git.io/J4asE [01:29:20] [02mediawiki] 07dependabot[bot] commented on pull request 03#2542: Bump extensions/WikiDiscover from `291df22` to `026307b` - 13https://git.io/JBrcq [01:29:22] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/WikiDiscover-026307b - 13https://git.io/vbL5b [01:29:23] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/WikiDiscover-026307b [01:30:18] [02mediawiki] 07Universal-Omega closed pull request 03#2480: Bump extensions/CreateWiki from `eb851fe` to `2ae032f` - 13https://git.io/J4aqV [01:30:19] [02mediawiki] 07dependabot[bot] commented on pull request 03#2480: Bump extensions/CreateWiki from `eb851fe` to `2ae032f` - 13https://git.io/JBrca [01:30:21] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/CreateWiki-2ae032f - 13https://git.io/vbL5b [01:30:22] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/CreateWiki-2ae032f [01:31:46] [02mediawiki] 07Universal-Omega commented on pull request 03#2446: Bump extensions/MirahezeMagic from `7bb0143` to `1f2ac31` - 13https://git.io/JBrCk [01:31:47] [02mediawiki] 07dependabot[bot] edited pull request 03#2446: Bump extensions/MirahezeMagic from `7bb0143` to `1f2ac31` - 13https://git.io/J4aLm [01:31:57] [02mediawiki] 07Universal-Omega closed pull request 03#2442: Bump extensions/ManageWiki from `56fe4f9` to `9e79791` - 13https://git.io/J4aIb [01:31:59] [02mediawiki] 07dependabot[bot] commented on pull request 03#2442: Bump extensions/ManageWiki from `56fe4f9` to `9e79791` - 13https://git.io/JBrCc [01:32:00] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/ManageWiki-9e79791 - 13https://git.io/vbL5b [01:32:02] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/ManageWiki-9e79791 [01:32:32] [02mediawiki] 07dependabot[bot] edited pull request 03#2446: Bump extensions/MirahezeMagic from `7bb0143` to `1f2ac31` - 13https://git.io/J4aLm [01:32:36] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-01292e8 [+0/-0/±1] 13https://git.io/JBrCP [01:32:38] [02miraheze/mediawiki] 07dependabot[bot] 03e0a0aa1 - Bump extensions/MirahezeMagic from `7bb0143` to `01292e8` [01:32:39] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-01292e8 - 13https://git.io/vbL5b [01:32:41] [02mediawiki] 07dependabot[bot] opened pull request 03#2552: Bump extensions/MirahezeMagic from `7bb0143` to `01292e8` - 13https://git.io/JBrCX [01:32:42] [02mediawiki] 07dependabot[bot] labeled pull request 03#2552: Bump extensions/MirahezeMagic from `7bb0143` to `01292e8` - 13https://git.io/JBrCX [01:32:43] [02mediawiki] 07dependabot[bot] labeled pull request 03#2552: Bump extensions/MirahezeMagic from `7bb0143` to `01292e8` - 13https://git.io/JBrCX [01:32:45] [02mediawiki] 07dependabot[bot] commented on pull request 03#2446: Bump extensions/MirahezeMagic from `7bb0143` to `1f2ac31` - 13https://git.io/JBrCD [01:32:46] [02mediawiki] 07dependabot[bot] closed pull request 03#2446: Bump extensions/MirahezeMagic from `7bb0143` to `1f2ac31` - 13https://git.io/J4aLm [01:32:48] [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-1f2ac31 [01:32:50] [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-1f2ac31 - 13https://git.io/vbL5b [01:33:16] [02mediawiki] 07Universal-Omega closed pull request 03#2552: Bump extensions/MirahezeMagic from `7bb0143` to `01292e8` - 13https://git.io/JBrCX [01:33:17] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBrWJ [01:33:19] [02miraheze/mediawiki] 07dependabot[bot] 037fc58b4 - Bump extensions/MirahezeMagic from `7bb0143` to `01292e8` (#2552) [01:33:20] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-01292e8 - 13https://git.io/vbL5b [01:33:22] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-01292e8 [01:38:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.56, 6.61, 7.75 [01:39:14] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.55, 6.54, 7.89 [01:39:58] PROBLEM - test3 Puppet on test3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:40:18] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:41:10] PROBLEM - jobrunner4 Puppet on jobrunner4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:41:19] PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:41:54] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:42:13] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:42:36] PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [01:46:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.02, 6.97, 7.44 [01:52:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.93, 7.43, 7.54 [01:54:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.14, 8.09, 7.77 [01:55:13] !log cd /srv/mediawiki/w && sudo -u www-data git fetch && sudo -u www-data git reset --hard origin/REL1_36 && sudo puppet agent -tv on mw* / jbr* [01:55:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:56:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.32, 7.62, 7.65 [01:56:04] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:57:09] RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:57:19] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [01:58:12] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:58:17] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:58:33] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:59:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.01, 6.22, 6.73 [02:00:46] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+1/-0/±1] 13https://git.io/JBrVR [02:00:47] [02miraheze/mediawiki] 07Universal-Omega 03d29ad90 - Install MintyDocs [02:01:54] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JBrwe [02:01:56] [02miraheze/mw-config] 07Universal-Omega 03416a6ee - Update LocalExtensions.php [02:01:57] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [02:02:05] [02mw-config] 07Universal-Omega opened pull request 03#4029: T6127: Install MintyDocs - 13https://git.io/JBrwI [02:02:31] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JBrwl [02:02:33] [02miraheze/mw-config] 07Universal-Omega 0379d5093 - Update LocalExtensions.php [02:02:34] [02mw-config] 07Universal-Omega synchronize pull request 03#4029: T6127: Install MintyDocs - 13https://git.io/JBrwI [02:03:00] miraheze/mw-config - Universal-Omega the build passed. [02:03:01] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JBrwK [02:03:03] [02miraheze/mw-config] 07Universal-Omega 033068af1 - Update LocalSettings.php [02:03:04] [02mw-config] 07Universal-Omega synchronize pull request 03#4029: T6127: Install MintyDocs - 13https://git.io/JBrwI [02:03:27] miraheze/mw-config - Universal-Omega the build passed. [02:04:01] miraheze/mw-config - Universal-Omega the build passed. [02:04:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.83, 7.65, 7.41 [02:04:15] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JBrrC [02:04:17] [02miraheze/mw-config] 07Universal-Omega 037d69981 - Update extension-list [02:04:18] [02mw-config] 07Universal-Omega synchronize pull request 03#4029: T6127: Install MintyDocs - 13https://git.io/JBrwI [02:05:12] miraheze/mw-config - Universal-Omega the build passed. [02:06:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.96, 7.61, 7.42 [02:06:05] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.47, 7.97, 7.35 [02:08:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.14, 7.67, 7.46 [02:09:55] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.25, 7.83, 7.50 [02:10:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.51, 7.51, 7.44 [02:11:19] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.80, 7.05, 6.11 [02:13:16] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.37, 6.34, 5.96 [02:14:20] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JBrP6 [02:14:22] [02miraheze/mw-config] 07Universal-Omega 0329ce494 - Update ManageWikiExtensions.php [02:14:23] [02mw-config] 07Universal-Omega synchronize pull request 03#4029: T6127: Install MintyDocs - 13https://git.io/JBrwI [02:15:16] miraheze/mw-config - Universal-Omega the build passed. [02:15:42] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.84, 6.06, 6.80 [02:18:14] [02mw-config] 07Universal-Omega closed pull request 03#4029: T6127: Install MintyDocs - 13https://git.io/JBrwI [02:18:16] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±4] 13https://git.io/JBr1J [02:18:17] [02miraheze/mw-config] 07Universal-Omega 03451dd3b - T6127: Install MintyDocs (#4029) [02:18:19] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [02:18:20] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [02:19:12] miraheze/mw-config - Universal-Omega the build passed. [02:21:28] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.79, 6.94, 6.88 [02:22:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.02, 7.40, 7.17 [02:23:03] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 30.72, 22.70, 18.90 [02:23:23] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.76, 6.94, 6.90 [02:24:56] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.05, 7.44, 6.45 [02:26:56] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.25, 7.23, 6.49 [02:27:14] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.35, 7.70, 7.20 [02:27:47] !log sudo -u www-data php /srv/mediawiki/w/maintenance/mergeMessageFileList.php --output /srv/mediawiki/config/ExtensionMessageFiles.php --wiki loginwiki && sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLocalisationCache.php --wiki=loginwiki on mw* / jbr* [02:27:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:28:56] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.64, 6.57, 6.33 [02:30:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.93, 7.66, 7.49 [02:31:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.01, 7.65, 7.30 [02:33:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.23, 8.89, 7.79 [02:34:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 16.95, 10.60, 8.54 [02:34:58] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.18, 7.21, 6.33 [02:35:03] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.17, 23.73, 22.38 [02:36:57] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.47, 6.76, 6.27 [02:37:24] [02mw-config] 07Universal-Omega closed pull request 03#4028: Custom DPL3 Settings for my wiki - 13https://git.io/JBrUq [02:37:25] I was checking the Request Wiki Queue for a user but the requester field seems to be echoing my IP instead of the requester's username, does this happen to anyone else? https://meta.miraheze.org/wiki/Special:RequestWikiQueue?dbname=&requester=Viril.Feline.Wyyzrd&status=* [02:37:26] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JBr5s [02:37:26] [url] Wiki requests queue - Miraheze Meta | meta.miraheze.org [02:37:27] [02miraheze/mw-config] 07Njsmooth 03761f6dc - Custom DPL3 Settings for my wiki (#4028) [02:38:20] miraheze/mw-config - Universal-Omega the build passed. [02:39:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.09, 7.52, 7.63 [02:40:46] @Agent: I think you can just ignore it. It is some weird issue, but only happens with that requester so I don't think it's worth looking into right now, and it does not leak any IPs, since it just shows the IP of the current logged in user, not to anyone else. [02:41:30] alright, just wanted to verify, thanks [02:42:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.52, 7.72, 7.98 [02:43:07] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.53, 17.74, 20.06 [02:47:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.41, 7.31, 7.23 [02:51:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.27, 6.82, 7.11 [02:56:03] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.23, 5.58, 6.63 [02:57:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.18, 5.73, 6.59 [03:06:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.20, 6.99, 6.78 [03:08:04] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.72, 6.77, 6.72 [03:35:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.99, 6.34, 5.81 [03:37:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.63, 5.74, 5.66 [03:51:18] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.40, 6.72, 5.96 [03:53:15] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.12, 6.15, 5.85 [03:56:45] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Reception123-patch-1 [03:56:47] [02mw-config] 07Universal-Omega deleted branch 03Reception123-patch-1 - 13https://git.io/vbvb3 [03:57:07] [02WikiDiscover] 07Universal-Omega deleted branch 03paladox-patch-1 - 13https://git.io/vhUAp [03:57:08] [02miraheze/WikiDiscover] 07Universal-Omega deleted branch 03paladox-patch-1 [03:58:34] [02MirahezeMagic] 07Universal-Omega deleted branch 03RhinosF1-patch-1 - 13https://git.io/fQRGX [03:58:36] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03RhinosF1-patch-1 [03:58:45] [02MirahezeMagic] 07Universal-Omega deleted branch 03Reception123-patch-1 - 13https://git.io/fQRGX [03:58:46] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Reception123-patch-1 [03:58:53] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03RhinosF1-patch-2 [03:58:54] [02MirahezeMagic] 07Universal-Omega deleted branch 03RhinosF1-patch-2 - 13https://git.io/fQRGX [03:58:56] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 [03:58:57] [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 - 13https://git.io/fQRGX [03:59:15] [02CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vpJTL [03:59:17] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [03:59:18] [02miraheze/CreateWiki] 07Universal-Omega pushed 033 commits to 03Universal-Omega-patch-2 [+0/-0/±3] 13https://git.io/JBo8W [03:59:20] [02miraheze/CreateWiki] 07Universal-Omega 03ebe8683 - Switch workflow to Libera.chat [03:59:21] [02miraheze/CreateWiki] 07Universal-Omega 03640a345 - Update continuousIntegration.yml [03:59:23] [02miraheze/CreateWiki] 07Universal-Omega 032cbeee1 - Update continuousIntegration.yml [03:59:24] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vpJTL [03:59:26] [02CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vpJTL [03:59:27] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [04:04:56] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.65, 7.44, 6.53 [04:05:35] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.11, 7.71, 6.49 [04:06:53] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.31, 7.47, 6.65 [04:07:33] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.94, 6.92, 6.35 [04:09:28] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.44, 6.72, 6.33 [04:10:48] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.16, 6.40, 6.40 [04:20:35] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.39, 7.41, 6.73 [04:21:28] PROBLEM - wiki.redeemer.live - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.redeemer.live could not be found [04:22:02] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.94, 19.83, 17.40 [04:22:32] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.06, 6.74, 6.56 [04:24:02] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.30, 20.91, 18.03 [04:26:02] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.07, 21.44, 18.59 [04:28:01] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 12.40, 18.10, 17.72 [04:28:25] RECOVERY - wiki.redeemer.live - reverse DNS on sslhost is OK: SSL OK - wiki.redeemer.live reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:41:29] [02mw-config] 07Universal-Omega commented on pull request 03#3987: T6471: Set wgGitInfoCacheDirectory - 13https://git.io/JBo6w [04:41:51] [02mw-config] 07Universal-Omega closed pull request 03#3987: T6471: Set wgGitInfoCacheDirectory - 13https://git.io/JckWv [04:41:52] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JBo6y [04:41:54] [02miraheze/mw-config] 07Universal-Omega 0305d2435 - Set wgGitInfoCacheDirectory (#3987) [04:41:56] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3 [04:41:57] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 [04:42:44] miraheze/mw-config - Universal-Omega the build passed. [04:42:50] [02mw-config] 07Universal-Omega commented on pull request 03#3972: Configure wgCrossSiteAJAXdomains to loginwiki and metawiki - 13https://git.io/JBoiI [04:43:51] [02mw-config] 07Universal-Omega edited pull request 03#3982: T7514: Install WebP - 13https://git.io/JnpSh [04:51:41] [02mediawiki] 07Universal-Omega closed pull request 03#2546: Bump extensions/TemplateWizard from `b7c0321` to `db77a90` - 13https://git.io/J4asX [04:51:42] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBo1I [04:51:44] [02miraheze/mediawiki] 07dependabot[bot] 0330b4bd3 - Bump extensions/TemplateWizard from `b7c0321` to `db77a90` (#2546) [04:51:45] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/TemplateWizard-db77a90 - 13https://git.io/vbL5b [04:51:47] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/TemplateWizard-db77a90 [04:51:56] [02mediawiki] 07Universal-Omega closed pull request 03#2545: Bump skins/liberty from `19ad238` to `456f5c0` - 13https://git.io/J4asK [04:51:58] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBo13 [04:51:59] [02miraheze/mediawiki] 07dependabot[bot] 03aea1d8c - Bump skins/liberty from `19ad238` to `456f5c0` (#2545) [04:52:01] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/liberty-456f5c0 [04:52:02] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/liberty-456f5c0 - 13https://git.io/vbL5b [04:52:13] [02mediawiki] 07Universal-Omega closed pull request 03#2544: Bump extensions/Comments from `6e7f55f` to `ff88c27` - 13https://git.io/J4asw [04:52:15] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBo18 [04:52:16] [02miraheze/mediawiki] 07dependabot[bot] 03dad6d4c - Bump extensions/Comments from `6e7f55f` to `ff88c27` (#2544) [04:52:18] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/Comments-ff88c27 - 13https://git.io/vbL5b [04:52:19] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/Comments-ff88c27 [04:52:50] [02mediawiki] 07Universal-Omega closed pull request 03#2543: Bump extensions/EventStreamConfig from `db9ea87` to `eef97ab` - 13https://git.io/J4asg [04:52:51] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBo1S [04:52:53] [02miraheze/mediawiki] 07dependabot[bot] 030f37e7c - Bump extensions/EventStreamConfig from `db9ea87` to `eef97ab` (#2543) [04:52:54] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/EventStreamConfig-eef97ab - 13https://git.io/vbL5b [04:52:56] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/EventStreamConfig-eef97ab [04:53:00] [02mediawiki] 07Universal-Omega closed pull request 03#2541: Bump extensions/JSBreadCrumbs from `ab25c0e` to `dcfd626` - 13https://git.io/J4as8 [04:53:02] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JBo1Q [04:53:03] [02miraheze/mediawiki] 07dependabot[bot] 03ad96c77 - Bump extensions/JSBreadCrumbs from `ab25c0e` to `dcfd626` (#2541) [04:53:05] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/JSBreadCrumbs-dcfd626 - 13https://git.io/vbL5b [04:53:06] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/JSBreadCrumbs-dcfd626 [05:06:27] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.91, 7.19, 6.16 [05:06:57] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.30, 19.40, 16.84 [05:07:14] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.35, 6.45, 5.82 [05:08:24] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.20, 6.95, 6.18 [05:08:59] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.95, 17.83, 16.58 [05:09:10] PROBLEM - jobrunner4 Puppet on jobrunner4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [05:09:21] PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [05:10:19] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [05:10:20] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.51, 7.57, 6.50 [05:10:34] PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [05:12:13] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [05:12:17] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.48, 6.90, 6.39 [05:13:36] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [05:16:11] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.73, 6.67, 6.44 [05:17:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.50, 6.34, 6.18 [05:27:03] [02puppet] 07Reception123 deleted branch 03revert-1829-patch-49 - 13https://git.io/vbiAS [05:27:05] [02miraheze/puppet] 07Reception123 deleted branch 03revert-1829-patch-49 [05:27:06] [02miraheze/puppet] 07Reception123 deleted branch 03Reception123-patch-2 [05:27:08] [02puppet] 07Reception123 deleted branch 03Reception123-patch-2 - 13https://git.io/vbiAS [05:27:10] [02puppet] 07Reception123 deleted branch 03Reception123-patch-1-3 - 13https://git.io/vbiAS [05:27:11] [02miraheze/puppet] 07Reception123 deleted branch 03Reception123-patch-1-3 [05:27:13] [02miraheze/puppet] 07Reception123 deleted branch 03Reception123-patch-1 [05:27:14] [02puppet] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://git.io/vbiAS [05:27:15] [02puppet] 07Reception123 deleted branch 03Reception123-patch-1-1 - 13https://git.io/vbiAS [05:27:17] [02miraheze/puppet] 07Reception123 deleted branch 03Reception123-patch-1-1 [05:27:18] [02puppet] 07Reception123 deleted branch 03Reception123-patch-1-2 - 13https://git.io/vbiAS [05:27:20] [02miraheze/puppet] 07Reception123 deleted branch 03Reception123-patch-1-2 [05:27:21] [02dns] 07Reception123 deleted branch 03Southparkfan-patch-1 - 13https://git.io/vbQXl [05:27:23] [02miraheze/dns] 07Reception123 deleted branch 03Southparkfan-patch-1 [05:44:16] [02mw-config] 07Reception123 commented on pull request 03#3982: T7514: Install WebP - 13https://git.io/JBKeD [05:44:17] [02mw-config] 07Reception123 closed pull request 03#3982: T7514: Install WebP - 13https://git.io/JnpSh [05:44:19] [02miraheze/mw-config] 07Reception123 deleted branch 03Universal-Omega-patch-2 [05:44:21] [02mw-config] 07Reception123 deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [05:46:22] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://git.io/JBKfT [05:46:23] [02miraheze/mw-config] 07Reception123 034ccc01f - change OAuth2 refresh token expiry time per T7722 [05:46:25] [02mw-config] 07Reception123 created branch 03Reception123-patch-1 - 13https://git.io/vbvb3 [05:46:30] [02mw-config] 07Reception123 opened pull request 03#4030: change OAuth2 refresh token expiry time per T7722 - 13https://git.io/JBKfq [05:47:22] miraheze/mw-config - Reception123 the build passed. [05:49:41] [02mw-config] 07Reception123 closed pull request 03#4030: change OAuth2 refresh token expiry time per T7722 - 13https://git.io/JBKfq [05:49:42] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JBKUI [05:49:44] [02miraheze/mw-config] 07Reception123 03dfffcad - change OAuth2 refresh token expiry time per T7722 (#4030) [05:50:35] miraheze/mw-config - Reception123 the build passed. [05:56:51] !log cd /srv/mediawiki/w && sudo -u www-data git fetch && sudo -u www-data git reset --hard origin/REL1_36 && sudo puppet agent -tv on mw* / jbr* [05:56:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:59:37] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.32, 7.82, 6.61 [06:00:26] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.83, 8.84, 6.87 [06:00:32] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [06:01:09] RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:01:18] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 55 seconds ago with 0 failures [06:01:33] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.95, 7.83, 6.76 [06:01:47] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [06:02:18] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:02:22] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.57, 7.84, 6.73 [06:03:29] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.64, 8.08, 6.97 [06:04:19] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.92, 9.04, 7.27 [06:05:23] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.52, 7.99, 7.08 [06:06:12] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 56 seconds ago with 0 failures [06:06:16] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.74, 7.78, 7.03 [06:12:09] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.11, 6.44, 6.69 [06:12:46] RECOVERY - jobrunner4 APT on jobrunner4 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:17:47] RECOVERY - cloud3 APT on cloud3 is OK: APT OK: 104 packages available for upgrade (0 critical updates). [06:21:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.17, 8.07, 7.38 [06:22:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.36, 8.03, 7.22 [06:23:35] RECOVERY - mw9 APT on mw9 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:28:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.77, 7.56, 7.38 [06:28:21] RECOVERY - cloud4 APT on cloud4 is OK: APT OK: 68 packages available for upgrade (0 critical updates). [06:29:14] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.70, 7.76, 7.70 [06:33:15] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 13.24, 8.70, 7.95 [06:34:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.10, 7.80, 7.45 [06:36:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.65, 7.35, 7.34 [06:39:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.87, 7.36, 7.70 [06:39:23] RECOVERY - test3 APT on test3 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:41:59] RECOVERY - mw11 APT on mw11 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:46:46] RECOVERY - services4 APT on services4 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:47:35] RECOVERY - services3 APT on services3 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:48:06] RECOVERY - jobrunner3 APT on jobrunner3 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:49:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.03, 7.32, 7.33 [06:49:32] RECOVERY - mw10 APT on mw10 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:50:32] RECOVERY - cloud5 APT on cloud5 is OK: APT OK: 68 packages available for upgrade (0 critical updates). [06:51:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.76, 7.08, 7.25 [06:51:28] RECOVERY - mw8 APT on mw8 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [06:52:04] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.43, 6.38, 6.74 [06:57:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.85, 6.17, 6.80 [07:35:27] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.80, 7.01, 6.25 [07:37:21] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.90, 6.02, 5.96 [08:05:26] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.98, 6.61, 5.92 [08:07:23] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.17, 6.10, 5.82 [08:36:40] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.09, 6.55, 5.73 [08:38:36] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.03, 5.93, 5.60 [08:51:12] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.21, 6.73, 6.17 [08:53:09] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.32, 6.31, 6.09 [09:05:39] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.74, 6.38, 5.92 [09:07:33] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.86, 6.03, 5.84 [09:35:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.02, 6.53, 5.93 [09:35:53] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.43, 7.28, 6.51 [09:37:03] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.66, 6.16, 5.86 [09:37:48] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.78, 6.48, 6.31 [09:50:44] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.66, 6.87, 6.13 [09:52:15] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.60, 6.72, 6.26 [09:52:40] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.54, 6.96, 6.24 [09:54:09] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.89, 6.27, 6.15 [09:54:37] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.70, 6.37, 6.11 [10:05:47] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.57, 7.30, 6.49 [10:09:40] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.20, 6.32, 6.29 [10:33:30] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.59, 7.67, 6.85 [10:35:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.38, 8.23, 6.93 [10:35:27] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.99, 7.13, 6.76 [10:37:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.27, 7.46, 6.81 [10:37:24] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.40, 6.80, 6.68 [10:39:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.33, 6.79, 6.64 [10:43:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.83, 7.12, 6.79 [10:47:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.72, 6.76, 6.69 [10:51:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.84, 7.26, 6.92 [10:53:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.22, 6.65, 6.75 [11:04:47] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.78, 9.55, 7.61 [11:05:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.56, 9.76, 7.92 [11:09:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.62, 7.36, 7.35 [11:10:40] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.36, 7.86, 7.45 [11:18:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.55, 5.72, 6.59 [11:19:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.35, 6.34, 6.80 [11:35:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.63, 7.60, 6.70 [11:36:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.62, 8.01, 7.10 [11:37:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.01, 7.11, 6.65 [11:38:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.89, 7.18, 6.90 [11:48:03] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.10, 6.62, 6.77 [11:52:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.18, 7.17, 6.93 [11:54:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.15, 6.92, 6.88 [11:55:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.31, 6.67, 6.75 [11:56:05] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.65, 6.66, 6.80 [12:06:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.38, 7.20, 6.91 [12:06:06] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.43, 8.22, 7.37 [12:08:01] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.73, 7.91, 7.38 [12:12:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.70, 8.12, 7.36 [12:16:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.81, 7.76, 7.38 [12:18:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.85, 7.87, 7.44 [12:19:33] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.51, 8.28, 7.51 [12:23:21] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.25, 7.22, 7.30 [12:24:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.14, 7.38, 7.51 [12:33:14] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.47, 7.19, 7.08 [12:34:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.98, 8.04, 7.54 [12:38:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.17, 7.67, 7.51 [12:44:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.59, 8.19, 7.74 [12:45:14] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.23, 7.89, 7.78 [12:46:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.16, 7.66, 7.59 [12:47:15] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.38, 8.18, 7.91 [12:51:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.47, 7.67, 7.81 [13:04:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.30, 8.39, 7.56 [13:08:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.54, 7.67, 7.51 [13:10:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.22, 8.23, 7.75 [13:14:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.54, 7.76, 7.71 [13:20:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.21, 8.00, 7.77 [13:23:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.82, 7.59, 7.28 [13:24:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.94, 7.82, 7.81 [13:25:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.77, 7.22, 7.18 [13:31:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.90, 6.13, 6.70 [13:43:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 36.08, 14.97, 9.53 [13:48:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.18, 7.31, 7.15 [13:50:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.18, 7.15, 7.11 [13:55:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.64, 6.93, 7.74 [14:00:03] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.50, 6.25, 6.76 [14:05:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.12, 7.54, 7.45 [14:06:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.94, 7.09, 6.97 [14:07:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.12, 7.00, 7.27 [14:12:03] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.61, 6.41, 6.72 [14:13:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.00, 6.02, 6.73 [14:21:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.75, 7.52, 7.09 [14:23:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.34, 6.76, 6.87 [14:26:39] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.78, 1.82, 1.24 [14:27:13] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.31, 6.36, 6.71 [14:28:02] @R4356th: if you want to play around on test3 to make sure I haven't broke anything with the new deploy scripts then do [14:28:38] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.67, 1.39, 1.16 [14:30:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.21, 6.82, 6.68 [14:31:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.89, 6.99, 6.91 [14:33:15] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.14, 8.27, 7.37 [14:34:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 12.67, 8.85, 7.46 [14:50:21] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.25, 7.02, 6.16 [14:50:59] PROBLEM - wiki.rpointer.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.rpointer.ml could not be found [14:51:00] PROBLEM - hellointernet.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hellointernet.miraheze.org could not be found [14:51:02] PROBLEM - wiki.mineland.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mineland.eu could not be found [14:51:06] PROBLEM - test1.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for test1.miraheze.org could not be found [14:51:07] PROBLEM - wiki.lefrenchmelee.fr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.lefrenchmelee.fr could not be found [14:51:07] PROBLEM - www.highdeologywiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.highdeologywiki.com could not be found [14:51:09] PROBLEM - sportsanalytics.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sportsanalytics.wiki could not be found [14:51:48] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.27, 7.45, 6.46 [14:56:07] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.84, 6.62, 6.30 [14:57:48] RECOVERY - wiki.rpointer.ml - reverse DNS on sslhost is OK: SSL OK - wiki.rpointer.ml reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:57:52] RECOVERY - hellointernet.miraheze.org - reverse DNS on sslhost is OK: SSL OK - hellointernet.miraheze.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [14:57:55] RECOVERY - wiki.mineland.eu - reverse DNS on sslhost is OK: SSL OK - wiki.mineland.eu reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:58:02] RECOVERY - test1.miraheze.org - reverse DNS on sslhost is OK: SSL OK - test1.miraheze.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [14:58:06] RECOVERY - wiki.lefrenchmelee.fr - reverse DNS on sslhost is OK: SSL OK - wiki.lefrenchmelee.fr reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:58:06] RECOVERY - www.highdeologywiki.com - reverse DNS on sslhost is OK: SSL OK - www.highdeologywiki.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:58:08] RECOVERY - sportsanalytics.wiki - reverse DNS on sslhost is OK: SSL OK - sportsanalytics.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [15:05:17] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.29, 6.38, 6.52 [15:45:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.19, 7.14, 7.82 [15:49:14] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.51, 8.34, 8.09 [15:51:41] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.06, 2.18, 1.25 [15:52:20] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.31, 6.48, 6.23 [15:53:40] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.76, 1.68, 1.18 [15:59:59] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.57, 6.64, 6.46 [16:05:51] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.41, 7.06, 6.76 [16:07:46] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.86, 6.74, 6.69 [16:34:52] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.63, 18.79, 17.33 [16:36:51] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.16, 17.70, 17.09 [16:37:48] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.56, 7.00, 6.27 [16:39:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.21, 7.34, 7.93 [16:39:43] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.07, 6.23, 6.08 [16:40:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.55, 7.34, 7.84 [16:44:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.63, 7.92, 7.94 [16:49:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.13, 7.52, 7.57 [16:51:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.51, 7.73, 7.67 [16:54:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.00, 7.83, 7.99 [16:55:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.49, 7.78, 7.69 [16:59:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.46, 7.74, 7.69 [17:01:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.45, 8.78, 8.11 [17:02:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.54, 7.88, 7.85 [17:04:58] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.54, 7.05, 6.24 [17:06:56] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.62, 6.78, 6.23 [17:09:38] Reception123: merge https://github.com/miraheze/puppet/pull/1835 [17:09:39] [url] hieradata: set values for sync scripts by RhinosF1 · Pull Request #1835 · miraheze/puppet · GitHub | github.com [17:09:54] It's no-op [17:12:54] [02puppet] 07RhinosF1 opened pull request 03#1838: mediawiki: automatically sync config - 13https://git.io/JBPY9 [17:13:27] That's another part done [17:16:07] RhinosF1: mobile now. I'll look in ~1 hour [17:16:23] Reception123: #1835 is completely no-op [17:16:40] #1838 is if we want config to run fully automated still because it's easy [17:16:49] I'm not gonna do that for core I don't think [17:17:24] I still think !log is a good idea because of the weirdness. Might be worth a seperate sync log. [17:18:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.77, 7.25, 7.88 [17:19:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.81, 7.13, 7.88 [17:20:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.18, 8.10, 8.11 [17:24:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.68, 7.53, 7.92 [17:27:15] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.32, 7.40, 7.73 [17:34:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.51, 8.78, 8.14 [17:56:10] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.08, 6.95, 6.53 [18:00:01] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.08, 7.40, 6.78 [18:00:11] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JBPl7 [18:00:13] [02miraheze/puppet] 07Reception123 0317440e8 - matomo: upgrade to 4.4.0 [18:01:57] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.54, 7.47, 6.88 [18:02:55] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.20, 6.88, 6.38 [18:04:16] PROBLEM - mon2 Puppet on mon2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_checkout_matomo] [18:04:55] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.40, 6.76, 6.40 [18:08:05] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.95, 19.90, 18.08 [18:10:11] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.70, 18.13, 17.63 [18:11:02] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.30, 7.39, 6.74 [18:11:39] !log updated matomo to 4.4.0 (pulled changes in and ran database upgrade) [18:11:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:12:23] RECOVERY - mon2 Puppet on mon2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:12:41] !log updated matomo composer on mon2 [18:12:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:12:57] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.88, 7.13, 6.72 [18:14:09] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.17, 19.54, 18.29 [18:14:55] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.08, 7.31, 6.83 [18:16:08] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.46, 17.78, 17.79 [18:16:57] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.46, 7.24, 6.85 [18:18:57] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.21, 6.80, 6.73 [18:19:11] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.83, 6.41, 6.74 [18:26:29] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.21, 3.57, 3.05 [18:26:56] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.12, 6.77, 6.82 [18:28:26] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.41, 3.25, 3.00 [18:36:57] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.58, 5.98, 6.55 [18:38:41] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JBPz0 [18:38:42] [02miraheze/puppet] 07Reception123 037b10f55 - graylog: Upgrade elasticsearch, mongodb and graylog [18:53:28] [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JBPaJ [18:53:30] [02miraheze/puppet] 07Reception123 034c636a7 - elasticsearch is 7.13.4 [18:53:50] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.06, 1.75, 1.24 [18:54:22] Hmm not sure why graylog still says it's outdated [18:54:50] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.51, 3.40, 2.58 [18:55:03] Reception123: do stuff need restarting? [18:55:04] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.57, 22.63, 19.66 [18:55:49] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.31, 1.59, 1.24 [18:56:00] Ah I guess that could be it, perhaps the graylog server needs a restart to fully upgrade [18:56:18] !log restarted graylog-server [18:56:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:56:56] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.33, 6.97, 6.56 [18:56:59] nope, it's still mad :( [18:57:05] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.51, 20.45, 19.19 [18:57:27] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+1/-0/±0] 13https://git.io/JBPa9 [18:57:28] [02miraheze/DataDump] 07Universal-Omega 03b28028e - Create ApiDeleteDumps.php [18:57:30] [02DataDump] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fhhKV [18:57:31] [02DataDump] 07Universal-Omega opened pull request 03#32: Create ApiDeleteDumps.php - 13https://git.io/JBPaH [18:58:22] miraheze/DataDump - Universal-Omega the build passed. [18:58:52] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JBPaj [18:58:54] [02miraheze/DataDump] 07Universal-Omega 0381cba8c - Update extension.json [18:58:55] [02DataDump] 07Universal-Omega synchronize pull request 03#32: Create ApiDeleteDumps.php - 13https://git.io/JBPaH [18:58:55] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.14, 7.28, 6.71 [18:59:02] Version: [18:59:02] 4.1.2+20cd592, codename Noir [18:59:05] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.17, 19.22, 18.88 [18:59:12] my only guess is that the notification doesn't go away itself and you're supposed to delete it? [18:59:21] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JBPVI [18:59:23] [02miraheze/DataDump] 07Universal-Omega 03d8ee792 - Update ApiDeleteDumps.php [18:59:24] [02DataDump] 07Universal-Omega synchronize pull request 03#32: Create ApiDeleteDumps.php - 13https://git.io/JBPaH [18:59:48] miraheze/DataDump - Universal-Omega the build passed. [19:00:19] miraheze/DataDump - Universal-Omega the build passed. [19:00:21] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JBPVC [19:00:22] [02miraheze/DataDump] 07Universal-Omega 03d306a74 - Update ApiDeleteDumps.php [19:00:24] [02DataDump] 07Universal-Omega synchronize pull request 03#32: Create ApiDeleteDumps.php - 13https://git.io/JBPaH [19:00:56] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.79, 6.75, 6.60 [19:01:31] miraheze/DataDump - Universal-Omega the build passed. [19:02:38] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 2.57, 3.27, 2.92 [19:02:54] it went away now seems like it just wanted more time [19:04:32] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JBPwI [19:04:33] [02miraheze/DataDump] 07Universal-Omega 03525206d - Update ApiDeleteDumps.php [19:04:35] [02DataDump] 07Universal-Omega synchronize pull request 03#32: Create ApiDeleteDumps.php - 13https://git.io/JBPaH [19:04:56] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.06, 6.83, 6.69 [19:05:25] miraheze/DataDump - Universal-Omega the build passed. [19:06:01] !log upgraded phabricator [19:06:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:55] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.98, 6.52, 6.59 [19:12:59] [02DataDump] 07Universal-Omega edited pull request 03#32: Create API for deleting dumps - 13https://git.io/JBPaH [19:13:31] [02DataDump] 07Universal-Omega edited pull request 03#32: T7341: Create API for deleting dumps - 13https://git.io/JBPaH [19:47:56] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.61, 7.79, 7.02 [19:49:53] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.64, 7.17, 6.90 [19:50:56] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.68, 7.07, 6.31 [19:52:55] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.39, 6.41, 6.15 [19:55:01] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.67, 20.16, 18.26 [19:55:42] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.10, 7.83, 7.22 [19:56:55] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.93, 7.77, 6.75 [19:57:00] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.35, 18.79, 17.97 [20:00:55] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.03, 7.30, 6.84 [20:01:33] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.88, 7.65, 7.38 [20:02:55] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.26, 6.74, 6.70 [20:09:12] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.95, 8.39, 7.72 [20:09:13] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JBPyv [20:09:14] [02miraheze/MirahezeMagic] 07Universal-Omega 03dd334b1 - RebuildVersionCache: Support rebuilding for all extensions [20:09:16] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/fQRGX [20:09:17] [02MirahezeMagic] 07Universal-Omega opened pull request 03#273: RebuildVersionCache: Support rebuilding for all extensions - 13https://git.io/JBPyf [20:10:17] miraheze/MirahezeMagic - Universal-Omega the build passed. [20:10:23] [02MirahezeMagic] 07Universal-Omega edited pull request 03#273: RebuildVersionCache: Support rebuilding for all extensions - 13https://git.io/JBPyf [20:10:55] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.20, 6.83, 6.74 [20:11:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.12, 7.61, 7.53 [20:12:55] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.32, 6.68, 6.69 [20:13:00] [02MirahezeMagic] 07Universal-Omega edited pull request 03#273: RebuildVersionCache: Support rebuilding for all extensions - 13https://git.io/JBPyf [20:15:45] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JBPSe [20:15:46] [02miraheze/mw-config] 07Universal-Omega 03e7078f2 - Remove ENV for GDFONTPATH [20:15:48] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/vbvb3 [20:16:46] [02mw-config] 07Universal-Omega opened pull request 03#4031: Remove ENV for GDFONTPATH - 13https://git.io/JBPSm [20:17:37] miraheze/mw-config - Universal-Omega the build passed. [20:25:47] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.85, 7.05, 6.74 [20:29:39] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.48, 6.71, 6.66 [20:30:55] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.80, 6.21, 6.73 [20:48:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.09, 7.03, 7.99 [20:50:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 7.65, 7.55, 8.07 [20:52:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.39, 7.09, 7.83 [20:56:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.41, 7.08, 7.60 [20:58:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.81, 6.85, 7.45 [21:00:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.52, 8.03, 7.84 [21:02:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.06, 7.77, 7.77 [21:04:05] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.10, 8.44, 8.02 [21:04:32] I hate you mw8 with a passion [21:08:47] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.91, 6.59, 6.34 [21:09:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.82, 7.27, 7.92 [21:10:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.76, 7.98, 7.98 [21:10:41] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.53, 6.16, 6.21 [21:12:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.48, 8.25, 8.06 [21:13:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.39, 7.70, 7.91 [21:23:14] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.62, 7.88, 7.94 [21:25:16] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.36, 8.34, 8.08 [21:38:36] Do you really, @RhinosF1? :/ [21:39:46] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.94, 7.23, 6.64 [21:43:36] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.41, 6.68, 6.54 [21:57:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.03, 7.22, 7.82 [22:00:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.13, 7.48, 7.95 [22:03:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.21, 7.30, 7.66 [22:04:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.62, 8.12, 8.01 [22:04:40] PROBLEM - cp12 Disk Space on cp12 is WARNING: DISK WARNING - free space: / 4236 MB (10% inode=96%); [22:09:02] poor mw8 😭 [22:09:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.51, 7.75, 7.96 [22:10:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.52, 7.90, 7.98 [22:30:04] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.38, 6.10, 6.77 [22:31:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.37, 7.07, 7.09 [22:36:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.76, 7.59, 7.21 [22:42:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.65, 8.15, 7.58 [22:43:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.70, 7.88, 7.70 [22:46:04] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.07, 7.84, 7.60 [22:47:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.36, 8.16, 7.87 [22:50:06] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.03, 8.36, 7.82 [22:50:40] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/JBXkF [22:50:41] [02miraheze/MirahezeMagic] 07Universal-Omega 032091845 - Maintain default Wikimedia sites [22:50:43] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-4 - 13https://git.io/fQRGX [22:50:44] [02MirahezeMagic] 07Universal-Omega opened pull request 03#274: Maintain default Wikimedia sites - 13https://git.io/JBXkb [22:51:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.31, 7.43, 7.66 [22:51:40] miraheze/MirahezeMagic - Universal-Omega the build passed. [22:52:06] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.58, 7.60, 7.60 [22:52:34] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/JBXIL [22:52:36] [02miraheze/MirahezeMagic] 07Universal-Omega 0355e6792 - Update populateWikibaseSitesTable.php [22:52:37] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#274: Maintain default Wikimedia sites - 13https://git.io/JBXkb [22:53:29] miraheze/MirahezeMagic - Universal-Omega the build passed. [22:58:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.85, 7.85, 7.64 [22:59:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.29, 7.67, 7.62 [23:00:05] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.36, 7.21, 7.43 [23:02:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.38, 7.57, 7.53 [23:10:18] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/JBXtG [23:10:20] [02miraheze/MirahezeMagic] 07Universal-Omega 0348fe496 - Update populateWikibaseSitesTable.php [23:10:21] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#274: Maintain default Wikimedia sites - 13https://git.io/JBXkb [23:11:21] miraheze/MirahezeMagic - Universal-Omega the build passed. [23:12:12] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/JBXtu [23:12:14] [02miraheze/MirahezeMagic] 07Universal-Omega 03b15821b - Update populateWikibaseSitesTable.php [23:12:15] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#274: Maintain default Wikimedia sites - 13https://git.io/JBXkb [23:13:09] miraheze/MirahezeMagic - Universal-Omega the build passed. [23:19:12] [02MirahezeMagic] 07Universal-Omega edited pull request 03#274: T6045: Maintain default Wikimedia sites - 13https://git.io/JBXkb [23:22:58] PROBLEM - ping6 on cp3 is WARNING: PING WARNING - Packet loss = 0%, RTA = 306.52 ms [23:24:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.66, 7.38, 7.88 [23:31:14] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.96, 6.73, 7.78 [23:33:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.91, 7.08, 7.76 [23:34:03] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.69, 7.98, 7.78 [23:38:03] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.78, 7.65, 7.74 [23:39:45] !log [universalomega@test3] starting deploy of {'config': True, 'world': True, 'l10n': True} to skip [23:39:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:41:14] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.20, 7.53, 7.89 [23:45:00] !log [universalomega@test3] finished deploy of {'config': True, 'world': True, 'l10n': True} to skip [23:45:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:46:51] !log [universalomega@test3] starting deploy of {'world': True} to skip [23:46:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:47:35] !log [universalomega@test3] finished deploy of {'world': True} to skip [23:47:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:49:58] !log [universalomega@test3] starting deploy of {'world': True} to skip [23:50:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:50:27] !log [universalomega@test3] finished deploy of {'world': True} to skip [23:50:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:54:04] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.80, 6.04, 6.75 [23:55:13] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.30, 7.05, 7.23 [23:57:13] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.45, 6.72, 7.08 [23:59:55] !log [universalomega@test3] starting deploy of {'world': True} to skip [23:59:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log