[00:00:05] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.81, 7.06, 6.72 [00:00:10] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRqP [00:00:12] [02miraheze/ssl] 07MirahezeSSLBot 0327cc485 - Bot: Update SSL cert for wiki.beergeeks.co.il [00:00:29] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRqD [00:00:30] [02miraheze/ssl] 07MirahezeSSLBot 03c9273e5 - Bot: Update SSL cert for zh.internetpedia.tk [00:00:53] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRqH [00:00:54] [02miraheze/ssl] 07MirahezeSSLBot 0337ed6f4 - Bot: Update SSL cert for threedomwiki.pcast.site [00:00:58] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.83, 7.68, 7.01 [00:01:11] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRqQ [00:01:12] [02miraheze/ssl] 07MirahezeSSLBot 03e0e05a8 - Bot: Update SSL cert for puardian.xyz [00:01:31] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRq5 [00:01:33] [02miraheze/ssl] 07MirahezeSSLBot 03faeca16 - Bot: Update SSL cert for wikidiffs.ga [00:02:06] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.67, 6.68, 6.63 [00:02:18] !log sett dummy passwords for all beta global accounts [00:02:18] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.21, 1.75, 1.33 [00:02:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:02:56] !log drop betawiki from old CA cluster [00:03:13] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.13, 6.25, 5.68 [00:03:24] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Puppet has 8 failures. Last run 3 minutes ago with 8 failures. Failed resources (up to 3 shown): File[/etc/nginx/sites-available/graylog-proxy],File[/etc/sysctl.d],File[/etc/logrotate.d/nginx],File[/home/johnflewis] [00:03:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:04:23] RECOVERY - wikidiffs.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'wikidiffs.ga' will expire on Sun 27 Mar 2022 23:01:26 GMT +0000. [00:04:25] RECOVERY - puardian.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'puardian.xyz' will expire on Sun 27 Mar 2022 23:01:04 GMT +0000. [00:04:27] RECOVERY - threedomwiki.pcast.site - LetsEncrypt on sslhost is OK: OK - Certificate 'threedomwiki.pcast.site' will expire on Sun 27 Mar 2022 23:00:46 GMT +0000. [00:04:29] RECOVERY - zh.internetpedia.tk - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.internetpedia.tk' will expire on Sun 27 Mar 2022 23:00:22 GMT +0000. [00:04:31] RECOVERY - wiki.beergeeks.co.il - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.beergeeks.co.il' will expire on Sun 27 Mar 2022 23:00:03 GMT +0000. [00:04:35] RECOVERY - wiki.bikinibottomdiscord.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.bikinibottomdiscord.org' will expire on Sun 27 Mar 2022 22:59:46 GMT +0000. [00:04:39] RECOVERY - wiki.timewisely.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.timewisely.net' will expire on Sun 27 Mar 2022 22:59:28 GMT +0000. [00:04:40] RECOVERY - www.ambientguitar.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ambientguitar.org' will expire on Sun 27 Mar 2022 22:59:11 GMT +0000. [00:04:42] RECOVERY - ambientguitar.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ambientguitar.org' will expire on Sun 27 Mar 2022 22:59:11 GMT +0000. [00:04:45] RECOVERY - www.connorjwat.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.connorjwat.net' will expire on Sun 27 Mar 2022 22:57:17 GMT +0000. [00:04:47] RECOVERY - wikileague.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'wikileague.cf' will expire on Sun 27 Mar 2022 22:58:22 GMT +0000. [00:04:49] RECOVERY - wiki.airyx.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.airyx.org' will expire on Sun 27 Mar 2022 22:58:36 GMT +0000. [00:04:51] RECOVERY - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipedia.yogfront.ooo' will expire on Sun 27 Mar 2022 22:58:53 GMT +0000. [00:04:57] miraheze/CreateWiki - Universal-Omega the build passed. [00:05:13] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.48, 6.48, 5.83 [00:05:49] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/JyRm2 [00:05:51] [02miraheze/ssl] 07paladox 0382cdbbe - Remove storytime.jdstroy.cf [00:05:52] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:05:53] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.07, 23.00, 23.62 [00:05:54] [02ssl] 07paladox opened pull request 03#448: Remove storytime.jdstroy.cf - 13https://git.io/JyRma [00:06:14] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JyRmo [00:06:16] [02miraheze/ssl] 07paladox 0324d3bb0 - Update certs.yaml [00:06:17] [02ssl] 07paladox synchronize pull request 03#448: Remove storytime.jdstroy.cf - 13https://git.io/JyRma [00:06:18] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.59, 1.40, 1.30 [00:06:32] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.97, 6.34, 5.73 [00:06:51] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.57, 6.08, 6.57 [00:07:04] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 4 datacenters are down: 51.195.220.68/cpweb, 2001:41d0:801:2000::1b80/cpweb, 149.56.140.43/cpweb, 149.56.141.75/cpweb [00:07:52] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 29.47, 25.46, 24.40 [00:08:20] PROBLEM - cp21 Stunnel Http for mw11 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:08:32] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 6.51, 6.29, 5.78 [00:09:13] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.55, 6.26, 5.91 [00:09:16] [02ssl] 07paladox closed pull request 03#448: Remove storytime.jdstroy.cf - 13https://git.io/JyRma [00:09:17] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JyRmA [00:09:19] [02miraheze/ssl] 07paladox 03978cad5 - Remove storytime.jdstroy.cf (#448) [00:09:20] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:09:22] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [00:09:31] PROBLEM - cp30 Stunnel Http for mw11 on cp30 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:09:48] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.44, 5.72, 4.94 [00:09:57] PROBLEM - mw11 MediaWiki Rendering on mw11 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:10:17] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.14, 3.75, 4.00 [00:10:24] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JyRYT [00:10:26] [02miraheze/ssl] 07paladox 030406b04 - Remove madzebrascience.wik [00:10:27] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:10:29] [02ssl] 07paladox opened pull request 03#449: Remove madzebrascience.wik - 13https://git.io/JyRYI [00:10:35] PROBLEM - cp31 Stunnel Http for mw10 on cp31 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:10:39] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/JyRYq [00:10:41] [02miraheze/ssl] 07paladox 034bdb13d - Delete madzebrascience.wiki.crt [00:10:42] [02ssl] 07paladox synchronize pull request 03#449: Remove madzebrascience.wik - 13https://git.io/JyRYI [00:10:44] PROBLEM - cp20 Stunnel Http for mw10 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:10:47] [02ssl] 07paladox closed pull request 03#449: Remove madzebrascience.wik - 13https://git.io/JyRYI [00:10:48] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 198.244.148.90/cpweb, 2001:41d0:801:2000::1b80/cpweb, 149.56.140.43/cpweb, 2607:5300:201:3100::929a/cpweb [00:10:49] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JyRYm [00:10:50] [02miraheze/ssl] 07paladox 031273c81 - Remove madzebrascience.wik (#449) [00:10:52] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:10:53] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [00:10:53] PROBLEM - cp31 Stunnel Http for mw11 on cp31 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:11:21] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 20.48, 19.80, 18.25 [00:11:32] PROBLEM - cp21 Stunnel Http for mw10 on cp21 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:11:41] PROBLEM - mw10 MediaWiki Rendering on mw10 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:11:48] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.17, 4.93, 4.73 [00:12:01] RECOVERY - mw11 MediaWiki Rendering on mw11 is OK: HTTP OK: HTTP/1.1 200 OK - 20528 bytes in 7.006 second response time [00:12:21] PROBLEM - cp30 Stunnel Http for mw10 on cp30 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:12:30] RECOVERY - cp21 Stunnel Http for mw11 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14565 bytes in 3.024 second response time [00:12:39] RECOVERY - cp31 Stunnel Http for mw10 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14557 bytes in 6.649 second response time [00:12:46] RECOVERY - cp20 Stunnel Http for mw10 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14565 bytes in 6.493 second response time [00:12:50] RECOVERY - cp31 Stunnel Http for mw11 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14557 bytes in 0.755 second response time [00:12:54] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.79, 6.83, 6.25 [00:12:54] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JyRYV [00:12:56] [02miraheze/ssl] 07paladox 03c30cdce - Remove adanfime.com [00:12:57] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:12:59] [02ssl] 07paladox opened pull request 03#450: Remove adanfime.com - 13https://git.io/JyRYK [00:13:09] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/JyRY6 [00:13:10] [02miraheze/ssl] 07paladox 03c529f1f - Delete adanfime.com.crt [00:13:12] [02ssl] 07paladox synchronize pull request 03#450: Remove adanfime.com - 13https://git.io/JyRYK [00:13:15] [02ssl] 07paladox closed pull request 03#450: Remove adanfime.com - 13https://git.io/JyRYK [00:13:17] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 17.75, 19.24, 18.24 [00:13:17] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JyRYi [00:13:18] [02miraheze/ssl] 07paladox 03d1b7ad4 - Remove adanfime.com (#450) [00:13:20] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:13:21] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [00:13:24] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JyRYX [00:13:25] [02miraheze/mw-config] 07Universal-Omega 039d762e0 - Configure `$wgCrossSiteAJAXdomains` for betaheze [00:13:27] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [00:13:38] RECOVERY - cp30 Stunnel Http for mw11 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14557 bytes in 1.799 second response time [00:13:39] RECOVERY - cp21 Stunnel Http for mw10 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14557 bytes in 8.794 second response time [00:13:46] [02mw-config] 07Universal-Omega opened pull request 03#4301: Enable GlobalWatchlist for betaheze - 13https://git.io/JyRYD [00:13:49] [02puppet] 07paladox closed pull request 03#2173: Remove regex_domain_ats - 13https://git.io/JyWt2 [00:13:49] RECOVERY - mw10 MediaWiki Rendering on mw10 is OK: HTTP OK: HTTP/1.1 200 OK - 20528 bytes in 8.675 second response time [00:13:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRYy [00:13:52] [02miraheze/puppet] 07Universal-Omega 0391911e3 - Remove regex_domain_ats (#2173) [00:13:53] [02ssl] 07paladox closed pull request 03#447: Remove regex_domain_ats - 13https://git.io/JyWtV [00:13:55] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRY9 [00:13:56] [02miraheze/ssl] 07Universal-Omega 039b2cdb1 - Remove regex_domain_ats (#447) [00:14:17] RECOVERY - cp30 Stunnel Http for mw10 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14557 bytes in 0.352 second response time [00:14:35] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JyRYx [00:14:37] [02miraheze/mw-config] 07Universal-Omega 03f117000 - Update LocalWiki.php [00:14:38] [02mw-config] 07Universal-Omega synchronize pull request 03#4301: Enable GlobalWatchlist for betaheze - 13https://git.io/JyRYD [00:14:43] [02mw-config] 07Universal-Omega edited pull request 03#4301: Enable GlobalWatchlist for betawiki - 13https://git.io/JyRYD [00:14:53] miraheze/mw-config - Universal-Omega the build passed. [00:14:53] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.89, 7.45, 6.53 [00:14:58] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:15:13] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.09, 7.24, 6.47 [00:15:36] miraheze/mw-config - Universal-Omega the build passed. [00:15:40] CosmicAlpha: thanks! [00:16:57] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.38, 6.57, 6.32 [00:17:10] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:17:26] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JyROw [00:17:27] [02miraheze/ssl] 07paladox 036193944 - Remove wiki.apadotech.ga [00:17:29] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:17:30] [02ssl] 07paladox opened pull request 03#451: Remove wiki.apadotech.ga - 13https://git.io/JyROr [00:17:33] paladox: no problem! [00:17:42] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/JyRO6 [00:17:43] [02miraheze/ssl] 07paladox 03e0ac18d - Delete wiki.apadotech.ga.crt [00:17:45] [02ssl] 07paladox synchronize pull request 03#451: Remove wiki.apadotech.ga - 13https://git.io/JyROr [00:17:50] [02ssl] 07paladox closed pull request 03#451: Remove wiki.apadotech.ga - 13https://git.io/JyROr [00:17:52] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JyROX [00:17:53] [02miraheze/ssl] 07paladox 03c3bec1e - Remove wiki.apadotech.ga (#451) [00:17:55] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [00:17:56] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:18:09] paladox: FYI, https://phabricator.miraheze.org/T8522 [00:18:10] [url] ⚓ T8522 DNS issue | phabricator.miraheze.org [00:18:21] Regarding the domain you just removed. [00:18:26] oh [00:18:36] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.67, 6.73, 6.43 [00:18:43] [02miraheze/ssl] 07paladox pushed 031 commit to 03revert-451-paladox-patch-1 [+1/-0/±1] 13https://git.io/JyROb [00:18:45] [02miraheze/ssl] 07paladox 030e1cbe3 - Revert "Remove wiki.apadotech.ga (#451)" [00:18:46] [02ssl] 07paladox created branch 03revert-451-paladox-patch-1 - 13https://git.io/vxP9L [00:18:53] [02ssl] 07paladox opened pull request 03#452: Revert "Remove wiki.apadotech.ga" - 13https://git.io/JyROp [00:19:16] for when it's resolved CosmicAlpha ^ [00:20:05] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JyR3O [00:20:07] [02miraheze/ssl] 07paladox 035306c44 - Remove wiki.velaan.org [00:20:08] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:20:10] [02ssl] 07paladox opened pull request 03#453: Remove wiki.velaan.org - 13https://git.io/JyR33 [00:20:22] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-1/±0] 13https://git.io/JyR3B [00:20:23] Sounds good, thanks paladox! If they don't respond within a couple days and have it fixed then it can probably just stay removed as you've done. [00:20:23] [02miraheze/ssl] 07paladox 03f49f70d - Delete wiki.velaan.org.crt [00:20:25] [02ssl] 07paladox synchronize pull request 03#453: Remove wiki.velaan.org - 13https://git.io/JyR33 [00:20:31] [02ssl] 07paladox closed pull request 03#453: Remove wiki.velaan.org - 13https://git.io/JyR33 [00:20:31] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 51.195.220.68/cpweb, 149.56.140.43/cpweb [00:20:32] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://git.io/JyR3u [00:20:34] [02miraheze/ssl] 07paladox 035cd34f7 - Remove wiki.velaan.org (#453) [00:20:35] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:20:37] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [00:20:38] PROBLEM - mw9 MediaWiki Rendering on mw9 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:20:50] CosmicAlpha: ack [00:21:08] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 51.195.220.68/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::929a/cpweb, 2607:5300:201:3100::5ebc/cpweb [00:21:08] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.31, 6.35, 6.08 [00:21:11] PROBLEM - cp20 Stunnel Http for mw9 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:21:15] isn't miraheze.ml a wildcard cert [00:21:19] trying to remember [00:21:42] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.13, 5.45, 5.01 [00:21:56] RECOVERY - mw9 MediaWiki Rendering on mw9 is OK: HTTP OK: HTTP/1.1 200 OK - 20526 bytes in 4.225 second response time [00:21:58] oh it's not [00:22:02] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:22:21] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[wiki.apadotech.ga] [00:22:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyR35 [00:22:27] [02miraheze/ssl] 07MirahezeSSLBot 03fc7a5b4 - Bot: Update SSL cert for miraheze.ml [00:22:42] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyR3b [00:22:44] [02miraheze/ssl] 07MirahezeSSLBot 03de2cdf1 - Bot: Update SSL cert for wiki.cdntennis.ca [00:22:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyR3h [00:22:58] [02miraheze/ssl] 07MirahezeSSLBot 036eebf43 - Bot: Update SSL cert for wiki.graalmilitary.com [00:23:00] PROBLEM - mw13 Puppet on mw13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[wiki.apadotech.ga] [00:23:06] RECOVERY - cp20 Stunnel Http for mw9 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14564 bytes in 0.008 second response time [00:23:07] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:23:07] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.91, 5.97, 5.98 [00:23:14] PROBLEM - cp31 Puppet on cp31 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[wiki.apadotech.ga] [00:23:23] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRsT [00:23:25] [02miraheze/ssl] 07MirahezeSSLBot 03e621fc0 - Bot: Update SSL cert for wiki.grottocenter.org [00:23:36] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 6.00, 5.36, 5.01 [00:23:51] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.12, 3.80, 3.73 [00:23:52] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRst [00:23:53] [02miraheze/ssl] 07MirahezeSSLBot 0379dd150 - Bot: Update SSL cert for wiki.fraterniterebellion.com [00:24:07] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRsO [00:24:09] [02miraheze/ssl] 07MirahezeSSLBot 03c9ca26d - Bot: Update SSL cert for mediawiki.ecfin.eu [00:24:24] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRsc [00:24:25] [02miraheze/ssl] 07MirahezeSSLBot 03895584b - Bot: Update SSL cert for mrlove.wiki [00:24:37] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRsl [00:24:38] [02miraheze/ssl] 07MirahezeSSLBot 03d7d895b - Bot: Update SSL cert for vitriol.spoon.army [00:24:49] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRsR [00:24:51] [02miraheze/ssl] 07MirahezeSSLBot 03d58c71d - Bot: Update SSL cert for wiki.ricochetuniverse.com [00:25:07] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRsu [00:25:08] [02miraheze/ssl] 07MirahezeSSLBot 03cd4f730 - Bot: Update SSL cert for monarchists.wiki [00:25:23] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRsw [00:25:25] [02miraheze/ssl] 07MirahezeSSLBot 03a9e9fec - Bot: Update SSL cert for wiki.tulpa.info [00:25:30] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 10.22, 6.84, 5.57 [00:25:49] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.76, 3.73 [00:27:04] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.40, 3.83, 3.75 [00:27:04] RECOVERY - mrlove.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mrlove.wiki' will expire on Sun 27 Mar 2022 23:24:17 GMT +0000. [00:27:22] RECOVERY - wiki.fraterniterebellion.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fraterniterebellion.com' will expire on Sun 27 Mar 2022 23:23:46 GMT +0000. [00:27:52] RECOVERY - wiki.cdntennis.ca - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.cdntennis.ca' will expire on Sun 27 Mar 2022 23:22:36 GMT +0000. [00:28:14] RECOVERY - wiki.grottocenter.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.grottocenter.org' will expire on Sun 27 Mar 2022 23:23:16 GMT +0000. [00:28:40] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.90, 7.08, 6.34 [00:29:01] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.03, 3.55, 3.66 [00:29:04] RECOVERY - wiki.ricochetuniverse.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ricochetuniverse.com' will expire on Sun 27 Mar 2022 23:24:45 GMT +0000. [00:29:35] RECOVERY - miraheze.ml - LetsEncrypt on sslhost is OK: OK - Certificate 'miraheze.ml' will expire on Sun 27 Mar 2022 23:22:19 GMT +0000. [00:29:39] RECOVERY - wiki.tulpa.info - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.tulpa.info' will expire on Sun 27 Mar 2022 23:25:17 GMT +0000. [00:29:41] RECOVERY - www.fraterniterebellion.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fraterniterebellion.com' will expire on Sun 27 Mar 2022 23:23:46 GMT +0000. [00:29:43] RECOVERY - mediawiki.ecfin.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'mediawiki.ecfin.eu' will expire on Sun 27 Mar 2022 23:24:02 GMT +0000. [00:29:45] RECOVERY - vitriol.spoon.army - LetsEncrypt on sslhost is OK: OK - Certificate 'vitriol.spoon.army' will expire on Sun 27 Mar 2022 23:24:31 GMT +0000. [00:29:46] RECOVERY - monarchists.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'monarchists.wiki' will expire on Sun 27 Mar 2022 23:25:01 GMT +0000. [00:29:52] RECOVERY - wiki.graalmilitary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.graalmilitary.com' will expire on Sun 27 Mar 2022 23:22:51 GMT +0000. [00:30:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRGx [00:30:44] [02miraheze/ssl] 07MirahezeSSLBot 03b81f11e - Bot: Update SSL cert for mh142.com [00:30:58] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.56, 4.51, 4.00 [00:31:00] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZe [00:31:01] [02miraheze/ssl] 07MirahezeSSLBot 03d41fd48 - Bot: Update SSL cert for permanentfuturelab.wiki [00:31:15] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZU [00:31:16] [02miraheze/ssl] 07MirahezeSSLBot 0316f2b85 - Bot: Update SSL cert for wiki.ssij.se [00:31:40] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [00:32:19] [02miraheze/ssl] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JyRZs [00:32:21] [02miraheze/ssl] 07paladox 03733f9b7 - disable events for ndg.nenawiki.org [00:32:22] [02ssl] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:32:24] [02ssl] 07paladox opened pull request 03#454: disable events for ndg.nenawiki.org - 13https://git.io/JyRZG [00:32:28] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.83, 6.27, 6.21 [00:32:33] [02ssl] 07paladox closed pull request 03#454: disable events for ndg.nenawiki.org - 13https://git.io/JyRZG [00:32:34] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZc [00:32:36] [02miraheze/ssl] 07paladox 03be78143 - disable events for ndg.nenawiki.org (#454) [00:32:37] [02ssl] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vxP9L [00:32:39] [02miraheze/ssl] 07paladox deleted branch 03paladox-patch-1 [00:33:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZ4 [00:33:05] [02miraheze/ssl] 07MirahezeSSLBot 0341bccfb - Bot: Update SSL cert for nenawiki.org [00:33:27] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZE [00:33:28] [02miraheze/ssl] 07MirahezeSSLBot 038bd25dd - Bot: Update SSL cert for nonbinary.wiki [00:33:35] [02mw-config] 07Universal-Omega closed pull request 03#4301: Enable GlobalWatchlist for betawiki - 13https://git.io/JyRYD [00:33:37] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [00:33:38] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JyRZg [00:33:40] [02miraheze/mw-config] 07Universal-Omega 03ab17ff1 - Enable GlobalWatchlist for betawiki (#4301) [00:33:41] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [00:33:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZ2 [00:33:44] [02miraheze/ssl] 07MirahezeSSLBot 03513941a - Bot: Update SSL cert for wiki.make717.org [00:33:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZw [00:33:59] [02miraheze/ssl] 07MirahezeSSLBot 0330f30cc - Bot: Update SSL cert for wiki.mineland.eu [00:34:11] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZ6 [00:34:12] [02miraheze/ssl] 07MirahezeSSLBot 03a344add - Bot: Update SSL cert for wiki.danvs.net [00:34:27] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZ1 [00:34:28] [02miraheze/ssl] 07MirahezeSSLBot 03335c3a3 - Bot: Update SSL cert for speleo.wiki [00:34:37] miraheze/mw-config - Universal-Omega the build passed. [00:34:40] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.18, 5.77, 5.80 [00:34:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZQ [00:34:45] [02miraheze/ssl] 07MirahezeSSLBot 03195ef1a - Bot: Update SSL cert for archive.a2b2.org [00:34:52] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.96, 3.71, 3.79 [00:34:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRZb [00:34:58] [02miraheze/ssl] 07MirahezeSSLBot 033b78dfc - Bot: Update SSL cert for adadevelopersacademy.wiki [00:35:03] PROBLEM - cp31 Stunnel Http for mw11 on cp31 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:35:14] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRne [00:35:15] [02miraheze/ssl] 07MirahezeSSLBot 037e41748 - Bot: Update SSL cert for antiguabarbudacalypso.com [00:35:32] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRnk [00:35:34] [02miraheze/ssl] 07MirahezeSSLBot 035c7a326 - Bot: Update SSL cert for allthetropes.org [00:35:45] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRnm [00:35:47] [02miraheze/ssl] 07MirahezeSSLBot 034515ae6 - Bot: Update SSL cert for aman.awiki.org [00:36:36] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.12, 6.09, 5.92 [00:37:05] RECOVERY - nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nonbinary.wiki' will expire on Sun 27 Mar 2022 23:33:20 GMT +0000. [00:37:06] RECOVERY - cp31 Stunnel Http for mw11 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14557 bytes in 4.701 second response time [00:37:13] RECOVERY - www.mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Sun 27 Mar 2022 23:30:36 GMT +0000. [00:37:17] RECOVERY - www.permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Sun 27 Mar 2022 23:30:53 GMT +0000. [00:37:20] RECOVERY - wiki.ssij.se - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ssij.se' will expire on Sun 27 Mar 2022 23:31:09 GMT +0000. [00:37:23] RECOVERY - nenawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nenawiki.org' will expire on Sun 27 Mar 2022 23:32:57 GMT +0000. [00:37:25] RECOVERY - ndg.nenawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'nenawiki.org' will expire on Sun 27 Mar 2022 23:32:57 GMT +0000. [00:37:29] RECOVERY - mh142.com - LetsEncrypt on sslhost is OK: OK - Certificate 'mh142.com' will expire on Sun 27 Mar 2022 23:30:36 GMT +0000. [00:37:36] RECOVERY - permanentfuturelab.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'permanentfuturelab.wiki' will expire on Sun 27 Mar 2022 23:30:53 GMT +0000. [00:37:37] RECOVERY - wiki.make717.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.make717.org' will expire on Sun 27 Mar 2022 23:33:35 GMT +0000. [00:37:40] RECOVERY - wiki.danvs.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.danvs.net' will expire on Sun 27 Mar 2022 23:34:06 GMT +0000. [00:37:42] RECOVERY - speleo.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'speleo.wiki' will expire on Sun 27 Mar 2022 23:34:22 GMT +0000. [00:37:44] RECOVERY - archive.a2b2.org - LetsEncrypt on sslhost is OK: OK - Certificate 'archive.a2b2.org' will expire on Sun 27 Mar 2022 23:34:37 GMT +0000. [00:37:46] RECOVERY - adadevelopersacademy.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'adadevelopersacademy.wiki' will expire on Sun 27 Mar 2022 23:34:52 GMT +0000. [00:37:46] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.63, 5.29, 5.65 [00:37:49] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Sun 27 Mar 2022 23:35:09 GMT +0000. [00:37:51] RECOVERY - allthetropes.org - LetsEncrypt on sslhost is OK: OK - Certificate 'allthetropes.org' will expire on Sun 27 Mar 2022 23:35:25 GMT +0000. [00:37:53] RECOVERY - aman.awiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'aman.awiki.org' will expire on Sun 27 Mar 2022 23:35:41 GMT +0000. [00:37:59] RECOVERY - wiki.mineland.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mineland.eu' will expire on Sun 27 Mar 2022 23:33:52 GMT +0000. [00:38:21] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRnS [00:38:21] RECOVERY - www.allthetropes.org - LetsEncrypt on sslhost is OK: OK - Certificate 'allthetropes.org' will expire on Sun 27 Mar 2022 23:35:25 GMT +0000. [00:38:22] [02miraheze/ssl] 07MirahezeSSLBot 030128c11 - Bot: Update SSL cert for wiki.thunis.eu [00:38:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRn7 [00:38:45] [02miraheze/ssl] 07MirahezeSSLBot 031991c6b - Bot: Update SSL cert for beaconspace.unrestrictedlorefare.com [00:38:46] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.65, 4.66, 4.14 [00:39:03] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JyRnb [00:39:04] [02miraheze/mw-config] 07Universal-Omega 03cea9dc7 - Update Defines.php [00:39:06] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRnN [00:39:07] [02miraheze/ssl] 07MirahezeSSLBot 03f1376ef - Bot: Update SSL cert for dariawiki.org [00:39:09] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [00:39:11] [02mw-config] 07Universal-Omega opened pull request 03#4302: set ManageWikiNamespaces' variable defaults - 13https://git.io/JyRnp [00:39:27] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcf [00:39:28] [02miraheze/ssl] 07MirahezeSSLBot 03d5c2caf - Bot: Update SSL cert for ao90.pinho.org [00:39:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcI [00:39:41] [02miraheze/ssl] 07MirahezeSSLBot 03c46d5d4 - Bot: Update SSL cert for archive.stellurgists.wiki [00:39:48] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.61, 7.22, 6.45 [00:39:55] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcY [00:39:57] [02miraheze/ssl] 07MirahezeSSLBot 03ae50891 - Bot: Update SSL cert for electowiki.org [00:40:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcn [00:40:10] [02miraheze/ssl] 07MirahezeSSLBot 03beda819 - Bot: Update SSL cert for data.nonbinary.wiki [00:40:12] miraheze/mw-config - Universal-Omega the build passed. [00:40:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcB [00:40:42] [02miraheze/ssl] 07MirahezeSSLBot 033139e1e - Bot: Update SSL cert for enc.for.uz [00:40:57] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcz [00:40:59] [02miraheze/ssl] 07MirahezeSSLBot 03fc096ad - Bot: Update SSL cert for hololive.wiki [00:41:13] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.10, 6.63, 5.97 [00:41:14] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcr [00:41:15] [02miraheze/ssl] 07MirahezeSSLBot 036c9edb8 - Bot: Update SSL cert for fc.songcontests.eu [00:41:28] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRc6 [00:41:29] [02miraheze/ssl] 07MirahezeSSLBot 03ddef5f1 - Bot: Update SSL cert for publictestwiki.com [00:41:43] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.16, 7.13, 6.50 [00:41:45] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcM [00:41:46] [02miraheze/ssl] 07MirahezeSSLBot 03cf56427 - Bot: Update SSL cert for index.pdcommunity.ir [00:41:59] !log [@mw11] starting deploy of {'config': True} to ovlon [00:42:02] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcQ [00:42:03] [02miraheze/ssl] 07MirahezeSSLBot 0344ba4be - Bot: Update SSL cert for franchise.franchising.org.ua [00:42:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:42:15] !log [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 16s [00:42:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:42:59] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRcp [00:43:01] [02miraheze/ssl] 07MirahezeSSLBot 03d9ef037 - Bot: Update SSL cert for encyclopediaofastrobiology.org [00:43:13] RECOVERY - wiki.thunis.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.thunis.eu' will expire on Sun 27 Mar 2022 23:38:16 GMT +0000. [00:43:14] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRCf [00:43:15] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.39, 6.47, 6.00 [00:43:16] [02miraheze/ssl] 07MirahezeSSLBot 03245b593 - Bot: Update SSL cert for guia.cineastas.pt [00:43:21] RECOVERY - www.dariawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dariawiki.org' will expire on Sun 27 Mar 2022 23:38:58 GMT +0000. [00:43:22] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.75, 6.94, 6.14 [00:43:23] RECOVERY - ao90.pinho.org - LetsEncrypt on sslhost is OK: OK - Certificate 'ao90.pinho.org' will expire on Sun 27 Mar 2022 23:39:20 GMT +0000. [00:43:25] RECOVERY - archive.stellurgists.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'archive.stellurgists.wiki' will expire on Sun 27 Mar 2022 23:39:35 GMT +0000. [00:43:27] RECOVERY - electowiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'electowiki.org' will expire on Sun 27 Mar 2022 23:39:50 GMT +0000. [00:43:34] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.00, 3.83, 4.96 [00:43:46] RECOVERY - data.nonbinary.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'data.nonbinary.wiki' will expire on Sun 27 Mar 2022 23:40:03 GMT +0000. [00:43:47] RECOVERY - www.publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Sun 27 Mar 2022 23:41:23 GMT +0000. [00:43:48] RECOVERY - enc.for.uz - LetsEncrypt on sslhost is OK: OK - Certificate 'enc.for.uz' will expire on Sun 27 Mar 2022 23:40:35 GMT +0000. [00:43:50] RECOVERY - dariawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dariawiki.org' will expire on Sun 27 Mar 2022 23:38:58 GMT +0000. [00:43:53] RECOVERY - publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Sun 27 Mar 2022 23:41:23 GMT +0000. [00:43:55] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRCq [00:43:55] RECOVERY - fc.songcontests.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'fc.songcontests.eu' will expire on Sun 27 Mar 2022 23:41:08 GMT +0000. [00:43:57] [02miraheze/ssl] 07MirahezeSSLBot 03a5ffbbd - Bot: Update SSL cert for cyberlaw.ccdcoe.org [00:43:57] RECOVERY - hololive.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'hololive.wiki' will expire on Sun 27 Mar 2022 23:40:50 GMT +0000. [00:44:03] RECOVERY - beaconspace.unrestrictedlorefare.com - LetsEncrypt on sslhost is OK: OK - Certificate 'beaconspace.unrestrictedlorefare.com' will expire on Sun 27 Mar 2022 23:38:37 GMT +0000. [00:44:09] RECOVERY - index.pdcommunity.ir - LetsEncrypt on sslhost is OK: OK - Certificate 'index.pdcommunity.ir' will expire on Sun 27 Mar 2022 23:41:38 GMT +0000. [00:44:14] RECOVERY - franchise.franchising.org.ua - LetsEncrypt on sslhost is OK: OK - Certificate 'franchise.franchising.org.ua' will expire on Sun 27 Mar 2022 23:41:55 GMT +0000. [00:44:38] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRCC [00:44:40] [02miraheze/ssl] 07MirahezeSSLBot 031f9c934 - Bot: Update SSL cert for guia.esporo.net [00:44:46] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JyRC4 [00:44:48] [02miraheze/CreateWiki] 07Universal-Omega 038dc442f - Update RequestWikiAIJob.php [00:44:49] [02CreateWiki] 07Universal-Omega synchronize pull request 03#269: Add auto approval description blacklist to AI - 13https://git.io/JDFNj [00:45:05] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRCu [00:45:06] [02miraheze/ssl] 07MirahezeSSLBot 0337d47ae - Bot: Update SSL cert for history.sdtef.org [00:45:10] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JyRCg [00:45:12] [02miraheze/CreateWiki] 07Universal-Omega 03f7aa0f0 - Update extension.json [00:45:14] [02CreateWiki] 07Universal-Omega synchronize pull request 03#269: Add auto approval description blacklist to AI - 13https://git.io/JDFNj [00:45:18] PROBLEM - mw13 Current Load on mw13 is CRITICAL: CRITICAL - load average: 9.14, 7.73, 6.52 [00:45:19] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRCV [00:45:21] [02miraheze/ssl] 07MirahezeSSLBot 033f1a236 - Bot: Update SSL cert for scpvncommunitywiki.xyz [00:45:33] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.27, 6.66, 6.46 [00:45:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRCi [00:45:41] [02miraheze/ssl] 07MirahezeSSLBot 03e215489 - Bot: Update SSL cert for wiki.homiedb.party [00:46:56] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRWf [00:46:58] [02miraheze/dns] 07paladox 036784b9b - Add acme challenge to miraheze.org [00:48:11] [02miraheze/ssl] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRWl [00:48:13] [02miraheze/ssl] 07paladox 0316de1d6 - Update m.miraheze.org.crt [00:48:17] [02CreateWiki] 07Universal-Omega closed pull request 03#269: Add auto approval description blacklist to AI - 13https://git.io/JDFNj [00:48:19] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JyRWB [00:48:20] [02miraheze/CreateWiki] 07Universal-Omega 03f1d6e6c - Add auto approval description blacklist to AI (#269) [00:48:22] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [00:48:23] [02CreateWiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/vpJTL [00:48:24] miraheze/CreateWiki - Universal-Omega the build has errored. [00:48:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRW0 [00:48:36] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.89, 7.30, 6.32 [00:48:36] [02miraheze/ssl] 07MirahezeSSLBot 030e1d2f4 - Bot: Update SSL cert for zamlung.tk [00:48:51] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.85, 21.01, 23.66 [00:49:02] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRWw [00:49:03] [02miraheze/ssl] 07MirahezeSSLBot 0398c4781 - Bot: Update SSL cert for wiki.consid.vn [00:49:15] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JyRW6 [00:49:16] [02miraheze/ssl] 07MirahezeSSLBot 033ad4cb3 - Bot: Update SSL cert for thepolicyhub.org.uk [00:50:37] PROBLEM - cp31 Stunnel Http for mw12 on cp31 is CRITICAL: HTTP CRITICAL - No data received from host [00:50:50] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 37.38, 26.26, 25.19 [00:50:53] PROBLEM - cp30 Stunnel Http for mw12 on cp30 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:51:01] RECOVERY - cp31 Puppet on cp31 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:51:05] PROBLEM - mw12 MediaWiki Rendering on mw12 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:51:10] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 8 datacenters are down: 51.195.220.68/cpweb, 198.244.148.90/cpweb, 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb, 149.56.140.43/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::929a/cpweb, 2607:5300:201:3100::5ebc/cpweb [00:51:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 51.195.220.68/cpweb, 198.244.148.90/cpweb, 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb, 149.56.140.43/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::929a/cpweb, 2607:5300:201:3100::5ebc/cpweb [00:51:13] RECOVERY - guia.esporo.net - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.esporo.net' will expire on Sun 27 Mar 2022 23:44:33 GMT +0000. [00:51:33] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Sun 27 Mar 2022 23:47:45 GMT +0000. [00:51:35] RECOVERY - mw13 Puppet on mw13 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:51:36] RECOVERY - history.sdtef.org - LetsEncrypt on sslhost is OK: OK - Certificate 'history.sdtef.org' will expire on Sun 27 Mar 2022 23:44:57 GMT +0000. [00:51:39] RECOVERY - guia.cineastas.pt - LetsEncrypt on sslhost is OK: OK - Certificate 'guia.cineastas.pt' will expire on Sun 27 Mar 2022 23:43:09 GMT +0000. [00:51:43]