[00:00:47] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.06, 7.30, 7.34 [00:02:46] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.38, 7.05, 7.25 [00:03:27] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.31, 7.96, 7.94 [00:05:40] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 5 seconds ago with 0 failures [00:06:00] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [00:07:21] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:07:52] RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:10:07] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZHxP [00:10:08] [02miraheze/mw-config] 07Universal-Omega 0347b3443 - add wgIcon [00:11:13] miraheze/mw-config - Universal-Omega the build passed. [00:12:42] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.06, 5.92, 6.74 [00:13:21] !log cd /srv/mediawiki/w/ && sudo -u www-data git fetch && sudo -u www-data git reset --hard origin/REL1_36 && cd vendor && sudo -u www-data git reset --hard origin/REL1_36 && sudo puppet agent -tv on mw8-10 / jbr* / test3 (issue on mw11) [00:13:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:13:55] paladox: ^ did not work on mw11 to get puppet running, bunch of access denied stuff. [00:14:08] ok [00:14:11] i'll check [00:14:11] also [00:14:19] https://stockcarracing.miraheze.org/wiki/Main_Page is fataling [00:14:26] Original exception: [ab916a07498a7277ae7cc1f5] /wiki/Main_Page Error: Class 'Wikibase\DataModel\Services\Lookup\DisabledEntityTypesEntityLookup' not found [00:14:46] Was composer ran? [00:14:56] yeh [00:15:25] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.81, 5.62, 6.75 [00:17:02] weird thing is i see the file [00:17:18] paladox: composer running fixes it. [00:17:30] oh? [00:17:33] I did on test3 an proxied and now it works. [00:18:11] ah, great! i did run composer earlier though... [00:18:22] anyways you can run that on all mw* and jobrunner* :) [00:18:25] pls and thanks! [00:18:44] actually... [00:18:49] i guess i could use salt [00:18:56] what was the command you used Universal_Omega ? [00:19:07] `sudo -u www-data wget -O composer.phar https://getcomposer.org/composer-1.phar | php && sudo -u www-data php composer.phar install --no-dev` [00:19:16] thanks [00:19:25] No problem [00:19:30] in /srv/mediawiki/w? [00:19:34] yep [00:20:42] works now! [00:20:49] Great! [00:21:50] paladox: I think it was my fault when I git reset vendor to fix puppet. So if you fix mw11, may need to do that again there. (not 100% sure though) [00:22:07] oh [00:27:20] paladox: https://github.com/miraheze/puppet/pull/1777 (a bit unrelated but just an email reminded me about that; google still gives indexed though blocked by robots.txt and I assumed that would fix though may not? Just wondering what you think and if you can merge if so.) [00:28:00] i mean i doin't think that will fix it? [00:28:10] or maybe i [00:28:16] i'm not understanding something [00:28:30] I know it would fix I just don't know if those are still needed. [00:28:37] as that is the cause of errors. [00:28:47] what errors? [00:29:22] paladox: In google. `'Indexed, though blocked by robots.txt'.` [00:29:33] oh [00:29:40] so you want me to remove it? [00:29:50] err merge that commit. [00:30:44] paladox: That is why I added the header (https://github.com/miraheze/puppet/blob/79340d4/modules/varnish/templates/default.vcl#L405-L407) before but I am unsure if that part in robots is still needed, but don't think so. [00:31:16] I can merge, though is there anyway you can test? [00:31:24] if i merge it [00:31:39] No, it's not testable until google starts picking up index changes. [00:31:50] oh ok [00:32:01] [02puppet] 07paladox closed pull request 03#1777: Remove DISALLOW stuff from robots.txt user-agent: * - 13https://git.io/JZW6H [00:32:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZQkx [00:32:03] [02miraheze/puppet] 07Universal-Omega 03edb2763 - Remove DISALLOW stuff from robots.txt user-agent: * (#1777) [00:32:23] Thanks! [00:33:52] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [00:34:17] paladox: also, you can probably merge https://github.com/miraheze/puppet/pull/1776 if you want/looks right as well as Reception123 gave the go ahead on testing that for opt-in wikis which the mw-config PR has wikis that has opted in already. I just wanted to wait till after 1.36. I can wait for him though also if you want. [00:34:41] [02puppet] 07paladox closed pull request 03#1776: Add cron for updateSpecialPages.php - 13https://git.io/JZcUr [00:34:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZQLI [00:34:44] [02miraheze/puppet] 07Universal-Omega 0316c3053 - Add cron for updateSpecialPages.php (#1776) [00:34:52] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:35:28] [02mw-config] 07Universal-Omega closed pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZcIP [00:35:29] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZQLz [00:35:31] [02miraheze/mw-config] 07Universal-Omega 03bb5405c - Set wgMiserMode to true for opt-in wikis (#3945) [00:35:32] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [00:35:34] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [00:36:28] miraheze/mw-config - Universal-Omega the build passed. [00:51:36] paladox: thanks for fixing mw11 also. [00:51:46] yw [00:56:46] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=batmanwiki [00:56:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:56:58] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=cosmoswiki [00:57:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:57:10] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=darkangelwiki [00:57:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:57:24] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=dcmultiversewiki [00:57:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:57:37] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=metawiki [00:57:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:57:54] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=r4356thwiki [00:57:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:58:03] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=snapwikiwiki [00:58:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:58:14] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=test3wiki [00:58:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:58:19] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=testwiki [00:58:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:58:28] !log [universalomega@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/updateSpecialPages.php --wiki=theboyswiki [00:58:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:06:01] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [01:10:32] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [01:14:04] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZQBr [01:14:06] [02miraheze/mw-config] 07Universal-Omega 03d8caa6b - Fix tabbing [01:15:51] miraheze/mw-config - Universal-Omega the build passed. [01:16:01] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZQRL [01:16:01] [02miraheze/mw-config] 07Universal-Omega 03f15658f - Fix spacing [01:16:23] miraheze/mw-config - Universal-Omega the build passed. [01:44:08] paladox: what is the issue we had with 1.35 that John mentioned was with CreateWiki cache or something with namespace aliases? We are having it again it seems. [01:44:24] Um, i'm not sure [01:44:27] cannot remember [01:45:11] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [01:45:44] paladox: Yeah I only vaguely remember but I do think it is the same issue as https://phabricator.miraheze.org/T7455, https://phabricator.miraheze.org/T7456 and https://phabricator.miraheze.org/T7452 [01:46:44] also #miraheze has reports of it. [01:49:29] https://phabricator.miraheze.org/T6826 [01:50:23] Yeah it's that same issue. [01:50:43] it will regenerate automatically eventually I think, right, paladox? [01:51:10] Can we merge those tickets rather than closing the duplicates? [01:53:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZQ1m [01:53:15] [02miraheze/puppet] 07paladox 03fb5956d - Fix [01:54:00] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 0 seconds ago with 0 failures [01:55:43] Universal_Omega: seems like namespaces work [01:55:48] after deleting the cache files? [01:56:07] !log mw*: cd /srv/mediawiki/w ; rm *.json [01:56:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:01:00] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [02:14:52] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [02:38:43] paladox: I thought John said not to do that last time? Maybe I am mistaken. [02:40:55] paladox: Thanks for helping out today! [02:44:35] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [02:58:26] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [03:05:25] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.82, 6.43, 5.67 [03:07:25] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.99, 5.74, 5.53 [03:28:30] PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 24 minutes ago with 0 failures [03:41:59] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [03:55:51] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [04:11:43] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [04:36:30] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [04:38:15] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZ7bx [04:38:16] [02miraheze/mediawiki] 07Universal-Omega 036744a01 - Update Cosmos [04:39:38] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [04:55:35] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZ5vJ [04:55:35] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [04:55:36] [02miraheze/mediawiki] 07Universal-Omega 031ee73b5 - Update Cosmos [04:58:18] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.08, 1.86, 1.38 [05:00:18] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 4.04, 2.23, 1.55 [05:02:18] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.84, 1.62, 1.40 [05:08:24] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZ5kq [05:08:26] [02miraheze/mediawiki] 07Universal-Omega 03087aa37 - Update Cosmos [05:38:23] PROBLEM - gp.ct777.cf - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'gp.ct777.cf' expires in 15 day(s) (Tue 29 Jun 2021 05:31:27 GMT +0000). [05:39:18] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZ5C4 [05:39:20] [02miraheze/ssl] 07MirahezeSSLBot 03c1e7fad - Bot: Update SSL cert for gp.ct777.cf [05:59:22] RECOVERY - gp.ct777.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'gp.ct777.cf' will expire on Sat 11 Sep 2021 04:39:11 GMT +0000. [06:29:41] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZ51r [06:29:42] [02miraheze/mw-config] 07Universal-Omega 03cf3c05b - Add wgCosmosEnableWantedPages override for batmanwiki and snapwikiwiki [06:30:46] miraheze/mw-config - Universal-Omega the build passed. [06:52:23] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [07:16:48] [02puppet] 07Universal-Omega synchronize pull request 03#1772: T7192: Move cache out of w/ directory - 13https://git.io/JZt3Y [07:18:14] [02puppet] 07Universal-Omega synchronize pull request 03#1772: T7192: Move cache out of w/ directory - 13https://git.io/JZt3Y [07:47:49] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [07:52:31] [02mediawiki] 07R4356th opened pull request 03#2259: Install WikibaseLocalMedia (T7294) - 13https://git.io/JZdWz [07:54:09] [02mw-config] 07R4356th synchronize pull request 03#3947: Add WikibaseLocalMedia (T7294) - 13https://git.io/JZ0f3 [07:55:02] miraheze/mw-config - R4356th the build passed. [07:55:17] [02mw-config] 07R4356th synchronize pull request 03#3947: Add WikibaseLocalMedia (T7294) - 13https://git.io/JZ0f3 [07:56:11] miraheze/mw-config - R4356th the build passed. [07:57:53] [02mw-config] 07R4356th synchronize pull request 03#3947: Add WikibaseLocalMedia (T7294) - 13https://git.io/JZ0f3 [07:58:41] miraheze/mw-config - R4356th the build passed. [07:59:12] [02mw-config] 07R4356th synchronize pull request 03#3947: Add WikibaseLocalMedia (T7294) - 13https://git.io/JZ0f3 [08:00:02] miraheze/mw-config - R4356th the build passed. [08:03:19] PROBLEM - zh.gyaanipedia.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'zh.gyaanipedia.com' expires in 15 day(s) (Tue 29 Jun 2021 07:58:51 GMT +0000). [08:03:41] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [08:04:34] PROBLEM - wiki.fbpml.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.fbpml.org' expires in 15 day(s) (Tue 29 Jun 2021 07:57:16 GMT +0000). [08:06:41] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZdEK [08:06:43] [02miraheze/ssl] 07MirahezeSSLBot 0328988c7 - Bot: Update SSL cert for zh.gyaanipedia.com [08:10:21] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZdzl [08:10:23] [02miraheze/ssl] 07MirahezeSSLBot 03e363ac6 - Bot: Update SSL cert for wiki.fbpml.org [08:10:30] PROBLEM - test3 Puppet on test3 is WARNING: WARNING: Puppet is currently disabled, message: reason not specified, last run 2 minutes ago with 0 failures [08:31:15] RECOVERY - zh.gyaanipedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'zh.gyaanipedia.com' will expire on Sat 11 Sep 2021 07:06:34 GMT +0000. [08:31:59] RECOVERY - wiki.fbpml.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fbpml.org' will expire on Sat 11 Sep 2021 07:10:15 GMT +0000. [08:38:24] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [09:08:04] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [09:21:55] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [09:31:45] [02mw-config] 07JohnFLewis commented on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZFto [09:37:43] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [10:13:07] [02mw-config] 07Universal-Omega commented on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZFg3 [10:15:56] [02mediawiki] 07Universal-Omega closed pull request 03#2259: Install WikibaseLocalMedia (T7294) - 13https://git.io/JZdWz [10:15:58] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+1/-0/±1] 13https://git.io/JZF2V [10:15:59] [02miraheze/mediawiki] 07R4356th 03af2d523 - Install WikibaseLocalMedia (T7294) (#2259) [10:18:50] [02mw-config] 07JohnFLewis commented on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZFab [10:58:51] Universal_Omega: yeh he did which I remembered after the fact. I have a script that resets wiki cache without the need for me to do what i did [11:35:35] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [11:58:21] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [13:20:02] PROBLEM - linkwiki.cf - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'linkwiki.cf' expires in 15 day(s) (Tue 29 Jun 2021 13:16:54 GMT +0000). [13:25:52] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZbFN [13:25:53] [02miraheze/ssl] 07MirahezeSSLBot 03d8d63be - Bot: Update SSL cert for linkwiki.cf [13:35:24] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [13:37:19] PROBLEM - wiki.slimelab.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.slimelab.net' expires in 15 day(s) (Tue 29 Jun 2021 13:29:07 GMT +0000). [13:42:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZNvs [13:42:10] [02miraheze/ssl] 07MirahezeSSLBot 030c1b0f0 - Bot: Update SSL cert for wiki.slimelab.net [14:01:55] RECOVERY - linkwiki.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'linkwiki.cf' will expire on Sat 11 Sep 2021 12:25:45 GMT +0000. [14:04:20] RECOVERY - wiki.slimelab.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimelab.net' will expire on Sat 11 Sep 2021 12:42:01 GMT +0000. [14:05:04] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [14:26:04] Is it safe to delete user groups added by extensions that some people still have? [14:29:09] We can empty them first [14:30:20] It won't break anything though [14:30:30] I don't think you can remove them from the people though [14:30:38] If you do [14:30:54] Can you do that for me? [14:31:36] Or should I make a task? [14:34:53] I'm doing college stuff at moment so make a task because I have pants memory [14:35:23] Okay, thank you for the info. 🙂 [14:57:56] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JZNwj [14:57:58] [02miraheze/mediawiki] 07paladox 038f3af19 - Update GlobalPreferences [15:00:34] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [15:09:27] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [15:23:18] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [15:32:11] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [16:06:51] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [16:16:09] [02mw-config] 07dmehus commented on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZAYZ [16:16:47] [02mw-config] 07dmehus edited a comment on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZAYZ [16:19:58] RhinosF1, what's a "pants memory"? I've never heard that expression before. Is it a British expression? [16:20:16] dmehus: pants just means rubbish [16:20:37] RhinosF1, ah, interesting, didn't know that [16:21:26] @R4356th, it's safe to delete user groups with users occupying the groups, as I've seen it done before. The groups will be removed with the group's deletion; you'll just have no rights log entries for the removals [16:29:41] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [16:31:09] I think I will just manually remove the groups from the users first just to avoid any potential issue. [16:34:16] [02mw-config] 07Reception123 commented on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZAWC [16:37:43] [02mw-config] 07Reception123 edited a comment on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZAWC [16:40:12] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZA4q [16:40:13] [02miraheze/services] 07MirahezeSSLBot 03ea98f41 - BOT: Updating services config for wikis [16:40:48] [02mw-config] 07dmehus commented on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZA40 [16:43:34] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [16:47:20] paladox: ah alright thanks I understand. [17:14:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZAKj [17:14:50] [02miraheze/mw-config] 07Universal-Omega 03c99894c - Fix TimedMediaHandler sql [17:15:46] miraheze/mw-config - Universal-Omega the build passed. [17:20:10] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [17:43:05] Will-change memory consumption is too high. Budget limit is the document surface area multiplied by 3 (405760 px). Occurrences of will-change over the budget will be ignored. [17:43:22] I am getting this error in my console while reviewing my changes with CodeEditor. [17:45:16] On what page? [17:45:34] https://snapwiki.miraheze.org/w/index.php?title=MediaWiki:Common.js [17:46:44] Hmm [17:46:56] Is there a specific part of your edit that triggers it? [17:47:14] I made two edits both of which triggered it. [17:47:35] Not sure then [17:47:36] I do not think I did anything that could cause high memory consumption. [17:47:37] 13:46 ⇐ You were banned from kodama.freenode.net: You are banned from this server- IRCCloud is no longer welcome on freenode (2021/6/13 12.46) [17:47:47] well, that's just great [17:47:48] Is it just log spam or ? [17:47:53] MacFan4000: -offtopic pls [17:48:15] RhinosF1: only one at a time but every time I try to edit the page. [17:48:47] The edit I made earlier: https://snapwiki.miraheze.org/w/index.php?title=MediaWiki:Common.js&curid=295&diff=7701&oldid=1936&_rcid=10646 [17:48:49] File a task then [17:48:58] Log spam is annoying but I've not got much ideas [17:49:02] Just ignore it for now [17:49:05] 👍 [17:49:42] I was actually looking for Jquery deprecation messages because I wanted to turn Jmigrate off. [17:50:14] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JZAbl [17:50:15] [02miraheze/mw-config] 07Universal-Omega 03b71c234 - Set wgMiserMode for commonswiki, devwiki, and templatewiki [17:50:17] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [17:50:18] [02mw-config] 07Universal-Omega opened pull request 03#3960: Set wgMiserMode for commonswiki, devwiki, and templatewiki - 13https://git.io/JZAbR [17:50:47] [02mw-config] 07Universal-Omega closed pull request 03#3960: Set wgMiserMode for commonswiki, devwiki, and templatewiki - 13https://git.io/JZAbR [17:50:48] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZAb9 [17:50:50] [02miraheze/mw-config] 07Universal-Omega 03dce04a4 - Set wgMiserMode for commonswiki, devwiki, and templatewiki (#3960) [17:50:51] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [17:50:53] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [17:51:20] miraheze/mw-config - Universal-Omega the build passed. [17:51:43] miraheze/mw-config - Universal-Omega the build passed. [18:13:53] [02mw-config] 07JohnFLewis commented on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZxUf [18:14:58] [02mw-config] 07JohnFLewis edited a comment on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZxUf [18:15:15] [02mw-config] 07JohnFLewis edited a comment on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZxUf [18:15:36] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [18:31:25] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [18:37:19] [02mw-config] 07R4356th commented on pull request 03#3947: Add WikibaseLocalMedia (T7294) - 13https://git.io/JZx3A [18:45:17] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [18:46:05] @R4356th: it's only 11 hours since you marked it ready [18:50:16] PROBLEM - wiki.scrungecraft.gg - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.scrungecraft.gg' expires in 15 day(s) (Tue 29 Jun 2021 18:43:12 GMT +0000). [18:53:29] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZxWx [18:53:30] [02miraheze/ssl] 07MirahezeSSLBot 03a776958 - Bot: Update SSL cert for wiki.scrungecraft.gg [18:55:25] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.49, 6.58, 5.88 [18:56:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.99, 7.64, 6.34 [18:57:25] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.65, 6.92, 6.06 [18:58:01] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.94, 7.51, 6.43 [18:59:25] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 6.49, 6.71, 6.09 [18:59:56] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.20, 7.92, 6.72 [19:01:06] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [19:01:51] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.87, 7.86, 6.86 [19:03:23] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.61, 7.18, 6.43 [19:05:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.45, 8.43, 6.78 [19:07:00] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.52, 7.77, 6.73 [19:07:23] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.65, 6.08, 6.18 [19:08:56] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.93, 6.43, 6.36 [19:09:34] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.05, 6.32, 6.60 [19:14:59] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [19:31:12] RECOVERY - wiki.scrungecraft.gg - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.scrungecraft.gg' will expire on Sat 11 Sep 2021 17:53:22 GMT +0000. [19:33:29] RhinosF1: I know, I was waiting for the upgrade and the extension was requested by @Ugochimobi on May 13th. A whole month is a lot of time. [19:34:14] I am not claiming I did not cause this to get delayed further though. [19:35:25] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.81, 6.76, 6.53 [19:37:25] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.01, 6.68, 6.54 [19:55:32] I'm actually a very patient shit man [19:55:49] though it's really been long [19:56:33] [02mw-config] 07dmehus commented on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZxSv [19:57:02] [02mw-config] 07dmehus edited a comment on pull request 03#3945: Set wgMiserMode to true for opt-in wikis - 13https://git.io/JZxSv [19:58:36] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [19:59:07] @Ugochimobi, I'm familiar with that Wikibase config's purpose. It seems fairly non-controversial to implement into ManageWiki. I think there's just been a lot of tasks lately and the MediaWiki 1.36 upgrade has consumed a lot of SRE's time, hence it's just a matter of priorities, but nevertheless it should be implemented soon not to worry. Thank you for your continued patience. :) [20:05:25] :mirahezelogo: We're here [20:10:09] [02puppet] 07dmehus commented on pull request 03#1764: add web.libera.chat to CSP Whitelist for WebChat extension - 13https://git.io/JZx5L [20:10:23] [02puppet] 07dmehus edited a comment on pull request 03#1764: add web.libera.chat to CSP Whitelist for WebChat extension - 13https://git.io/JZx5L [20:10:37] [02puppet] 07dmehus edited a comment on pull request 03#1764: add web.libera.chat to CSP Whitelist for WebChat extension - 13https://git.io/JZx5L [20:12:15] @Ugochimobi, 👍 [20:18:34] [02puppet] 07DarkMatterMan4500 commented on pull request 03#1764: add web.libera.chat to CSP Whitelist for WebChat extension - 13https://git.io/JZxbo [20:19:23] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [20:20:40] Reception|away: paladox: can you please review that puppet pr? [20:22:40] MacFan4000, yeah I'm holding off doing a PR to remove `*.freenode.net` until it's merged as otherwise I'll invariably have to resolve a merge conflict [20:23:12] dmehus: I can update the PR to do that at the same time if you want? [20:23:15] From what I understand @Owen has told us no more until some policy && the other listed whitelist are checked. [20:23:22] *is created [20:24:23] paladox: I thought the policy was created? https://phabricator.miraheze.org/T7322#148829 [20:24:51] Universal_Omega, sure [20:25:51] paladox, no Owen didn't say that. Trust and Safety just advised SRE to establish a formal policy for whitelisting sites. In this case, I think we can safely trust Libera.Chat and freenode.net would be a removal, not an addition [20:26:01] Oh, wasn’t aware of that, though that doesn’t say I have the go ahead to add anymore right now [20:27:13] no, you don't, but it would be nice to make that extension functional :) [20:27:47] “Ideally no future additions are made to the CSP until such a policy is in place.” [20:27:54] Universal_Omega, sure [20:27:56] yeah, it doesn't seem right to offer libera as an option for WebChat when it's blocked by CSP [20:28:25] paladox, "ideally" being the operative word. In this case, there's a clear need based on the very recent events with Libera.Chat [20:28:57] Arguably this is just an *update* to an existing link. What Omega should do is modify his PR to *replace* `*.freenode.net` with `*.libera.chat` [20:29:11] MacFan4000, yeah, exactly [20:29:53] Yeh if you amend to libera that will be better [20:30:00] paladox, sure [20:30:05] and I agree [20:30:10] Universal_Omega: ^ [20:30:24] Sorry so what do I do? [20:30:37] just remove the added line and update the freenode URL to libera [20:30:56] since it's really a replacement [20:31:20] Libera.Chat is the de facto replacement to Freenode, with Freenode existing, but quickly spiralling into oblivion [20:32:02] [02puppet] 07Universal-Omega synchronize pull request 03#1764: add web.libera.chat to CSP Whitelist for WebChat extension - 13https://git.io/JGsTZ [20:32:04] [02puppet] 07Universal-Omega synchronize pull request 03#1764: add web.libera.chat to CSP Whitelist for WebChat extension - 13https://git.io/JGsTZ [20:32:18] [02puppet] 07Universal-Omega edited pull request 03#1764: Replace *.freenode.net with *.libera.chat in CSP whitelist - 13https://git.io/JGsTZ [20:32:36] dmehus: ^ [20:33:03] Universal_Omega, thanks [20:33:19] [02puppet] 07paladox commented on pull request 03#1764: Replace *.freenode.net with *.libera.chat in CSP whitelist - 13https://git.io/JZpev [20:33:19] paladox, should Universal_Omega also update the Apache Traffic Server version also? [20:33:22] [02puppet] 07paladox closed pull request 03#1764: Replace *.freenode.net with *.libera.chat in CSP whitelist - 13https://git.io/JGsTZ [20:33:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZpeJ [20:33:26] [02miraheze/puppet] 07Universal-Omega 037f454cc - Replace *.freenode.net with *.libera.chat in CSP whitelist (#1764) [20:33:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JZpeG [20:33:50] [02miraheze/mw-config] 07Universal-Omega 032703413 - Remove freenodeChat [20:33:52] [02mw-config] 07Universal-Omega synchronize pull request 03#3926: Set WebChat to default to Libera - 13https://git.io/JGY3k [20:33:54] Yeh [20:34:35] ok [20:34:44] miraheze/mw-config - Universal-Omega the build passed. [20:34:46] paladox: oh needs done there to. Doing then. [20:35:14] If you doint want to do that now, that’s fine [20:35:17] I can do it later [20:36:36] [02puppet] 07Universal-Omega opened pull request 03#1782: CSP: Replace *.freenode.net with *.libera.chat - 13https://git.io/JZpvW [20:37:00] paladox: ^ [20:38:10] thanks :) [20:39:06] [02puppet] 07paladox closed pull request 03#1782: CSP: Replace *.freenode.net with *.libera.chat - 13https://git.io/JZpvW [20:39:07] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZpfl [20:39:09] [02miraheze/puppet] 07Universal-Omega 03e7e75ec - CSP: Replace *.freenode.net with *.libera.chat (#1782) [20:40:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JZpf9 [20:40:12] [02miraheze/services] 07MirahezeSSLBot 038e7939f - BOT: Updating services config for wikis [20:40:14] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JZpfQ [20:40:15] [02miraheze/mw-config] 07Universal-Omega 030c77a65 - Remove freenodeChat [20:40:17] [02mw-config] 07Universal-Omega synchronize pull request 03#3926: Set WebChat to default to Libera - 13https://git.io/JGY3k [20:41:12] miraheze/mw-config - Universal-Omega the build passed. [20:42:30] [02mw-config] 07dmehus commented on pull request 03#3926: Set WebChat to default to Libera - 13https://git.io/JZpJK [20:43:18] [02mw-config] 07Universal-Omega commented on pull request 03#3926: Set WebChat to default to Libera - 13https://git.io/JZpJh [20:44:22] paladox: ^ would I just run `UPDATE mw_settings SET s_settings = REPLACE(s_settings,'freenodeChat', 'LiberaChat');` [20:44:27] [02mw-config] 07dmehus commented on pull request 03#3926: Set WebChat to default to Libera - 13https://git.io/JZpUR [20:44:46] I guess [20:45:26] oh that would work I think, Universal_Omega. Is that the only variable that needs to be updated? [20:45:40] Yes. [20:45:49] ah, okay, seems to me then, too [20:50:05] !log UPDATE mw_settings SET s_settings = REPLACE(s_settings,'freenodeChat', 'LiberaChat'); [20:50:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:50:52] [02mw-config] 07Universal-Omega edited pull request 03#3926: Set WebChat to default to Libera; Remove freenodeChat support - 13https://git.io/JGY3k [20:51:37] [02mw-config] 07Universal-Omega edited pull request 03#3926: Set WebChat to default to Libera; remove freenodeChat support - 13https://git.io/JGY3k [20:51:43] [02mw-config] 07Universal-Omega edited pull request 03#3926: Set WebChat to default to Libera; remove freenodeChat - 13https://git.io/JGY3k [20:51:51] [02mw-config] 07Universal-Omega closed pull request 03#3926: Set WebChat to default to Libera; remove freenodeChat - 13https://git.io/JGY3k [20:51:53] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JZpIR [20:51:54] [02miraheze/mw-config] 07Universal-Omega 0301cf3ee - Set WebChat to default to Libera; remove freenodeChat (#3926) [20:51:56] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [20:51:57] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbvb3 [20:52:31] RECOVERY - test3 Puppet on test3 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [20:52:50]