[00:00:02] https://lakehub.ga/wiki/Special:CargoTables damn, this again [00:00:07] [url] Permission error - Lakehub | lakehub.ga [00:00:45] I don't know why this happens specifically for the list of tables. The page with the tables aren't affected [00:02:09] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:05:01] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.94, 8.29, 6.21 [00:05:09] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 15.75, 10.32, 7.15 [00:07:32] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.82, 6.76, 5.74 [00:08:05] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 11.19, 7.97, 6.14 [00:09:33] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.17, 7.40, 6.11 [00:10:05] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.21, 7.73, 6.29 [00:11:32] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.36, 7.02, 6.13 [00:12:05] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.86, 6.64, 6.06 [00:12:52] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.27, 7.84, 6.88 [00:15:05] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.98, 7.43, 7.06 [00:18:47] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.97, 6.62, 6.66 [00:19:05] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.94, 7.30, 7.02 [00:19:32] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.98, 6.60, 6.34 [00:21:05] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.83, 7.47, 7.12 [00:25:32] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.26, 6.67, 6.40 [00:27:05] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.77, 5.99, 6.60 [00:27:31] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.66, 6.12, 6.22 [00:32:09] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:41:57] Created https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Comments/+/702786 [02:00:27] and https://gerrit.wikimedia.org/r/c/mediawiki/extensions/ArticleToCategory2/+/702789 [02:09:44] Voidwalker: great, thanks! [02:11:52] Universal_Omega, are you aware of any way to silence (or limit) the deprecation errors? There should be a specific deprecation channel for these messages (according to the monolog config), but this doesn't seem to be the case [02:13:52] !log deleted oldest two graylog indexes due to exhaustion of disk space [02:13:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:14:14] RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 84965 MB (11% inode=99%); [02:46:07] doesn't seem to be. maybe if we hack monolog to limit any errors with MWDebug::sendRawDeprecated [02:53:27] Voidwalker: I will look tomorrow. [02:56:04] Might also just disable all deprecation warnings for mediawiki 1.35+, as many of these are entirely outside our control [02:58:44] A good chunk of these deprecated hooks also have no replacement/migration path, which means most of them can't be updated, at least until the authors know more [03:09:47] [02miraheze/mw-config] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JclM4 [03:09:48] [02miraheze/mw-config] 07The-Voidwalker 03f284542 - disable logging of T263581 [03:10:40] miraheze/mw-config - The-Voidwalker the build passed. [03:10:54] that'll help, over half of our mediawiki debug log is that channel :P [03:12:25] another 60k are from mediawiki 1.35 deprecation notices that are either pending a fix, or might not be able to be fixed [05:32:16] PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 78697 MB (10% inode=99%); [05:38:14] RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 79208 MB (11% inode=99%); [06:32:40] I will be mostly AFK for the next couple of days. [06:33:42] Np, exams finish at 1pm so I'll be back after my dentist appointment to normal [06:36:45] RhinosF1: sounds good, thanks! If I'm needed just ping and I'll be on but unless it's an emergency I'll be away through the weekend. [06:36:56] Ack [06:37:19] I'm extremely surprised with how calm this week has been [06:38:06] In real life [06:38:25] I was expecting it to be a lot crazier and stressed which is why I said I wouldn't be around [06:38:51] Oh that's good then! [06:40:56] I'm still not dropping my guard. I know certain things are at breaking point. It's just a much less bad time for things to go wrong once we're past 1pm today [06:41:38] It's kind of the same covid approach the gov use, make the peak of the issues happen at the point where it's easiest to cope and be as low as possible [07:06:14] PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 78457 MB (10% inode=99%); [07:30:14] RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 79147 MB (11% inode=99%); [07:40:14] PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 78709 MB (10% inode=99%); [08:28:15] RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 78827 MB (11% inode=99%); [08:32:14] PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 78659 MB (10% inode=99%); [12:11:51] PROBLEM - cp13 Current Load on cp13 is WARNING: WARNING - load average: 1.47, 1.86, 1.24 [12:13:51] RECOVERY - cp13 Current Load on cp13 is OK: OK - load average: 0.62, 1.42, 1.15 [13:33:46] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.48, 6.57, 4.91 [13:35:46] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.98, 6.08, 4.95 [14:04:30] PROBLEM - beaconspace.unrestrictedlorefare.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for beaconspace.unrestrictedlorefare.com could not be found [14:04:35] PROBLEM - www.pornwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.pornwiki.org could not be found [14:04:40] PROBLEM - www.permanentfuturelab.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.permanentfuturelab.wiki could not be found [14:04:40] PROBLEM - icclopedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for icclopedia.org could not be found [14:04:47] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.21, 6.75, 5.81 [14:05:00] PROBLEM - wiki.thunis.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.thunis.eu could not be found [14:06:45] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.12, 5.75, 5.56 [14:11:17] RECOVERY - beaconspace.unrestrictedlorefare.com - reverse DNS on sslhost is OK: rDNS OK - beaconspace.unrestrictedlorefare.com reverse DNS resolves to cp13.miraheze.org [14:11:25] RECOVERY - www.pornwiki.org - reverse DNS on sslhost is OK: rDNS OK - www.pornwiki.org reverse DNS resolves to cp13.miraheze.org [14:11:36] RECOVERY - www.permanentfuturelab.wiki - reverse DNS on sslhost is OK: rDNS OK - www.permanentfuturelab.wiki reverse DNS resolves to cp13.miraheze.org [14:11:38] RECOVERY - icclopedia.org - reverse DNS on sslhost is OK: rDNS OK - icclopedia.org reverse DNS resolves to cp13.miraheze.org [14:11:58] RECOVERY - wiki.thunis.eu - reverse DNS on sslhost is OK: rDNS OK - wiki.thunis.eu reverse DNS resolves to cp13.miraheze.org [14:36:49] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.65, 6.90, 5.47 [14:38:10] We have users in Antarctica [14:39:32] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.42, 6.51, 5.34 [14:40:06] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.13, 6.91, 5.51 [14:40:48] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.79, 6.45, 5.66 [14:41:31] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.14, 5.41, 5.07 [14:42:04] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.37, 6.27, 5.43 [14:44:47] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.99, 7.67, 6.26 [14:46:47] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.51, 7.19, 6.27 [14:50:25] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.31, 7.37, 6.16 [14:50:52] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.85, 7.65, 6.44 [14:52:20] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.16, 6.69, 6.06 [14:52:47] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.34, 5.93, 6.08 [14:52:51] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.29, 6.10, 6.02 [15:14:31] would be possible to add the "Some rights reserved" license to ManageWiki? [15:21:09] Well, that's not a license [15:21:45] You'd need to say what rights are reserved [15:27:09] "wikitext" content is not allowed on page Mainpage-description in slot "Main" What is that even supposed to mean? [15:27:54] NVM. [15:27:58] I figured it out. [15:56:04] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 12.31, 7.70, 6.11 [15:56:23] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.30, 6.74, 5.90 [15:56:24] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 10.60, 7.79, 6.31 [15:56:32] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 11.52, 8.12, 6.49 [15:58:19] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.22, 7.63, 6.44 [15:58:22] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.92, 6.69, 5.98 [15:58:29] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.35, 7.49, 6.46 [16:00:04] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.27, 7.59, 6.44 [16:00:20] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.18, 5.98, 5.80 [16:02:04] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.06, 6.64, 6.24 [16:02:24] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.49, 6.55, 6.31 [16:06:02] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.33, 6.63, 6.42 [18:53:01] PROBLEM - spiral.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for spiral.wiki could not be found [18:53:05] PROBLEM - franchise.franchising.org.ua - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for franchise.franchising.org.ua could not be found [18:53:08] PROBLEM - wiki.valkyrienskies.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.valkyrienskies.org could not be found [18:53:08] PROBLEM - dcmultiverse.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dcmultiverse.miraheze.org could not be found [18:53:08] PROBLEM - iceria.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for iceria.org could not be found [18:53:09] PROBLEM - iesd.mobagenie.my.id - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for iesd.mobagenie.my.id could not be found [18:53:09] PROBLEM - wiki.landev.vn - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.landev.vn could not be found [18:53:13] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.87, 19.11, 15.07 [18:53:14] PROBLEM - wikibeats.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikibeats.net could not be found [18:53:18] PROBLEM - sportsanalytics.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sportsanalytics.wiki could not be found [18:53:21] PROBLEM - ecole.science - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ecole.science could not be found [18:53:46] PROBLEM - linkwiki.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for linkwiki.cf could not be found [18:53:50] PROBLEM - parapedia.pl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for parapedia.pl could not be found [18:55:13] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 28.12, 21.16, 16.25 [18:57:13] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.10, 17.80, 15.61 [18:59:48] RECOVERY - wiki.valkyrienskies.org - reverse DNS on sslhost is OK: rDNS OK - wiki.valkyrienskies.org reverse DNS resolves to cp13.miraheze.org [18:59:49] RECOVERY - dcmultiverse.miraheze.org - reverse DNS on sslhost is OK: rDNS OK - dcmultiverse.miraheze.org reverse DNS resolves to cp13.miraheze.org [18:59:49] RECOVERY - iceria.org - reverse DNS on sslhost is OK: rDNS OK - iceria.org reverse DNS resolves to cp13.miraheze.org [18:59:51] RECOVERY - iesd.mobagenie.my.id - reverse DNS on sslhost is OK: rDNS OK - iesd.mobagenie.my.id reverse DNS resolves to cp13.miraheze.org [18:59:52] RECOVERY - wiki.landev.vn - reverse DNS on sslhost is OK: rDNS OK - wiki.landev.vn reverse DNS resolves to cp13.miraheze.org [18:59:57] RECOVERY - spiral.wiki - reverse DNS on sslhost is OK: rDNS OK - spiral.wiki reverse DNS resolves to cp13.miraheze.org [19:00:00] RECOVERY - wikibeats.net - reverse DNS on sslhost is OK: rDNS OK - wikibeats.net reverse DNS resolves to cp13.miraheze.org [19:00:05] RECOVERY - franchise.franchising.org.ua - reverse DNS on sslhost is OK: rDNS OK - franchise.franchising.org.ua reverse DNS resolves to cp13.miraheze.org [19:00:10] RECOVERY - sportsanalytics.wiki - reverse DNS on sslhost is OK: rDNS OK - sportsanalytics.wiki reverse DNS resolves to cp13.miraheze.org [19:00:16] RECOVERY - ecole.science - reverse DNS on sslhost is OK: rDNS OK - ecole.science reverse DNS resolves to cp13.miraheze.org [19:00:29] RECOVERY - parapedia.pl - reverse DNS on sslhost is OK: rDNS OK - parapedia.pl reverse DNS resolves to cp13.miraheze.org [19:00:42] RECOVERY - linkwiki.cf - reverse DNS on sslhost is OK: rDNS OK - linkwiki.cf reverse DNS resolves to cp13.miraheze.org [20:41:52] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 10.99, 8.97, 6.30 [20:43:05] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.59, 7.12, 5.82 [20:45:05] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.02, 6.00, 5.57 [20:45:48] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.71, 7.15, 6.17 [20:47:46] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.73, 6.01, 5.87 [21:30:34] [02puppet] 07RhinosF1 opened pull request 03#1801: mwscript: note logging is for end - pass return code - 13https://git.io/Jc0Rr [21:30:43] Reception123: ^ [21:36:01] Think he's sleeping RhinosF1. [21:36:02] https://phabricator.miraheze.org/T7522#152221 It will not work Universal_Omega [21:36:03] [url] ⚓ T7522 Drop the database of ucronias.miraheze.org and hispano76.miraheze.org | phabricator.miraheze.org [21:36:31] It would be simpler to delete the wiki.... [21:41:32] Hispano76: it wouldn't be simpler. I will look later. I'm AFK this weekend but if someone else wants to, just content models needs inserted into the database. [21:44:10] ajam [21:47:34] Hispano76: sorry about this. In the past there were issues with wiki recreation. But I recently did a patch to CreateWiki to hopefully fix this next time, but resetting again still won't be easier then running two sql commands to insert the correct content models. But like I said I'm AFK this weekend but if someone else is available to they can then. [21:49:48] ajam [21:51:46] and create new items will have the correct model Universal_Omega [21:52:52] Hispano76: they do? Or are saying that don't but making sure they will when that's done? If you mean will they, then yes. [21:53:23] hum, check [21:55:16] https://ucronias.miraheze.org/wiki/Item:Q2 interesting [21:55:17] [url] historia alternativa - Ucronías | ucronias.miraheze.org [21:56:42] Hispano76: oh in that case it is more complicated then I thought. [21:58:49] Hispano76: you may have to recreate them (the properties). I don't see how we can fix it simply then. But I can look if no one else does after the weekend. [21:59:12] Somehow content models are messed up further then I thought. [21:59:58] Or maybe just the property content model is messed up not the item one. [22:39:33] Voidwalker: https://git.io/Jc0Rr [22:39:59] * RhinosF1 is writing tests [23:15:17] !log [rhinos@jobrunner3] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=terrariawiki /home/rhinos/terraria_gamepedia_pages_full.xml --username-prefix wikia [23:15:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:35] PROBLEM - graylog2 Current Load on graylog2 is CRITICAL: CRITICAL - load average: 7.17, 4.32, 2.16 [23:35:35] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 1.74, 3.27, 2.27