[00:02:26] PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Puppet has 28 failures. Last run 2 minutes ago with 28 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg],File[/usr/local/bin/puppet-enabled],File[authority certificates],File[/etc/apt/apt.conf.d/50unattended-upgrades] [00:03:15] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 40.54, 24.59, 22.13 [00:03:45] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.16, 5.99, 4.90 [00:05:45] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.98, 5.10, 4.69 [00:06:49] PROBLEM - graylog2 Current Load on graylog2 is WARNING: WARNING - load average: 3.82, 2.97, 2.00 [00:07:15] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.61, 22.32, 21.81 [00:08:49] RECOVERY - graylog2 Current Load on graylog2 is OK: OK - load average: 3.23, 3.11, 2.18 [00:09:15] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 28.51, 25.03, 22.88 [00:11:45] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 11.99, 7.21, 5.51 [00:32:26] RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:43:45] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.36, 4.41, 5.70 [00:47:15] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 13.13, 17.54, 23.82 [00:49:45] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.13, 3.69, 4.92 [00:51:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.57, 3.36, 2.99 [00:53:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.26, 3.06, 2.93 [00:55:15] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 27.16, 20.66, 22.46 [00:57:15] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 17.49, 18.54, 21.43 [00:59:15] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 11.24, 15.90, 20.12 [01:01:08] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.75, 3.43, 3.10 [01:03:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.19, 3.58, 3.19 [01:05:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.79, 3.29, 3.13 [01:21:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.46, 3.33, 3.18 [01:25:08] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.57, 3.14, 3.15 [01:35:59] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.06, 3.63, 3.31 [01:39:51] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.46, 3.72, 3.43 [01:41:47] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.54, 3.28, 3.30 [02:20:34] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.23, 3.34, 3.08 [02:22:31] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.93, 3.04, 2.99 [03:01:31] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.98, 3.57, 3.33 [03:03:27] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.01, 3.38, 3.30 [03:07:22] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.23, 3.42, 3.34 [03:09:18] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.02, 3.36, 3.33 [03:16:08] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.22, 3.50, 3.42 [03:20:01] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.26, 3.34, 3.36 [03:23:55] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.31, 3.56, 3.46 [03:31:39] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.46, 3.08, 3.32 [03:51:27] SRE, 503 backend fetch error on `metawiki` [03:51:50] seems to be resolved [03:55:31] dmehus: for some reason there seems to be reoccurring issues with this. At least one report of something like that every day, it seems. [03:56:04] CosmicAlpha, yep [03:56:24] I made a task for SRE to investigate possible causes and potential solutions over the next few weeks hopefully [04:09:36] PROBLEM - nocyclo.tk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'nocyclo.tk' expires in 15 day(s) (Wed 17 Nov 2021 04:05:10 GMT +0000). [04:12:38] PROBLEM - incubator.nocyclo.tk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'incubator.nocyclo.tk' expires in 15 day(s) (Wed 17 Nov 2021 04:06:46 GMT +0000). [04:18:26] dmehus: replied to your ManageWiki task. I know the issue, and a possible solution but I prefer to hear the reasoning behind the current behaviour from John to verify it is not intentional, as I'm not sure that would with 100% certainty it was a mistake. [04:19:19] I just would like to make sure it was a mistake, as it doesn't seem like something that would be made a mistake, it seems intentional to me. But I don't know for sure. [04:31:32] CosmicAlpha, looking [04:31:42] yeah I figured you would likely know how to fix it immediately [04:31:45] so that's good :) [04:37:52] [02ssl] 07revi opened pull request 03#437: Remove reviwiki from the SSL - 13https://git.io/JPKOR [04:39:32] [02ssl] 07dmehus commented on pull request 03#437: Remove reviwiki from the SSL - 13https://git.io/JPKOh [04:40:34] TIL... when you get mentioned your username is displayed in the bright yellow uh https://usercontent.irccloud-cdn.com/file/77y0LmNQ/image.png [04:43:04] [02ssl] 07Universal-Omega commented on pull request 03#437: Remove reviwiki from the SSL - 13https://git.io/JPK39 [04:45:10] dmehus: yeah, a very simple one line to-be-removed fix, but I want to talk with John for reason of how it is now first. [04:48:27] revi: does that domain need removed from ManageWiki? [04:48:47] Wiki has been already deleted [04:48:59] Oh. [04:49:08] so there is no more ManageWiki to manage [04:49:38] was dealing with my email filter while the host under DDOS [04:49:44] let me read the comment..... [04:51:32] revi, yeah I think I did see that. It's a bit subtle, though, the pale yellow highlighting of one's name in GitHub mentions [04:51:50] CosmicAlpha, SGTM [04:53:50] [02mediawiki] 07Universal-Omega closed pull request 03#3943: Bump extensions/ManageWiki from `781223e` to `9386730` - 13https://git.io/JPonn [04:53:52] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/ManageWiki-9386730 - 13https://git.io/vbL5b [04:53:53] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/ManageWiki-9386730 [04:53:55] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JPKZq [04:53:56] [02miraheze/mediawiki] 07dependabot[bot] 03c6fc016 - Bump extensions/ManageWiki from `781223e` to `9386730` (#3943) [04:54:15] [02mediawiki] 07Universal-Omega closed pull request 03#3892: Bump extensions/ManageWiki from `781223e` to `9386730` - 13https://git.io/JPosS [04:54:17] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/ManageWiki-9386730 [04:54:18] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/ManageWiki-9386730 - 13https://git.io/vbL5b [04:54:20] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JPKZc [04:54:21] [02miraheze/mediawiki] 07dependabot[bot] 03f01115e - Bump extensions/ManageWiki from `781223e` to `9386730` (#3892) [04:54:32] [02mediawiki] 07Universal-Omega closed pull request 03#3963: Bump extensions/DataDump from `47e8db4` to `87f48f8` - 13https://git.io/JPocT [04:54:33] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JPKZR [04:54:35] [02miraheze/mediawiki] 07dependabot[bot] 035fe7aeb - Bump extensions/DataDump from `47e8db4` to `87f48f8` (#3963) [04:54:36] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/DataDump-87f48f8 - 13https://git.io/vbL5b [04:54:38] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/DataDump-87f48f8 [04:54:41] [02mediawiki] 07Universal-Omega closed pull request 03#3896: Bump extensions/DataDump from `47e8db4` to `87f48f8` - 13https://git.io/JPosx [04:54:43] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/DataDump-87f48f8 - 13https://git.io/vbL5b [04:54:44] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JPKZu [04:54:46] [02miraheze/mediawiki] 07dependabot[bot] 033c130fc - Bump extensions/DataDump from `47e8db4` to `87f48f8` (#3896) [04:54:47] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/DataDump-87f48f8 [04:55:59] [02mediawiki] 07Universal-Omega closed pull request 03#3944: Bump extensions/CreateWiki from `140af93` to `d7241ec` - 13https://git.io/JPonC [04:56:01] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JPKZS [04:56:02] [02miraheze/mediawiki] 07dependabot[bot] 03ba8d7d0 - Bump extensions/CreateWiki from `140af93` to `d7241ec` (#3944) [04:56:04] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/CreateWiki-d7241ec [04:56:05] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/CreateWiki-d7241ec - 13https://git.io/vbL5b [04:56:16] [02mediawiki] 07Universal-Omega closed pull request 03#3911: Bump extensions/CreateWiki from `140af93` to `d7241ec` - 13https://git.io/JPoGE [04:56:17] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JPKZ5 [04:56:19] [02miraheze/mediawiki] 07dependabot[bot] 034bbfa71 - Bump extensions/CreateWiki from `140af93` to `d7241ec` (#3911) [04:56:20] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/CreateWiki-d7241ec - 13https://git.io/vbL5b [04:56:22] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/CreateWiki-d7241ec [05:07:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.43, 3.52, 3.11 [05:09:08] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.04, 3.10, 3.02 [06:19:58] RECOVERY - cp14 APT on cp14 is OK: APT OK: 14 packages available for upgrade (0 critical updates). [06:33:08] [02miraheze/ssl] 07Reception123 pushed 032 commits to 03master [+2/-0/±2] 13https://git.io/JPK1J [06:33:09] [02miraheze/ssl] 07Reception123 03cdeea66 - add wiki.sanctuary-rts.com cert [06:33:11] [02miraheze/ssl] 07Reception123 03bda2269 - add data.memipedia.ga cert [06:39:21] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 9.17, 7.13, 6.19 [06:43:13] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 6.97, 7.60, 6.63 [06:46:20] [02mediawiki] 07Universal-Omega closed pull request 03#3959: Bump extensions/MirahezeMagic from `5ab1c2e` to `4c4eac3` - 13https://git.io/JPonx [06:46:21] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/MirahezeMagic-4c4eac3 [06:46:23] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/MirahezeMagic-4c4eac3 - 13https://git.io/vbL5b [06:46:24] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JPKD5 [06:46:26] [02miraheze/mediawiki] 07dependabot[bot] 03cfbade2 - Bump extensions/MirahezeMagic from `5ab1c2e` to `4c4eac3` (#3959) [06:46:31] [02mediawiki] 07Universal-Omega closed pull request 03#3916: Bump extensions/MirahezeMagic from `5ab1c2e` to `4c4eac3` - 13https://git.io/JPoGK [06:46:33] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JPKDF [06:46:34] [02miraheze/mediawiki] 07dependabot[bot] 03ea8a841 - Bump extensions/MirahezeMagic from `5ab1c2e` to `4c4eac3` (#3916) [06:46:36] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-4c4eac3 [06:46:37] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-4c4eac3 - 13https://git.io/vbL5b [06:46:50] !log [universalomega@mw11] starting deploy of {'world': True, 'l10n': True} to all [06:46:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:47:04] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 9.10, 7.64, 6.82 [06:47:17] !log [universalomega@test3] starting deploy of {'world': True, 'l10n': True} to skip [06:47:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:50:55] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 5.89, 6.91, 6.71 [06:54:44] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.01, 6.19, 6.48 [06:58:05] !log [universalomega@test3] finished deploy of {'world': True, 'l10n': True} to skip - SUCCESS in 647s [06:58:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:59:36] !log [reception@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=actiontaimaninwiki /home/reception/actiontaimanin_pages_full.xml --username-prefix wikia:action-taimanin --report 1 (END - exit=0) [06:59:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:01:27] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://git.io/JPKHT [07:01:28] [02miraheze/MirahezeMagic] 07Universal-Omega 03bc0c148 - mention #miraheze-sre for `dberr-again` message override [07:01:30] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://git.io/fQRGX [07:01:32] [02MirahezeMagic] 07Universal-Omega opened pull request 03#302: mention #miraheze-sre for `dberr-again` message override - 13https://git.io/JPKHL [07:02:28] miraheze/MirahezeMagic - Universal-Omega the build passed. [07:03:31] !log [universalomega@mw11] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 1001s [07:03:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:59:39] [02CreateWiki] 07Universal-Omega closed pull request 03#254: CWJ: add experimental to dblists - 13https://git.io/JiWbw [07:59:43] [02CreateWiki] 07Universal-Omega deleted branch 03RhinosF1-patch-1 - 13https://git.io/vpJTL [07:59:44] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03RhinosF1-patch-1 [08:19:21] PROBLEM - cp14 Current Load on cp14 is CRITICAL: CRITICAL - load average: 2.36, 2.30, 1.29 [08:19:25] PROBLEM - db13 APT on db13 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [08:21:21] RECOVERY - cp14 Current Load on cp14 is OK: OK - load average: 0.40, 1.58, 1.15 [08:21:21] RECOVERY - db13 APT on db13 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [08:21:31] PROBLEM - db13 Current Load on db13 is CRITICAL: CRITICAL - load average: 11.21, 10.07, 6.29 [08:23:31] PROBLEM - db13 Current Load on db13 is WARNING: WARNING - load average: 3.16, 7.32, 5.74 [08:25:31] RECOVERY - db13 Current Load on db13 is OK: OK - load average: 1.55, 5.25, 5.16 [09:52:39] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JP6Bt [09:52:40] [02miraheze/ManageWiki] 07Universal-Omega 036b61dac - T8234: allow (un)locking and (un)deleting actions in combination with others [09:52:42] [02ManageWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vpSns [09:52:54] [02ManageWiki] 07Universal-Omega opened pull request 03#314: T8234: allow (un)locking and (un)deleting actions in combination with others - 13https://git.io/JP6BY [09:59:34] miraheze/ManageWiki - Universal-Omega the build passed. [10:18:07] PROBLEM - duepedia.uk.to - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'duepedia.uk.to' expires in 7 day(s) (Tue 09 Nov 2021 10:14:23 GMT +0000). [10:26:12] [02ssl] 07revi synchronize pull request 03#437: Remove reviwiki from the SSL - 13https://git.io/JPKOR [10:28:01] [02ssl] 07revi commented on pull request 03#437: Remove reviwiki from the SSL - 13https://git.io/JP6VI [10:34:41] CosmicAlpha Good morning sir, In regards to the Wikibase Config, I think the way Wikibase was configured on miraheze is in a way that miraheze.org is just like wikipedia.org or wikinews.org, While famepedia.miraheze.org, memes.miraheze.org, allthetropes.miraheze.org etc, is just like es.wikipedia.org, ha.wikipedia.org, en.wikipedia.org, So all subdomains of Miraheze.org seem to be like all subdomains of Wikipedia.org. I have no [10:34:41] idea why it was configured like that on Miraheze though, cuz that's the only reason why otherprojectsLink would be appearing under the Otherlanguages section. [10:53:26] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.89, 3.25, 2.86 [10:55:23] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.29, 2.89, 2.77 [12:08:32] [02miraheze/GlobalNewFiles] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JP6hN [12:08:33] [02miraheze/GlobalNewFiles] 07translatewiki 03bf4f809 - Localisation updates from https://translatewiki.net. [12:08:34] [url] Main page - translatewiki.net | translatewiki.net [12:08:35] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±7] 13https://git.io/JP6hx [12:08:36] [02miraheze/ManageWiki] 07translatewiki 030b694f1 - Localisation updates from https://translatewiki.net. [12:08:37] [url] Main page - translatewiki.net | translatewiki.net [12:08:38] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/JP6hp [12:08:39] [02miraheze/MirahezeMagic] 07translatewiki 038560a47 - Localisation updates from https://translatewiki.net. [12:08:40] [url] Main page - translatewiki.net | translatewiki.net [12:09:35] miraheze/MirahezeMagic - translatewiki the build passed. [12:11:18] miraheze/GlobalNewFiles - translatewiki the build passed. [12:14:52] miraheze/ManageWiki - translatewiki the build passed. [12:36:31] PROBLEM - ethene.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ethene.wiki' expires in 15 day(s) (Wed 17 Nov 2021 12:33:50 GMT +0000). [12:42:37] PROBLEM - www.ethene.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ethene.wiki' expires in 15 day(s) (Wed 17 Nov 2021 12:33:50 GMT +0000). [13:55:51] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.87, 3.28, 2.90 [13:59:45] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.28, 3.01, 2.90 [14:38:51] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.16, 2.92 [14:40:51] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.12, 2.84, 2.84 [14:52:32] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.52, 3.16, 3.00 [14:54:29] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.01, 3.17, 3.03 [15:12:55] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.41, 3.54, 3.18 [15:14:51] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.65, 3.26, 3.13 [15:18:51] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.49, 3.63, 3.33 [15:22:51] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.38, 3.08, 3.20 [15:26:51] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.06, 3.48, 3.31 [15:28:51] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.13, 3.44, 3.32 [15:30:51] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.02, 3.46, 3.33 [15:32:51] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.26, 3.46, 3.35 [15:34:51] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.27, 3.03, 3.20 [16:25:41] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.35, 3.30, 2.74 [16:27:38] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.77, 3.37, 2.83 [16:31:32] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.95, 3.12, 2.86 [16:36:50] PROBLEM - wiki.fbpml.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.fbpml.org All nameservers failed to answer the query. [16:39:17] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.57, 3.46, 3.08 [16:41:14] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.14, 3.14, 3.02 [16:41:31] PROBLEM - wiki.fbpml.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:44:18] PROBLEM - wiki.fbpml.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns3.hostnetbv.nl.', 'ns2.hostnetbv.com.', 'ns1.hostnet.nl.'], 'CNAME': 'fbpml.miraheze.org.'} [16:48:28] RECOVERY - wiki.fbpml.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.fbpml.org' will expire on Wed 24 Nov 2021 06:24:05 GMT +0000. [17:05:30] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 12.11, 7.86, 5.52 [17:07:04] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 30.02, 15.96, 8.76 [17:08:59] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 5.24, 8.14, 6.05 [17:10:59] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 2.72, 6.23, 5.60 [17:12:58] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.14, 7.40, 7.10 [17:13:25] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.60, 6.60, 6.66 [17:14:56] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.61, 6.49, 6.80 [17:22:50] [02mediawiki] 07Universal-Omega closed pull request 03#3890: Bump skins/Evelution from `4bae117` to `2a9e7ca` - 13https://git.io/JPos1 [17:22:52] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/Evelution-2a9e7ca [17:22:53] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JPPgt [17:22:55] [02miraheze/mediawiki] 07dependabot[bot] 0353031ec - Bump skins/Evelution from `4bae117` to `2a9e7ca` (#3890) [17:22:56] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_36/skins/Evelution-2a9e7ca - 13https://git.io/vbL5b [17:23:07] [02mediawiki] 07Universal-Omega closed pull request 03#3967: Bump skins/Evelution from `4bae117` to `2a9e7ca` - 13https://git.io/JPoc3 [17:23:08] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JPPgO [17:23:10] [02miraheze/mediawiki] 07dependabot[bot] 03e16d532 - Bump skins/Evelution from `4bae117` to `2a9e7ca` (#3967) [17:23:12] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/Evelution-2a9e7ca [17:23:13] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/Evelution-2a9e7ca - 13https://git.io/vbL5b [17:29:27] [02MirahezeMagic] 07Universal-Omega closed pull request 03#302: mention #miraheze-sre for `dberr-again` message override - 13https://git.io/JPKHL [17:29:28] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JPP2y [17:29:30] [02miraheze/MirahezeMagic] 07Universal-Omega 03145b68c - mention #miraheze-sre for `dberr-again` message override (#302) [17:29:31] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [17:29:32] [02MirahezeMagic] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://git.io/fQRGX [17:30:35] miraheze/MirahezeMagic - Universal-Omega the build passed. [17:40:32] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JPPVX [17:40:33] [02miraheze/CreateWiki] 07Universal-Omega 039cdf974 - Use settings log if there are more than one change [17:40:35] [02CreateWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/vpJTL [17:40:36] [02CreateWiki] 07Universal-Omega opened pull request 03#255: Use settings log if there are more than one change - 13https://git.io/JPPVM [17:45:46] Joseph: I'm confused what you mean. Even on Wikimedia they don't have subdomains, only domains. How come this won't work for you to manually add the links to the sidebar from MediaWiki:Sidebar? [17:47:53] I doubt if you understood what I wrote :p [17:48:13] miraheze/CreateWiki - Universal-Omega the build passed. [17:49:07] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.13, 3.33, 3.07 [17:49:33] CosmicAlpha If this wikibase stuff was configured the way it is in Wikimedia, then we wouldn't be having this very issue [17:50:34] Joseph: we are not wikimedia. It is not possible for us to configure everything the way they do. [17:50:59] That's exactly what I am explaining [17:51:04] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.28, 2.96, 2.97 [17:52:43] It's just like saying because we're not Wikimedia then our Visual Editor shouldn't be able to do Citations, no I believe there are some configs that should be default [17:53:44] As we speak, otherProjectsLink and otherLanguages are conflicting and that's why they both appear under one tab. [17:55:55] Joseph: I'm extremely confused then.... with wikibase otherprojectlinks, even on Wikimedia it does not work with subdomains. And even there they appear above otherLanguages, as they do on famepediawiki. [18:00:53] There's really nothing to be confused about, lol, dmm But really, I am unsure that's how it works on Wikimedia Because they have two and one is otherProjectsLink which is visibly In other projects while they have otherLanguages which is In Wikipedia So as far as this is concerned, Other projects aren't conflicting or displaying under otherLanguages because it's the Languages of Wikipedia that displays under Other Languages [18:00:53] (In Wikipedia). [18:09:30] Joseph: the sidebar looks the same on Wikipedia as it does on FAMEPedia (or at least order). Other projects, then Other languages under it. [18:09:57] Although your otherLanguages menu is titled from FAMEPedia. [18:10:09] Or in FAMEPedia [18:10:30] Because you changed https://en.famepedia.org/wiki/MediaWiki:Otherlanguages [18:10:38] [url] MediaWiki:Otherlanguages - FAMEPedia | en.famepedia.org [18:10:47] Yes, I titled that, because other languages is supposed to be In FAMEPedia [18:11:02] And it does appear... [18:11:10] The order isn't what the issue is right now [18:12:08] The issue is the that appears in all projects, instead of the siteID [18:12:41] Like or allthetropes [18:12:43] And co [18:12:54] Or even commons [18:14:57] Well nothing is conflicting with otherLanguages... so what is the problem? Because you've been saying that it was conflicting. It isn't. The way you want to do it. Is absolutely not how otherProjectLinks work, not even on Wikimedia. It does not work with subdomains only domains. Miraheze group is miraheze, so it would only be wikibase-otherprojects-miraheze as that's the group. Just as wikipedia as a whole is a group on [18:14:58] Wikimedia so only -wikipedia is used in i18n, not -enwikipedia. [18:23:58] CosmicAlpha you take a look at this sidebar and observe https://famedata.org/m/6eQ See what I mean by they're conflicting The 4 wikis that were added to the AN item on famedata appears under English (ps: that tab is supposed to be In FAMEPedia not in other projects) At the top of it you'd find the proper in other projects which has all through the 4 projects That's absolutely wrong, they [18:23:58] shouldn't appear like that because if I should create that message with Miraheze, all 4 of these projects will be displaying Miraheze` all through INSTEAD of their various names (meta,commons,FAMEPedia) and the rest [18:23:59] [url] FAMEData:Administrators' noticeboard - FAMEData | famedata.org [18:29:56] Even, that being said, the projects that appears under Other projects shouldn't appear under the Interlanguagelinks sections In fact, the only project that should appear under otherLanguages are wikis that appears under Interlanguagelinks section of the wiki's interwiki table. [18:30:33] This is very clear [19:02:47] In fact, let me say this more simpler, The only links that should show up in the Other Languages are Interlanguagelinks on the interwiki table, while the links added to the item are the once the one that are to show up in other projects. So until we have a Spanish or German FAMEPedia, and by so doing have a sitegroup for FAMEPedia, links that should show up on other projects should be the one's added in the FAMEData item of that [19:02:48] page. [19:23:39] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.80, 3.48, 3.18 [19:25:36] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.25, 3.10, 3.08 [19:51:51] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.53, 3.83, 3.35 [19:53:48] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.49, 3.89, 3.44 [19:57:42] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.80, 3.26, 3.28 [20:03:29] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.33, 3.46, 3.38 [20:15:10] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.70, 3.19, 3.36 [20:28:36] Joseph: this is intentional behaviour. Miraheze is the site group, so miraheze is the message. As for otherLanguages, it seems like you configured that. https://famedata.org/wiki/Q414#sitelinks-miraheze [20:28:37] [url] FAMEPedia:Administrators' noticeboard - FAMEData | famedata.org [20:31:43] PROBLEM - privacy-wiki.0x.no - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'privacy-wiki.0x.no' expires in 15 day(s) (Wed 17 Nov 2021 20:28:02 GMT +0000). [20:32:13] PROBLEM - pornwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pornwiki.org' expires in 15 day(s) (Wed 17 Nov 2021 20:28:35 GMT +0000). [20:32:28] CosmicAlpha why do we now have https://www.wikidata.org/w/index.php?title=MediaWiki:Wikibase-otherprojects-meta when there's no Meta sitegroup on Wikidata?.... [20:32:29] [url] MediaWiki:Wikibase-otherprojects-meta - Wikidata | www.wikidata.org [20:32:41] PROBLEM - worldsanskrit.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'worldsanskrit.net' expires in 15 day(s) (Wed 17 Nov 2021 20:27:45 GMT +0000). [20:34:36] PROBLEM - ref.undu.st - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ref.undu.st' expires in 15 day(s) (Wed 17 Nov 2021 20:28:20 GMT +0000). [20:35:33] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.54, 3.46, 3.30 [20:35:42] PROBLEM - orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:35:53] PROBLEM - www.fossilfighterswiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.fossilfighterswiki.com' expires in 15 day(s) (Wed 17 Nov 2021 20:27:16 GMT +0000). [20:36:31] Joseph: oh I have an idea then. [20:37:01] PROBLEM - poserdazfreebies.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:37:03] We're talking about Individual site now not the GROUP. [20:37:30] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.12, 3.39, 3.30 [20:37:44] PROBLEM - meta.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:37:56] PROBLEM - miraheze.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'miraheze.com' expires in 15 day(s) (Wed 17 Nov 2021 20:33:31 GMT +0000). [20:38:57] PROBLEM - allthetropes.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:39:22] PROBLEM - isv.orain.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'orain.org' expires in 15 day(s) (Wed 17 Nov 2021 20:31:21 GMT +0000). [20:41:23] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.75, 4.20, 3.66 [20:42:48] Joseph: they do use groups even for that but with the usage of SpecialSiteLinkGroups which we may be able to use. [20:43:19] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.76, 3.86, 3.60 [20:43:52] CosmicAlpha, I think I saw that on the wikimedia gerrit, was just wondering though [20:44:19] Plus I also shared the link formerly, maybe you didn't geto see something like that there [20:47:13] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.13, 3.20, 3.36 [20:51:04] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.79, 3.62, 3.51 [20:51:46] Joseph: it won't work with our current setup. "Must correspond to a value used to give the site group in the MediaWiki sites table." Which I don't think we have it setup to support any value but miraheze though https://github.com/miraheze/MirahezeMagic/pull/274 is designed to support others. [20:51:47] [url] T6045: Maintain default Wikimedia sites by Universal-Omega · Pull Request #274 · miraheze/MirahezeMagic · GitHub | github.com [20:54:29] (Beyond just wikimedia it should support special also) [20:54:57] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.63, 3.21, 3.38 [21:00:32] CosmicAlpha in the last sections of the Wikibase.php file we have this code(s) and much as I understand it, the code says for famepediawiki and famedatawiki, let $wgWBClientSettings['otherProjectsLinks'] be 'commonswiki', 'famedatawiki', 'famepediawiki', 'metawiki', Which is wrong if you ask me [21:00:32] https://cdn.discordapp.com/attachments/808001911868489748/904837334841831444/new_1.php [21:02:09] I think you need to revert that [21:02:31] And then change the i18n for in other languages to on other sites or something [21:02:36] @Joseph [21:04:45] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.07, 6.36, 4.91 [21:05:25] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.77, 7.41, 5.27 [21:06:43] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.54, 5.94, 4.93 [21:06:51] because for Wikibase Repository (eg. famedatawiki), configurations should start with $wgWBRepoSettings not $wgWBClientSettings cuz the $wgWBClientSettings should only be used for Wikibase Clients (eg. famepediawiki). So summarily, $wgWBRepoSettings should only be used for FAMEData and $wgWBClientSettings should only be used for FAMEPedia. [21:07:25] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.78, 5.98, 5.00 [21:07:42] RhinosF1 that might also help though, but I think if what I just mentioned is looked into and fixed, we'd know where we're standing [21:08:06] .gh miraheze/mw-config [21:08:06] https://github.com/miraheze/mw-config [21:08:36] Hang on [21:08:55] You've got repo on famepedia in config [21:09:24] I saw [21:09:32] I believe https://github.com/miraheze/mw-config/commit/e731638cdbaecc89a6955cb6fe3480712a8be3e2#diff-c6c37863eeece3e5220ca38c364f52e79ccd574c183f514ff6cae2f94012cc72 needs reverting though [21:09:32] [url] Set otherProjectsLinks for famepediawiki and famedatawiki (#4191) · miraheze/mw-config@e731638 · GitHub | github.com [21:09:38] and which I think is just invalid cuz it might now work [21:09:54] You've got in other languages that you can just change i18n string for [21:10:06] not* [21:10:21] Do you want all wikiba [21:10:34] Se config iff though [21:10:59] Or just other project links [21:12:37] necessary wikibase configs are normally needed, it's because that stuff isn't currently working that's why we're currently working on it I don't like backlogging SRE with wikibase stuff, it's better we do them step by step, one issue or config after the other. [21:14:35] What cha [21:14:42] Changes need making now [21:15:34] the Otherprojects ofc I keep sharing this link cuz I think something useful might be there https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Wikibase/+/132613/ [21:16:54] So revert the commit I said [21:17:56] Welp, I can not revert a commit? [21:17:57] lol [21:18:20] I can [21:18:30] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03revert-4191-Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JPXYS [21:18:31] [02miraheze/mw-config] 07RhinosF1 039f90587 - Revert "Set otherProjectsLinks for famepediawiki and famedatawiki (#4191)" [21:18:33] [02mw-config] 07RhinosF1 created branch 03revert-4191-Universal-Omega-patch-1 - 13https://git.io/vbvb3 [21:18:34] [02mw-config] 07RhinosF1 opened pull request 03#4197: Revert "Set otherProjectsLinks for famepediawiki and famedatawiki" - 13https://git.io/JPXYH [21:18:40] [02mw-config] 07RhinosF1 closed pull request 03#4197: Revert "Set otherProjectsLinks for famepediawiki and famedatawiki" - 13https://git.io/JPXYH [21:18:41] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JPXYF [21:18:42] [02miraheze/mw-config] 07RhinosF1 03df1d783 - Revert "Set otherProjectsLinks for famepediawiki and famedatawiki (#4191)" (#4197) [21:18:44] [02mw-config] 07RhinosF1 deleted branch 03revert-4191-Universal-Omega-patch-1 - 13https://git.io/vbvb3 [21:18:45] [02miraheze/mw-config] 07RhinosF1 deleted branch 03revert-4191-Universal-Omega-patch-1 [21:19:40] Pushed @Joseoh [21:19:40] miraheze/mw-config - RhinosF1 the build passed. [21:20:04] miraheze/mw-config - RhinosF1 the build passed. [21:26:11] RhinosF1 Wait, lol, The In other languages can not be changed to In other sites, or shouldn't be changed because let's say for example we have Spanish, German, Catalan and English famepedia.... they're supposed to appear under the In other languages based on the Interlanguage in the Interwiki table. Otherlanguage have no business with Other projects, i wonder why there're merging and dragging one tab. 😪 [21:26:46] But you have multiple sites there [21:27:05] Even if you have another language [21:27:12] It still won't be true [21:27:28] WikiBase is evil though [21:27:37] And Amir is no longer working on it [21:32:25] RhinosF1 take a look at how famepedia's MP looks https://en.famepedia.org/m/6RK You'd find that we have English under Languages which is correct But when you hover over the Miraheze, Miraheze Miraheze, and Miraheze links in the In other projects you'd notice that they're commons, famepedia, meta and famedata. The issue is that they're not supposed to be appearing all as Miraheze, rather they ought to be the different site names [21:32:26] eg. wikibase-otherprojects-meta for Meta Wiki, wikibase-otherprojects-commons for Miraheze Commons. [21:32:27] [url] FAMEPedia - The free encyclopædia | en.famepedia.org [21:34:16] The projects should go in a minute [21:34:23] And you'll just have languages [21:34:30] Which has the wiki names [21:34:33] !log [@mw11] starting deploy of {'config': True} to all [21:34:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:34:54] !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 21s [21:34:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:35:37] CosmicAlpha: can you enable puppet test3 [21:39:21] RhinosF1 But that's not what is ideal if this issue should be resolved In fact, that's not what is needed right now We don't want other languages to be called other projects, that's not ideal [21:43:36] But that's what a few messages above you said to do [21:47:19] no.... [21:49:21] What we have already is interlanguage-link-famepedia not wikibase-otherprojects-famepedia See, I think the both configs were just interchanged. [21:49:54] because there's never supposed to be interlanguage-link [22:01:17] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.42, 3.44, 3.21 [22:03:13] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.23, 3.16, 3.15 [22:07:59] https://www.mediawiki.org/wiki/Wikibase/Installation#3._Add_the_wikis_to_the_sites_table This might be helpful, idk. [22:08:00] [url] Wikibase/Installation - MediaWiki | www.mediawiki.org [22:52:51] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.10, 3.53, 3.07 [22:54:49] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.30, 20.81, 17.20 [22:54:51] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.79, 3.30, 3.05 [22:56:57]