[00:00:58] RECOVERY - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is OK: OK: Status of the systemd unit mediawiki_job_generate-sitemap-index [00:01:08] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/0a069beb1208735f88df041967d83212a2522c3f [00:01:08] 02statichelp/03main 07WikiTideBot 030a069be Bot: Auto-update Tech namespace pages 2026-10-16 00:01:05 [00:33:33] !log [jenny@mwtask181] sudo -u www-data php /srv/mediawiki/1.46/maintenance/run.php importImages --wiki=fliplinestudioswiki --sleep=1 '--comment=Importing images from https://fliplinestudios.fandom.com ([[phorge:T16254|T16254]])' -- images (END - exit=-2) [00:33:34] !log [jenny@mwtask181] Finished import for fliplinestudioswiki (XML: None; Images: images) (END - exit=-2) [00:33:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016003333-b53b1dff [00:33:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016003338-7a13bf29 [00:46:58] PROBLEM - mwtask181 Check unit status of mediawiki_job_generate-sitemap-index on mwtask181 is CRITICAL: CRITICAL: Status of the systemd unit mediawiki_job_generate-sitemap-index [00:52:52] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 84867MiB (18.7% inode=100%); [03:48:18] [02mw-config] 07lihaohong6 merged pull request #6520: T15205: move less frequently used domains in the CSP to ManageWiki (07miraheze:03main...07lihaohong6:03csp7) 13https://github.com/miraheze/mw-config/pull/6520 [03:48:18] [02mw-config] 07lihaohong6 pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/5b21d9324975022b1effe22ea1fe16786edbe868 [03:48:20] 02mw-config/03main 07Peter Li 035b21d93 Move less frequently used domains in the CSP to ManageWiki (#6520)… [03:49:26] !log [petramagna@test151] Starting deploy of {'pull': 'config', 'config': True} to test151 (T15205) [03:49:26] !log [petramagna@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 1s (T15205) [03:49:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016034926-c7caaac5 [03:49:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016034929-65df6eaa [03:50:09] !log [petramagna@test151] Starting deploy of {'versions': '1.46', 'upgrade_extensions': 'MirahezeMagic'} to test151 (T15205) [03:50:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016035009-59126493 [03:50:20] !log [petramagna@test151] finished deploy of {'versions': '1.46', 'upgrade_extensions': 'MirahezeMagic'} to test151 - SUCCESS in 10s (T15205) [03:50:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016035020-8fd60ffe [04:12:31] PROBLEM - puppet181 Check unit status of git_pull_puppet on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit git_pull_puppet [04:19:46] [02ManageWiki] 07lihaohong6 drafted pull request #832: Support multi-value settings in PopulateWikiSettings (07miraheze:03main...07lihaohong6:03json) 13https://github.com/miraheze/ManageWiki/pull/832 [04:20:31] RECOVERY - puppet181 Check unit status of git_pull_puppet on puppet181 is OK: OK: Status of the systemd unit git_pull_puppet [04:23:43] [02ManageWiki] 07ParasailNumerous left a file comment in pull request #832 03cc8fab9: Should this be worded to "parse values in --sourcelist file", as the argument itself is not being parsed? 13https://github.com/miraheze/ManageWiki/pull/832#discussion_r4290904950 [04:32:25] [02ManageWiki] 07Universal-Omega left a file comment in pull request #832 03cc8fab9: Instead of try-catch, you can use either json_validate, or perhaps better something like: […] 13https://github.com/miraheze/ManageWiki/pull/832#discussion_r4290947493 [04:34:47] PROBLEM - puppet181 Check unit status of listdomains_github_push on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit listdomains_github_push [04:36:06] PROBLEM - mw181 Puppet on mw181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_3d2png] [04:42:31] PROBLEM - puppet181 Check unit status of git_pull_puppet on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit git_pull_puppet [04:47:11] [02ManageWiki] 07lihaohong6 left a file comment in pull request #832 03cc8fab9: Fixed 13https://github.com/miraheze/ManageWiki/pull/832#discussion_r4291016820 [04:47:33] [02ManageWiki] 07lihaohong6 left a file comment in pull request #832 03cc8fab9: Thanks! I added some more explanations 13https://github.com/miraheze/ManageWiki/pull/832#discussion_r4291018398 [04:53:55] [02ManageWiki] 07lihaohong6 readied pull request #832: Support multi-value settings in PopulateWikiSettings (07miraheze:03main...07lihaohong6:03json) 13https://github.com/miraheze/ManageWiki/pull/832 [04:55:28] [02ManageWiki] 07Universal-Omega approved pull request #832: I haven't tested myself but code looks fine. 13https://github.com/miraheze/ManageWiki/pull/832#pullrequestreview-5543228573 [04:57:07] !log [petramagna@test151] Starting deploy of {'folders': '1.46/extensions/ManageWiki', 'debug': True} to test151 (T16315) [04:57:08] !log [petramagna@test151] finished deploy of {'folders': '1.46/extensions/ManageWiki', 'debug': True} to test151 - SUCCESS in 0s (T16315) [04:57:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016045708-bebf0179 [04:57:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016045711-3ae5f98a [05:00:31] RECOVERY - puppet181 Check unit status of git_pull_puppet on puppet181 is OK: OK: Status of the systemd unit git_pull_puppet [05:00:47] RECOVERY - puppet181 Check unit status of listdomains_github_push on puppet181 is OK: OK: Status of the systemd unit listdomains_github_push [05:02:04] RECOVERY - mw181 Puppet on mw181 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [05:06:01] !log [petramagna@test151] sudo -u www-data php /srv/mediawiki/1.46/maintenance/run.php ManageWiki:PopulateWikiSettings --wiki=metawikibeta --setting=wgMirahezeMagicCSPEnabledServices --sourcelist=/tmp/t15205-csp.txt --json (END - exit=0) (T15205) [05:06:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016050601-308f3578 [05:10:32] !log [petramagna@test151] Starting deploy of {'folders': '1.46/extensions/MirahezeMagic', 'debug': True} to test151 [05:10:33] !log [petramagna@test151] finished deploy of {'folders': '1.46/extensions/MirahezeMagic', 'debug': True} to test151 - SUCCESS in 0s [05:10:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016051032-d14805b7 [05:10:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016051035-150a1b9c [05:10:48] PROBLEM - test151 Puppet on test151 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_3d2png] [05:12:55] [02ManageWiki] 07lihaohong6 merged pull request #832: Support multi-value settings in PopulateWikiSettings (07miraheze:03main...07lihaohong6:03json) 13https://github.com/miraheze/ManageWiki/pull/832 [05:12:57] [02ManageWiki] 07lihaohong6 pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/fbe1be6b04422f94509ca7dc7b4fc0414571c21c [05:12:59] 02ManageWiki/03main 07Peter Li 03fbe1be6 Support multi-value settings in PopulateWikiSettings (#832)… [05:13:30] !log [petramagna@mwtask181] Starting deploy of {'versions': 'all', 'upgrade_extensions': 'ManageWiki'} to all (T16315) [05:13:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016051330-95c0814c [05:14:12] !log [petramagna@mwtask181] finished deploy of {'versions': 'all', 'upgrade_extensions': 'ManageWiki'} to all - SUCCESS in 42s (T16315) [05:14:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016051412-9ac38262 [05:17:43] !log [petramagna@mwtask181] Starting deploy of {'pull': 'config', 'config': True} to all (T15205) [05:17:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016051743-22b404b6 [05:18:09] !log [petramagna@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 26s (T15205) [05:18:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016051809-4848017f [05:18:20] PROBLEM - phorge171 Puppet on phorge171 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_phorge-extensions] [05:19:05] PROBLEM - mwtask151 Puppet on mwtask151 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_mathoid] [05:25:36] !log [petramagna@mwtask181] sudo -u www-data php /srv/mediawiki/1.46/maintenance/run.php ManageWiki:PopulateWikiSettings --wiki=metawiki --setting=wgMirahezeMagicCSPEnabledServices --sourcelist=/tmp/t15205-csp.txt --json (END - exit=0) (T15205) [05:25:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016052536-40e62f16 [05:26:30] PROBLEM - mw191 Puppet on mw191 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_femiwiki-deploy-1.46] [05:28:18] [02MirahezeMagic] 07lihaohong6 readied pull request #666: T15205: allow CSP entries to be toggled via ManageWiki (07miraheze:03main...07lihaohong6:03csp2) 13https://github.com/miraheze/MirahezeMagic/pull/666 [05:29:14] [02MirahezeMagic] 07lihaohong6 merged pull request #666: T15205: allow CSP entries to be toggled via ManageWiki (07miraheze:03main...07lihaohong6:03csp2) 13https://github.com/miraheze/MirahezeMagic/pull/666 [05:29:14] [02MirahezeMagic] 07lihaohong6 pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/14e7e1c84735604147d88bc03d3b4a495ec78060 [05:29:14] 02MirahezeMagic/03main 07Peter Li 0314e7e1c Adjust CSP entries according to ManageWiki settings (#666)… [05:34:52] RECOVERY - test151 Puppet on test151 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [05:35:53] !log [petramagna@mwtask181] Starting deploy of {'versions': 'all', 'upgrade_extensions': 'MirahezeMagic'} to all (T15205) [05:35:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016053553-1ccf42bc [05:36:34] !log [petramagna@mwtask181] finished deploy of {'versions': 'all', 'upgrade_extensions': 'MirahezeMagic'} to all - SUCCESS in 40s (T15205) [05:36:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016053634-5655fb65 [05:44:20] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [05:45:05] RECOVERY - mwtask151 Puppet on mwtask151 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [05:50:13] [02mw-config] 07lihaohong6 opened pull request #6596: Unrestrict CSP setting on ManageWiki (07miraheze:03main...07lihaohong6:03csp8) 13https://github.com/miraheze/mw-config/pull/6596 [05:52:49] RECOVERY - mw191 Puppet on mw191 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:53:11] [02mw-config] 07lihaohong6 merged pull request #6596: Unrestrict CSP setting on ManageWiki (07miraheze:03main...07lihaohong6:03csp8) 13https://github.com/miraheze/mw-config/pull/6596 [05:53:11] [02mw-config] 07lihaohong6 pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/17eddfb1aed03eb293a2ad1ab87871e2e12e2e62 [05:53:11] 02mw-config/03main 07Peter Li 0317eddfb Unrestrict CSP setting on ManageWiki (#6596)… [05:53:31] !log [petramagna@test151] Starting deploy of {'pull': 'config', 'config': True} to test151 [05:53:32] !log [petramagna@test151] finished deploy of {'pull': 'config', 'config': True} to test151 - SUCCESS in 0s [05:53:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016055331-862295be [05:53:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016055336-8037d0ab [05:54:20] !log [petramagna@mwtask181] Starting deploy of {'pull': 'config', 'config': True} to all (T15205) [05:54:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016055420-22b404b6 [05:54:47] !log [petramagna@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 27s (T15205) [05:54:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016055447-4f00e2fe [06:02:30] PROBLEM - puppet181 Check unit status of git_pull_ssl on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit git_pull_ssl [06:04:55] [02MirahezeMagic] 07lihaohong6 merged pull request #665: T15875: log a CSP help message in the browser console (07miraheze:03main...07lihaohong6:03console) 13https://github.com/miraheze/MirahezeMagic/pull/665 [06:04:55] [02MirahezeMagic] 07lihaohong6 pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/6fe3a71c8ef540d1b1a24863f05812ca7b35109d [06:04:55] 02MirahezeMagic/03main 07Peter Li 036fe3a71 Log a CSP help message in the browser console (#665)… [06:05:07] !log [petramagna@test151] Starting deploy of {'versions': '1.46', 'upgrade_extensions': 'MirahezeMagic'} to test151 (T15875) [06:05:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016060507-ea85e448 [06:05:18] !log [petramagna@test151] finished deploy of {'versions': '1.46', 'upgrade_extensions': 'MirahezeMagic'} to test151 - SUCCESS in 10s (T15875) [06:05:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016060518-ef12b3b7 [06:10:18] !log [petramagna@mwtask181] Starting deploy of {'l10n': True, 'versions': 'all', 'upgrade_extensions': 'MirahezeMagic', 'debug': True} to all (T15875) [06:10:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016061018-8046fe59 [06:10:30] RECOVERY - puppet181 Check unit status of git_pull_ssl on puppet181 is OK: OK: Status of the systemd unit git_pull_ssl [06:11:23] !log [petramagna@mwtask181] finished deploy of {'l10n': True, 'versions': 'all', 'upgrade_extensions': 'MirahezeMagic', 'debug': True} to all - SUCCESS in 65s (T15875) [06:11:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016061124-d4a90cd5 [06:14:18] PROBLEM - swiftobject201 APT on swiftobject201 is CRITICAL: APT CRITICAL: 123 packages available for upgrade (1 critical updates). [06:14:57] PROBLEM - mwtask151 APT on mwtask151 is CRITICAL: APT CRITICAL: 178 packages available for upgrade (2 critical updates). [06:14:59] PROBLEM - mw173 APT on mw173 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:15:13] PROBLEM - phorge171 APT on phorge171 is CRITICAL: APT CRITICAL: 109 packages available for upgrade (1 critical updates). [06:15:34] PROBLEM - swiftac171 APT on swiftac171 is CRITICAL: APT CRITICAL: 120 packages available for upgrade (2 critical updates). [06:16:17] PROBLEM - speedscope211 APT on speedscope211 is CRITICAL: APT CRITICAL: 75 packages available for upgrade (1 critical updates). [06:16:22] PROBLEM - swiftobject181 APT on swiftobject181 is CRITICAL: APT CRITICAL: 123 packages available for upgrade (1 critical updates). [06:16:40] PROBLEM - db161 APT on db161 is CRITICAL: APT CRITICAL: 110 packages available for upgrade (1 critical updates). [06:17:10] PROBLEM - os201 APT on os201 is CRITICAL: APT CRITICAL: 114 packages available for upgrade (1 critical updates). [06:18:10] PROBLEM - cloud15 APT on cloud15 is CRITICAL: APT CRITICAL: 188 packages available for upgrade (1 critical updates). [06:18:25] PROBLEM - os151 APT on os151 is CRITICAL: APT CRITICAL: 114 packages available for upgrade (1 critical updates). [06:19:11] PROBLEM - ns1 APT on ns1 is CRITICAL: APT CRITICAL: 108 packages available for upgrade (1 critical updates). [06:19:29] PROBLEM - cloud21 APT on cloud21 is CRITICAL: APT CRITICAL: 180 packages available for upgrade (1 critical updates). [06:19:30] PROBLEM - mem151 APT on mem151 is CRITICAL: APT CRITICAL: 105 packages available for upgrade (1 critical updates). [06:20:09] PROBLEM - mw193 APT on mw193 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:21:02] PROBLEM - db171 APT on db171 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (1 critical updates). [06:21:53] PROBLEM - mw171 APT on mw171 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:22:13] PROBLEM - db201 APT on db201 is CRITICAL: APT CRITICAL: 117 packages available for upgrade (1 critical updates). [06:22:13] PROBLEM - mw191 APT on mw191 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:23:21] PROBLEM - db182 APT on db182 is CRITICAL: APT CRITICAL: 112 packages available for upgrade (1 critical updates). [06:23:30] PROBLEM - mw153 APT on mw153 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:24:27] PROBLEM - kafka182 APT on kafka182 is CRITICAL: APT CRITICAL: 120 packages available for upgrade (1 critical updates). [06:26:00] PROBLEM - cloud19 APT on cloud19 is CRITICAL: APT CRITICAL: 188 packages available for upgrade (1 critical updates). [06:26:58] PROBLEM - cp191 APT on cp191 is CRITICAL: APT CRITICAL: 110 packages available for upgrade (1 critical updates). [06:27:05] PROBLEM - bots171 APT on bots171 is CRITICAL: APT CRITICAL: 122 packages available for upgrade (2 critical updates). [06:27:26] PROBLEM - cp161 APT on cp161 is CRITICAL: APT CRITICAL: 108 packages available for upgrade (1 critical updates). [06:27:41] PROBLEM - swiftobject171 APT on swiftobject171 is CRITICAL: APT CRITICAL: 122 packages available for upgrade (1 critical updates). [06:28:03] PROBLEM - mem191 APT on mem191 is CRITICAL: APT CRITICAL: 105 packages available for upgrade (1 critical updates). [06:28:27] PROBLEM - os162 APT on os162 is CRITICAL: APT CRITICAL: 114 packages available for upgrade (1 critical updates). [06:28:50] PROBLEM - graylog161 APT on graylog161 is CRITICAL: APT CRITICAL: 116 packages available for upgrade (1 critical updates). [06:29:11] PROBLEM - mw192 APT on mw192 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:29:29] PROBLEM - mw151 APT on mw151 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:30:03] PROBLEM - os202 APT on os202 is CRITICAL: APT CRITICAL: 120 packages available for upgrade (1 critical updates). [06:30:52] PROBLEM - mw163 APT on mw163 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:31:30] PROBLEM - cloud18 APT on cloud18 is CRITICAL: APT CRITICAL: 182 packages available for upgrade (1 critical updates). [06:31:32] PROBLEM - db181 APT on db181 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (1 critical updates). [06:31:41] PROBLEM - ns2 APT on ns2 is CRITICAL: APT CRITICAL: 67 packages available for upgrade (1 critical updates). [06:32:10] PROBLEM - reports171 APT on reports171 is CRITICAL: APT CRITICAL: 109 packages available for upgrade (1 critical updates). [06:32:56] PROBLEM - mwtask181 APT on mwtask181 is CRITICAL: APT CRITICAL: 180 packages available for upgrade (2 critical updates). [06:32:58] PROBLEM - swiftobject151 APT on swiftobject151 is CRITICAL: APT CRITICAL: 122 packages available for upgrade (1 critical updates). [06:33:09] PROBLEM - db151 APT on db151 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (1 critical updates). [06:33:19] PROBLEM - mw181 APT on mw181 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:33:28] PROBLEM - test151 APT on test151 is CRITICAL: APT CRITICAL: 183 packages available for upgrade (2 critical updates). [06:33:29] PROBLEM - os191 APT on os191 is CRITICAL: APT CRITICAL: 114 packages available for upgrade (1 critical updates). [06:33:35] PROBLEM - db192 APT on db192 is CRITICAL: APT CRITICAL: 117 packages available for upgrade (1 critical updates). [06:33:37] PROBLEM - os161 APT on os161 is CRITICAL: APT CRITICAL: 114 packages available for upgrade (1 critical updates). [06:33:42] PROBLEM - matomo211 APT on matomo211 is CRITICAL: APT CRITICAL: 68 packages available for upgrade (1 critical updates). [06:33:53] PROBLEM - cloud20 APT on cloud20 is CRITICAL: APT CRITICAL: 188 packages available for upgrade (1 critical updates). [06:34:06] PROBLEM - swiftobject161 APT on swiftobject161 is CRITICAL: APT CRITICAL: 122 packages available for upgrade (1 critical updates). [06:34:41] PROBLEM - bast181 APT on bast181 is CRITICAL: APT CRITICAL: 112 packages available for upgrade (1 critical updates). [06:34:46] PROBLEM - eventgate182 APT on eventgate182 is CRITICAL: APT CRITICAL: 116 packages available for upgrade (1 critical updates). [06:34:46] PROBLEM - mw201 APT on mw201 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:35:02] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 102 packages available for upgrade (1 critical updates). [06:35:32] PROBLEM - ldap171 APT on ldap171 is CRITICAL: APT CRITICAL: 107 packages available for upgrade (1 critical updates). [06:36:09] PROBLEM - mw183 APT on mw183 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:36:28] PROBLEM - mw152 APT on mw152 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:36:48] PROBLEM - cloud16 APT on cloud16 is CRITICAL: APT CRITICAL: 182 packages available for upgrade (1 critical updates). [06:36:52] PROBLEM - swiftobject211 APT on swiftobject211 is CRITICAL: APT CRITICAL: 112 packages available for upgrade (1 critical updates). [06:36:53] PROBLEM - cloud17 APT on cloud17 is CRITICAL: APT CRITICAL: 182 packages available for upgrade (1 critical updates). [06:37:37] PROBLEM - prometheus151 APT on prometheus151 is CRITICAL: APT CRITICAL: 109 packages available for upgrade (1 critical updates). [06:37:51] PROBLEM - mw182 APT on mw182 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:38:51] PROBLEM - mattermost2 APT on mattermost2 is CRITICAL: APT CRITICAL: 110 packages available for upgrade (1 critical updates). [06:39:19] PROBLEM - matomo151 APT on matomo151 is CRITICAL: APT CRITICAL: 107 packages available for upgrade (1 critical updates). [06:39:33] PROBLEM - mw202 APT on mw202 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:39:35] PROBLEM - swiftproxy161 APT on swiftproxy161 is CRITICAL: APT CRITICAL: 119 packages available for upgrade (2 critical updates). [06:39:42] PROBLEM - cp201 APT on cp201 is CRITICAL: APT CRITICAL: 110 packages available for upgrade (1 critical updates). [06:40:09] PROBLEM - mem201 APT on mem201 is CRITICAL: APT CRITICAL: 105 packages available for upgrade (1 critical updates). [06:40:49] PROBLEM - changeprop202 APT on changeprop202 is CRITICAL: APT CRITICAL: 117 packages available for upgrade (1 critical updates). [06:41:10] PROBLEM - db172 APT on db172 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (1 critical updates). [06:41:24] PROBLEM - mw162 APT on mw162 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:41:31] PROBLEM - mw172 APT on mw172 is CRITICAL: APT CRITICAL: 174 packages available for upgrade (2 critical updates). [06:41:50] PROBLEM - rdb191 APT on rdb191 is CRITICAL: APT CRITICAL: 108 packages available for upgrade (1 critical updates). [06:41:51] PROBLEM - cp171 APT on cp171 is CRITICAL: APT CRITICAL: 110 packages available for upgrade (1 critical updates). [06:42:09] PROBLEM - mwtask171 APT on mwtask171 is CRITICAL: APT CRITICAL: 179 packages available for upgrade (2 critical updates). [06:42:15] PROBLEM - mw161 APT on mw161 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:42:34] PROBLEM - swiftproxy171 APT on swiftproxy171 is CRITICAL: APT CRITICAL: 119 packages available for upgrade (2 critical updates). [06:42:44] PROBLEM - bast161 APT on bast161 is CRITICAL: APT CRITICAL: 111 packages available for upgrade (1 critical updates). [06:42:47] PROBLEM - mw203 APT on mw203 is CRITICAL: APT CRITICAL: 173 packages available for upgrade (2 critical updates). [06:42:56] PROBLEM - llm191 APT on llm191 is CRITICAL: APT CRITICAL: 121 packages available for upgrade (2 critical updates). [06:43:12] PROBLEM - mwtask161 APT on mwtask161 is CRITICAL: APT CRITICAL: 178 packages available for upgrade (2 critical updates). [06:43:32] PROBLEM - mem161 APT on mem161 is CRITICAL: APT CRITICAL: 105 packages available for upgrade (1 critical updates). [06:43:33] PROBLEM - puppet181 APT on puppet181 is CRITICAL: APT CRITICAL: 92 packages available for upgrade (2 critical updates). [06:43:34] PROBLEM - swiftobject191 APT on swiftobject191 is CRITICAL: APT CRITICAL: 123 packages available for upgrade (1 critical updates). [09:14:18] [02mw-config] 07Honoka55 opened pull request #6597: Fix T16320 and Fix T16321: add two per-wiki csp (07miraheze:03main...07Honoka55:03patch-2) 13https://github.com/miraheze/mw-config/pull/6597 [10:10:40] [02TSPortal] 07renovate[bot] created 03renovate/dev-deps (+1 new commit) 13https://github.com/miraheze/TSPortal/commit/c7e9ad60f871 [10:10:40] 02TSPortal/03renovate/dev-deps 07renovate[bot] 03c7e9ad6 Update dependency phpunit/phpunit to v13.4.3 [10:10:53] [02TSPortal] 07renovate[bot] created 03renovate/prod-deps (+1 new commit) 13https://github.com/miraheze/TSPortal/commit/2567e8382d1b [10:10:54] 02TSPortal/03renovate/prod-deps 07renovate[bot] 032567e83 Update dependency laravel/framework to v13.37.0 [10:10:57] [02TSPortal] 07renovate[bot] opened pull request #131: Update dependency laravel/framework to v13.37.0 (03main...03renovate/prod-deps) 13https://github.com/miraheze/TSPortal/pull/131 [10:10:57] [02TSPortal] 07renovate[bot] added the label 'composer' to pull request #131 (Update dependency laravel/framework to v13.37.0) 13https://github.com/miraheze/TSPortal/pull/131 [10:10:59] [02TSPortal] 07renovate[bot] added the label 'dependencies' to pull request #131 (Update dependency laravel/framework to v13.37.0) 13https://github.com/miraheze/TSPortal/pull/131 [10:42:29] PROBLEM - mwtask151 Current Load on mwtask151 is CRITICAL: LOAD CRITICAL - total load average: 33.47, 36.59, 18.71 [10:46:28] RECOVERY - mwtask151 Current Load on mwtask151 is OK: LOAD OK - total load average: 4.42, 18.84, 15.49 [13:08:32] [02dns] 07paladox created 03paladox-patch-1 (+1 new commit) 13https://github.com/miraheze/dns/commit/39ca217a5768 [13:08:32] 02dns/03paladox-patch-1 07paladox 0339ca217 Add db193 to dns [13:09:23] [02dns] 07paladox opened pull request #715: Add db193 to dns (03main...03paladox-patch-1) 13https://github.com/miraheze/dns/pull/715 [13:09:57] [02dns] 07paladox pushed 1 new commit to 03paladox-patch-1 13https://github.com/miraheze/dns/commit/e86c40106a03458c9ba8879bfbfb1300038c486b [13:09:59] 02dns/03paladox-patch-1 07paladox 03e86c401 Add PTR record for db193.fsslc.wtnet [13:10:22] [02dns] 07paladox merged pull request #715: Add db193 to dns (03main...03paladox-patch-1) 13https://github.com/miraheze/dns/pull/715 [13:10:22] [02dns] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/dns/commit/6a7725d2ef8f7756a33b04e64ca11899104d6303 [13:10:22] 02dns/03main 07paladox 036a7725d Add db193 to dns (#715) [13:10:24] [02dns] 07paladox 04deleted 03paladox-patch-1 at 03e86c401 13https://api.github.com/repos/miraheze/dns/commit/e86c401 [13:26:36] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/bc5d1b293de5 [13:26:36] 02puppet/03paladox-patch-3 07paladox 03bc5d1b2 Install db193 [13:26:41] [02puppet] 07paladox opened pull request #5071: Install db193 (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5071 [13:27:01] [02puppet] 07paladox pushed 1 new commit to 03paladox-patch-3 13https://github.com/miraheze/puppet/commit/c77cac74ff04c9824691929b49116904df563d40 [13:27:02] 02puppet/03paladox-patch-3 07paladox 03c77cac7 Update site.pp [13:27:11] [02puppet] 07paladox merged pull request #5071: Install db193 (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5071 [13:27:11] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/6e2b9ef970008f8b4c336d70132c37a155590ead [13:27:11] 02puppet/03main 07paladox 036e2b9ef Install db193 (#5071) [13:27:12] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 03c77cac7 13https://api.github.com/repos/miraheze/puppet/commit/c77cac7 [13:34:23] PROBLEM - db193 MariaDB on db193 is CRITICAL: Can't connect to server on 'db193.fsslc.wtnet' (115) [13:34:31] PROBLEM - db193 nftables_active on db193 is CRITICAL: connect to address 10.0.19.174 port 5666: Connection refusedconnect to host 10.0.19.174 port 5666: Connection refused [13:34:32] PROBLEM - db193 MariaDB Connections on db193 is UNKNOWN: PHP Fatal error: Uncaught mysqli_sql_exception: Connection refused in /usr/lib/nagios/plugins/check_mysql_connections.php:66Stack trace:#0 /usr/lib/nagios/plugins/check_mysql_connections.php(66): mysqli_real_connect(Object(mysqli), 'db193.fsslc.wtn...', 'icinga', Object(SensitiveParameterValue), NULL, NULL, NULL, true)#1 {main} thrown in /usr/lib/nagios/plugins/check_mysql_connect [13:34:32] n line 66Fatal error: Uncaught mysqli_sql_exception: Connection refused in /usr/lib/nagios/plugins/check_mysql_connections.php:66Stack trace:#0 /usr/lib/nagios/plugins/check_mysql_connections.php(66): mysqli_real_connect(Object(mysqli), 'db193.fsslc.wtn...', 'icinga', Object(SensitiveParameterValue), NULL, NULL, NULL, true)#1 {main} thrown in /usr/lib/nagios/plugins/check_mysql_connections.php on line 66 PROBLEM - db193 conntrack_table_size on db193 is CRITICAL: connect to address 10.0.19.174 port 5666: Connection refusedconnect to host 10.0.19.174 port 5666: Connection refused [13:34:44] PROBLEM - db193 Puppet on db193 is CRITICAL: connect to address 10.0.19.174 port 5666: Connection refusedconnect to host 10.0.19.174 port 5666: Connection refused [13:34:46] PROBLEM - db193 Current Load on db193 is CRITICAL: connect to address 10.0.19.174 port 5666: Connection refusedconnect to host 10.0.19.174 port 5666: Connection refused [13:34:50] PROBLEM - db193 Disk Space on db193 is CRITICAL: connect to address 10.0.19.174 port 5666: Connection refusedconnect to host 10.0.19.174 port 5666: Connection refused [13:35:07] PROBLEM - db193 PowerDNS Recursor on db193 is CRITICAL: connect to address 10.0.19.174 port 5666: Connection refusedconnect to host 10.0.19.174 port 5666: Connection refused [13:35:07] PROBLEM - db193 chrony on db193 is CRITICAL: connect to address 10.0.19.174 port 5666: Connection refusedconnect to host 10.0.19.174 port 5666: Connection refused [13:35:08] PROBLEM - db193 Check unit status of sql-backup on db193 is CRITICAL: connect to address 10.0.19.174 port 5666: Connection refusedconnect to host 10.0.19.174 port 5666: Connection refused [13:35:10] PROBLEM - db193 APT on db193 is CRITICAL: connect to address 10.0.19.174 port 5666: Connection refusedconnect to host 10.0.19.174 port 5666: Connection refused [13:38:19] PROBLEM - db193 nftables_active on db193 is UNKNOWN: NRPE: Unable to read output [13:38:36] PROBLEM - db193 Puppet on db193 is UNKNOWN: NRPE: Unable to read output [13:38:38] RECOVERY - db193 conntrack_table_size on db193 is OK: OK: nf_conntrack is 0 % full [13:38:43] RECOVERY - db193 Current Load on db193 is OK: LOAD OK - total load average: 0.84, 0.81, 0.43 [13:38:48] RECOVERY - db193 Disk Space on db193 is OK: DISK OK - free space: / 162599MiB (97.0% inode=99%); [13:39:01] RECOVERY - db193 Check unit status of sql-backup on db193 is OK: OK: Status of the systemd unit sql-backup [13:39:03] RECOVERY - db193 PowerDNS Recursor on db193 is OK: DNS OK: 0.061 seconds response time. db193.fsslc.wtnet returns 10.0.19.174 [13:39:06] RECOVERY - db193 chrony on db193 is OK: chrony OK: System Time 0.000000529 seconds slow of NTP time, Stratum 4 [13:40:13] RECOVERY - db193 nftables_active on db193 is OK: OK nftables input default policy is set [13:40:33] RECOVERY - db193 Puppet on db193 is OK: OK: Puppet is currently enabled, last run 38 seconds ago with 0 failures [13:44:54] RECOVERY - db193 APT on db193 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [13:46:51] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/23f566b5d86a [13:46:51] 02puppet/03paladox-patch-3 07paladox 0323f566b phorge: Put into read-only mode [13:46:57] [02puppet] 07paladox opened pull request #5072: phorge: Put into read-only mode (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5072 [13:47:06] [02puppet] 07paladox merged pull request #5072: phorge: Put into read-only mode (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5072 [13:47:08] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/b1bc01065c54b9acbbf7c21a0ab186a6e90751fa [13:47:09] 02puppet/03main 07paladox 03b1bc010 phorge: Put into read-only mode (#5072) [13:47:11] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 0323f566b 13https://api.github.com/repos/miraheze/puppet/commit/23f566b [13:50:30] PROBLEM - phorge171 Puppet on phorge171 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[phd] [14:03:00] PROBLEM - mon181 APT on mon181 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [14:04:59] PROBLEM - mon181 APT on mon181 is CRITICAL: APT CRITICAL: 103 packages available for upgrade (2 critical updates). [14:06:19] [02TSPortal] 07renovate[bot] merged 03renovate/dev-deps into 03main 13https://github.com/miraheze/TSPortal/compare/f279daa5dc55...c7e9ad60f871 [14:06:20] [02TSPortal] 07renovate[bot] 04deleted 03renovate/dev-deps at 03c7e9ad6 13https://api.github.com/repos/miraheze/TSPortal/commit/c7e9ad6 [14:06:52] [02TSPortal] 07renovate[bot] 04force-pushed 03renovate/prod-deps from 032567e83 to 036b3ac18 13https://api.github.com/repos/miraheze/TSPortal/commits/renovate/prod-deps [14:06:52] 02TSPortal/03renovate/prod-deps 07renovate[bot] 036b3ac18 Update dependency laravel/framework to v13.37.0 [14:12:03] RECOVERY - db193 MariaDB on db193 is OK: Uptime: 1657 Threads: 1 Questions: 13 Slow queries: 0 Opens: 16 Open tables: 10 Queries per second avg: 0.007 [14:12:11] RECOVERY - db193 MariaDB Connections on db193 is OK: OK connection usage: 0.1%Current connections: 1 [14:12:26] [02mw-config] 07dependabot[bot] created 03dependabot/composer/phpunit/phpunit-13.4.2 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/b92b1a757e61 [14:12:26] 02mw-config/03dependabot/composer/phpunit/phpunit-13.4.2 07dependabot[bot] 03b92b1a7 Update phpunit/phpunit requirement from 13.4.1 to 13.4.2… [14:12:29] [02mw-config] 07dependabot[bot] opened pull request #6598: Update phpunit/phpunit requirement from 13.4.1 to 13.4.2 (03main...03dependabot/composer/phpunit/phpunit-13.4.2) 13https://github.com/miraheze/mw-config/pull/6598 [14:12:30] [02mw-config] 07dependabot[bot] added the label 'dependencies' to pull request #6598 (Update phpunit/phpunit requirement from 13.4.1 to 13.4.2) 13https://github.com/miraheze/mw-config/pull/6598 [14:12:32] [02mw-config] 07dependabot[bot] added the label 'php' to pull request #6598 (Update phpunit/phpunit requirement from 13.4.1 to 13.4.2) 13https://github.com/miraheze/mw-config/pull/6598 [14:30:50] [1/4] https://cdn.discordapp.com/attachments/808001911868489748/1560661301527715861/DSC_0369.png?ex=6ad38699&is=6ad23519&hm=be5129669f76043a8a9080ccb085dd2e750d8246c888e7f3764259115f8cd48b& [14:30:51] [2/4] https://cdn.discordapp.com/attachments/808001911868489748/1560661301967982663/image_2x81bo.png?ex=6ad3869a&is=6ad2351a&hm=08becc35d3a5396135aeb1d6d058be75c0a99ce90ab82855867207ba1413de90& [14:30:51] [3/4] https://cdn.discordapp.com/attachments/808001911868489748/1560661302412583054/IMG-20260918-WA2849.png?ex=6ad3869a&is=6ad2351a&hm=26ac996f7d597c9eeca293912d0282d704eb7f6eca500051fc753b7e99faf51a& [14:30:51] [4/4] https://cdn.discordapp.com/attachments/808001911868489748/1560661302907502622/DSC_2383.png?ex=6ad3869a&is=6ad2351a&hm=52441e73d20a428ffb0fc0a56d6cac8a71dd8242856950c8214440c7d3841303& [14:31:25] PROBLEM - phorge171 Disk Space on phorge171 is WARNING: DISK WARNING - free space: / 5034MiB (6.8% inode=95%); [14:33:24] PROBLEM - phorge171 Disk Space on phorge171 is CRITICAL: DISK CRITICAL - free space: / 3459MiB (4.7% inode=95%); [14:41:20] RECOVERY - phorge171 Disk Space on phorge171 is OK: DISK OK - free space: / 52558MiB (71.4% inode=95%); [15:44:11] wtf was that [15:44:32] went from 5% to 71% in like 5m [15:47:14] miraheze/mw-config - Aeywoo the build passed. [15:54:23] @Infrastructure Specialists hey, Issue Tracker is dead. [15:54:33] https://cdn.discordapp.com/attachments/808001911868489748/1560682369244070049/image.png?ex=6ad39a38&is=6ad248b8&hm=1fc9eb326de47946d5ba9cb5bb862b11c42f646c8a1a243993b186357eb1408f& [15:55:24] I guess someone put the DB in read-only mode? [15:58:09] yeh we are aware (it'sm me moving its db) [16:01:13] Ahhh, didn't know cause I didn't see an announcement. [16:27:34] PROBLEM - db182 Current Load on db182 is CRITICAL: LOAD CRITICAL - total load average: 14.37, 11.52, 8.85 [16:29:34] PROBLEM - db182 Current Load on db182 is WARNING: LOAD WARNING - total load average: 9.67, 10.79, 8.92 [16:30:38] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 14.37, 12.59, 10.41 [16:31:34] RECOVERY - db182 Current Load on db182 is OK: LOAD OK - total load average: 7.55, 9.54, 8.68 [16:32:38] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 16.20, 14.23, 11.30 [16:34:38] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 13.09, 13.90, 11.55 [16:36:38] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 17.62, 15.27, 12.33 [16:38:38] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 14.57, 15.06, 12.62 [16:40:34] PROBLEM - mw182 HTTPS on mw182 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10006 milliseconds [16:40:41] PROBLEM - mw182 SSH on mw182 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:41:25] PROBLEM - mw182 MediaWiki Rendering on mw182 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:42:15] PROBLEM - mw182 Current Load on mw182 is CRITICAL: LOAD CRITICAL - total load average: 37.12, 36.06, 23.57 [16:42:30] RECOVERY - mw182 HTTPS on mw182 is OK: HTTP OK: HTTP/2 410 - Status line output matched "HTTP/2 410" - 340 bytes in 0.674 second response time [16:42:36] RECOVERY - mw182 SSH on mw182 is OK: SSH OK - OpenSSH_10.0p2 (protocol 2.0) [16:43:21] RECOVERY - mw182 MediaWiki Rendering on mw182 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.314 second response time [16:48:15] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 15.25, 22.11, 21.25 [16:52:15] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 9.57, 15.99, 19.02 [16:52:38] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 9.98, 12.76, 13.02 [17:02:59] PROBLEM - mw193 Current Load on mw193 is WARNING: LOAD WARNING - total load average: 16.91, 21.83, 16.74 [17:04:55] RECOVERY - mw193 Current Load on mw193 is OK: LOAD OK - total load average: 10.75, 17.96, 15.95 [17:54:53] PROBLEM - db193 Disk Space on db193 is WARNING: DISK WARNING - free space: / 12314MiB (7.3% inode=99%); [17:58:53] PROBLEM - db193 Disk Space on db193 is CRITICAL: DISK CRITICAL - free space: / 4785MiB (2.9% inode=99%); [18:02:53] RECOVERY - db193 Disk Space on db193 is OK: DISK OK - free space: / 77713MiB (46.4% inode=99%); [18:17:17] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 14.02, 13.42, 12.08 [18:30:46] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 12.46, 13.07, 12.97 [18:38:38] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 13.57, 13.88, 13.36 [18:42:38] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 11.80, 13.12, 13.19 [18:48:38] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 14.27, 13.74, 13.42 [18:50:38] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 13.07, 13.40, 13.34 [19:09:17] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 15.10, 14.10, 13.38 [19:11:12] PROBLEM - matomo151 Current Load on matomo151 is CRITICAL: LOAD CRITICAL - total load average: 17.32, 15.09, 13.82 [19:13:08] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 14.09, 14.72, 13.84 [19:21:41] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/bef67c3a0aa4 [19:21:41] 02puppet/03paladox-patch-3 07paladox 03bef67c3 Fix db193 config [19:21:46] [02puppet] 07paladox opened pull request #5073: Fix db193 config (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5073 [19:22:02] [02puppet] 07paladox merged pull request #5073: Fix db193 config (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5073 [19:22:04] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/b6fdff0f84b7cc954dc93a27fa3f6a99593950bc [19:22:05] 02puppet/03main 07paladox 03b6fdff0 Fix db193 config (#5073) [19:22:07] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 03bef67c3 13https://api.github.com/repos/miraheze/puppet/commit/bef67c3 [19:24:24] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/7326fd0f66a4eaddacd782763f7901e6517e6a9c [19:24:24] 02puppet/03main 07paladox 037326fd0 Fix [19:24:41] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 12.60, 13.04, 13.43 [20:10:34] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 21.44, 19.29, 15.37 [20:12:29] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 14.38, 17.48, 15.18 [20:27:37] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 45207MiB (10.0% inode=100%); [20:48:58] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/5086d92c4f510e2a2f7f602d57fbbae64d3b0aa0 [20:48:58] 02mw-config/03main 07Honoka55 035086d92 Fix T16320 and Fix T16321: add two per-wiki csp (#6597)… [20:49:00] [02mw-config] 07Universal-Omega merged 07Honoka55's pull request #6597: Fix T16320 and Fix T16321: add two per-wiki csp (07miraheze:03main...07Honoka55:03patch-2) 13https://github.com/miraheze/mw-config/pull/6597 [20:49:18] !log [universalomega@mwtask181] Starting deploy of {'pull': 'config', 'config': True} to all [20:49:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016204918-4d1b4212 [20:49:49] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 31s [20:49:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016204949-bed1657f [20:50:34] [02mw-config] 07Universal-Omega merged 07dependabot[bot]'s pull request #6598: Update phpunit/phpunit requirement from 13.4.1 to 13.4.2 (03main...03dependabot/composer/phpunit/phpunit-13.4.2) 13https://github.com/miraheze/mw-config/pull/6598 [20:50:35] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/ae59f5c9e7f1ab91d8dcfdeb3d51a4ba501b72df [20:50:35] 02mw-config/03main 07dependabot[bot] 03ae59f5c Update phpunit/phpunit requirement from 13.4.1 to 13.4.2 (#6598)… [20:50:36] [02mw-config] 07Universal-Omega 04deleted 03dependabot/composer/phpunit/phpunit-13.4.2 at 03b92b1a7 13https://api.github.com/repos/miraheze/mw-config/commit/b92b1a7 [21:02:33] [02MirahezeMagic] 07SaraTheSwift opened pull request #673: Update en.json (07miraheze:03main...07SaraTheSwift:03patch-1) 13https://github.com/miraheze/MirahezeMagic/pull/673 [21:09:09] [02MirahezeMagic] 07Universal-Omega commented on pull request #673: Thanks! 13https://github.com/miraheze/MirahezeMagic/pull/673#issuecomment-6224736543 [21:09:18] [02MirahezeMagic] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/7e726026c9aab6c6b330de7e991be337cf640d63 [21:09:18] 02MirahezeMagic/03main 07SaraTheSwift 037e72602 Update en.json (#673)… [21:09:20] [02MirahezeMagic] 07Universal-Omega merged 07SaraTheSwift's pull request #673: Update en.json (07miraheze:03main...07SaraTheSwift:03patch-1) 13https://github.com/miraheze/MirahezeMagic/pull/673 [21:15:01] miraheze/MirahezeMagic - SaraTheSwift the build passed. [21:15:41] miraheze/MirahezeMagic - Universal-Omega the build passed. [21:41:17] [02puppet] 07paladox created 03paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/c6bf2df76fdf [21:41:17] 02puppet/03paladox-patch-3 07paladox 03c6bf2df phorge: switch to db193 [21:41:23] [02puppet] 07paladox opened pull request #5074: phorge: switch to db193 (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5074 [21:42:54] PROBLEM - cp171 Disk Space on cp171 is WARNING: DISK WARNING - free space: / 44387MiB (9.8% inode=100%); [21:48:01] [02puppet] 07paladox merged pull request #5074: phorge: switch to db193 (03main...03paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5074 [21:48:03] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/fb67726278d03b7f61e9400bd1e0f92831ad4b8a [21:48:04] 02puppet/03main 07paladox 03fb67726 phorge: switch to db193 (#5074) [21:48:06] [02puppet] 07paladox 04deleted 03paladox-patch-3 at 03c6bf2df 13https://api.github.com/repos/miraheze/puppet/commit/c6bf2df [21:48:54] RECOVERY - cp171 Disk Space on cp171 is OK: DISK OK - free space: / 90305MiB (19.9% inode=100%); [21:49:39] [02puppet] 07paladox created 03revert-5072-paladox-patch-3 (+1 new commit) 13https://github.com/miraheze/puppet/commit/863d6879ff3e [21:49:39] 02puppet/03revert-5072-paladox-patch-3 07paladox 03863d687 Revert "phorge: Put into read-only mode (#5072)"… [21:49:42] [02puppet] 07paladox opened pull request #5075: Revert "phorge: Put into read-only mode" (03main...03revert-5072-paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5075 [21:49:49] [02puppet] 07paladox merged pull request #5075: Revert "phorge: Put into read-only mode" (03main...03revert-5072-paladox-patch-3) 13https://github.com/miraheze/puppet/pull/5075 [21:49:51] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/04c732cf34771e37dce18c4bec3526a71e5b69ff [21:49:52] 02puppet/03main 07paladox 0304c732c Revert "phorge: Put into read-only mode" (#5075)… [21:49:54] [02puppet] 07paladox 04deleted 03revert-5072-paladox-patch-3 at 03863d687 13https://api.github.com/repos/miraheze/puppet/commit/863d687 [21:51:03] it's back now (phorge) [21:51:28] RECOVERY - phorge171 Puppet on phorge171 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:55:59] !log dropped phabricator_ on db182 [21:56:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016215559-454efd89 [21:56:42] RECOVERY - db182 Disk Space on db182 is OK: DISK OK - free space: / 100488MiB (17.0% inode=100%); [22:09:48] PROBLEM - cp191 Disk Space on cp191 is WARNING: DISK WARNING - free space: / 44670MiB (9.8% inode=100%); [22:15:48] RECOVERY - cp191 Disk Space on cp191 is OK: DISK OK - free space: / 90587MiB (19.9% inode=100%); [22:29:35] !log increase phorg171 disk by 19gib (20gb) [22:29:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016222935-93d68f44 [22:33:33] RECOVERY - phorge171 Check unit status of phorge_db-backup on phorge171 is OK: OK: Status of the systemd unit phorge_db-backup [22:55:34] [02MirahezeMagic] 07ParasailNumerous opened pull request #674: T15875: Notify interface admin/admin/bureaucrat users for CSP violations (07miraheze:03main...07ParasailNumerous:03csp-violation-notify) 13https://github.com/miraheze/MirahezeMagic/pull/674 [23:17:47] !log [petramagna@test151] Starting deploy of {'folders': '1.46/extensions/MirahezeMagic', 'debug': True} to test151 (T15875) [23:17:48] !log [petramagna@test151] finished deploy of {'folders': '1.46/extensions/MirahezeMagic', 'debug': True} to test151 - SUCCESS in 0s (T15875) [23:17:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016231747-bb2c6d7b [23:17:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016231750-bc9c51bb [23:18:23] !log [petramagna@test151] Starting deploy of {'l10n': True, 'folders': '1.46/extensions/MirahezeMagic', 'versions': '1.46', 'debug': True} to test151 [23:18:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016231823-bc73fc46 [23:18:39] !log [petramagna@test151] finished deploy of {'l10n': True, 'folders': '1.46/extensions/MirahezeMagic', 'versions': '1.46', 'debug': True} to test151 - SUCCESS in 16s [23:18:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log#sal-20261016231839-d060b098 [23:31:07] [02phorge-extensions] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/phorge-extensions/commit/b8f0e7b58e5bc941e2b41646ac89aae9351bcec1 [23:31:07] 02phorge-extensions/03main 07CosmicAlpha 03b8f0e7b - [23:31:18] [02phorge-extensions] 07Universal-Omega created 03revert-86-feedbots (+1 new commit) 13https://github.com/miraheze/phorge-extensions/commit/d48abb290827 [23:31:20] 02phorge-extensions/03revert-86-feedbots 07CosmicAlpha 03d48abb2 Revert "Add dashboard type to allow hiding bots"… [23:31:24] [02phorge-extensions] 07Universal-Omega opened pull request #89: Revert "Add dashboard type to allow hiding bots" (03main...03revert-86-feedbots) 13https://github.com/miraheze/phorge-extensions/pull/89 [23:32:14] [02phorge-extensions] 07Universal-Omega merged pull request #89: Revert "Add dashboard type to allow hiding bots" (03main...03revert-86-feedbots) 13https://github.com/miraheze/phorge-extensions/pull/89 [23:32:14] [02phorge-extensions] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/phorge-extensions/commit/14e6c783e9bc77a35b9004989b3785844764f1a5 [23:32:14] 02phorge-extensions/03main 07CosmicAlpha 0314e6c78 Revert "Add dashboard type to allow hiding bots"… [23:32:16] [02phorge-extensions] 07Universal-Omega 04deleted 03revert-86-feedbots at 03d48abb2 13https://api.github.com/repos/miraheze/phorge-extensions/commit/d48abb2 [23:36:53] [02MirahezeMagic] 07lihaohong6 left a file comment in pull request #674 033f3ea5d: I believe it is possible to create links in the frontend. It wasn't done in the console message because the console only accepts plaintext links. But here you might be able to use the external link syntax and parse it in JS? 13https://github.com/miraheze/MirahezeMagic/pull/674#discussion_r4300258308 [23:37:31] [02MirahezeMagic] 07lihaohong6 left a file comment in pull request #674 033f3ea5d: Oops wrong line. 13https://github.com/miraheze/MirahezeMagic/pull/674#discussion_r4300261879 [23:37:49] [02MirahezeMagic] 07lihaohong6 left a file comment in pull request #674 033f3ea5d: I believe it is possible to create links in the frontend. It wasn't done in the console message because the console only accepts plaintext links. But here you might be able to use the external link syntax and parse it in JS? 13https://github.com/miraheze/MirahezeMagic/pull/674#discussion_r4300263381 [23:38:49] [02phorge-extensions] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/phorge-extensions/commit/5acb848a06bb4be102926276a2997df350e21284 [23:38:50] 02phorge-extensions/03main 07CosmicAlpha 035acb848 Fix assignment visibility [23:46:45] [02MirahezeMagic] 07lihaohong6 left a file comment in pull request #674 033f3ea5d: See https://www.mediawiki.org/wiki/Manual:Messages_API#Format_options. Links do work. `*` does not, but you can use raw `
    ` and `
  • ` tags. 13https://github.com/miraheze/MirahezeMagic/pull/674#discussion_r4300310592 [23:48:07] [02phorge-extensions] 07Universal-Omega created 03style (+1 new commit) 13https://github.com/miraheze/phorge-extensions/commit/a5ebcbd82d8f [23:48:07] 02phorge-extensions/03style 07CosmicAlpha 03a5ebcbd Move inline styles to celerity [23:48:13] [02phorge-extensions] 07Universal-Omega opened pull request #90: Move inline styles to celerity (03main...03style) 13https://github.com/miraheze/phorge-extensions/pull/90 [23:49:04] [02phorge-extensions] 07Universal-Omega pushed 1 new commit to 03style 13https://github.com/miraheze/phorge-extensions/commit/fc716d8071e9a397e7f8e730ab09ad8dea9f2f31 [23:49:04] 02phorge-extensions/03style 07CosmicAlpha 03fc716d8 Update [23:50:01] [02phorge-extensions] 07Universal-Omega pushed 1 new commit to 03style 13https://github.com/miraheze/phorge-extensions/commit/9c2025f331b7b3769b906ac5f0348956407c8948 [23:50:01] 02phorge-extensions/03style 07CosmicAlpha 039c2025f Update [23:50:50] [02phorge-extensions] 07Universal-Omega pushed 1 new commit to 03style 13https://github.com/miraheze/phorge-extensions/commit/8199ee4cefe5e2ddbacc4d83b36da77a27089880 [23:50:50] 02phorge-extensions/03style 07CosmicAlpha 038199ee4 Add [23:51:36] [02phorge-extensions] 07Universal-Omega pushed 1 new commit to 03style 13https://github.com/miraheze/phorge-extensions/commit/d32d620445c0705d71bd9ed4810ab6ff22e47504 [23:51:36] 02phorge-extensions/03style 07CosmicAlpha 03d32d620 Add [23:52:26] [02phorge-extensions] 07Universal-Omega pushed 1 new commit to 03style 13https://github.com/miraheze/phorge-extensions/commit/cdf98df710ee0cf38f5d41b963507f6fc2516dae [23:52:26] 02phorge-extensions/03style 07CosmicAlpha 03cdf98df Update [23:54:40] [02phorge-extensions] 07Universal-Omega merged pull request #90: Move inline styles to celerity (03main...03style) 13https://github.com/miraheze/phorge-extensions/pull/90 [23:54:40] [02phorge-extensions] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/phorge-extensions/commit/5a7102ac2f96a9fa8075c73974cef873bd30e638 [23:54:42] 02phorge-extensions/03main 07CosmicAlpha 035a7102a Move inline styles to celerity [23:54:44] [02phorge-extensions] 07Universal-Omega 04deleted 03style at 03cdf98df 13https://api.github.com/repos/miraheze/phorge-extensions/commit/cdf98df [23:57:42] [02MirahezeMagic] 07Universal-Omega left a file comment in pull request #674 033f3ea5d: Is it possible to check rights instead? Not all wikis use these groups. 13https://github.com/miraheze/MirahezeMagic/pull/674#discussion_r4300362062