[00:00:45] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:02:45] PROBLEM - cp26 HTTP 4xx/5xx ERROR Rate on cp26 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [00:03:40] PROBLEM - cp28 Disk Space on cp28 is WARNING: DISK WARNING - free space: / 29842MiB (6% inode=99%); [00:04:04] RECOVERY - cp37 Disk Space on cp37 is OK: DISK OK - free space: / 20980MiB (23% inode=98%); [00:04:49] RECOVERY - cp36 Disk Space on cp36 is OK: DISK OK - free space: / 20962MiB (23% inode=98%); [00:09:02] [02CreateWiki] 07Universal-Omega closed pull request 03#479: Use modern maintenance functions and improve manageInactiveWikis - 13https://github.com/miraheze/CreateWiki/pull/479 [00:09:03] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±14] 13https://github.com/miraheze/CreateWiki/compare/980c6956d8bf...841350fc4c2e [00:09:06] [02miraheze/CreateWiki] 07Universal-Omega 03841350f - Use modern maintenance functions and improve manageInactiveWikis (#479) [00:33:04] miraheze/CreateWiki - Universal-Omega the build passed. [00:34:39] [02ManageWiki] 07Universal-Omega synchronize pull request 03#451: ToggleExtension: support running on all wikis at once - 13https://github.com/miraheze/ManageWiki/pull/451 [00:34:41] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03toggle-all [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/46fcbbb3d9cc...8731024180c7 [00:34:42] [02miraheze/ManageWiki] 07Universal-Omega 038731024 - Use MainConfigNames [00:35:13] [02ManageWiki] 07Universal-Omega closed pull request 03#451: ToggleExtension: support running on all wikis at once - 13https://github.com/miraheze/ManageWiki/pull/451 [00:35:16] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/a3f03eb34256...721fd38e1c1f [00:35:19] [02miraheze/ManageWiki] 07Universal-Omega 03721fd38 - ToggleExtension: support running on all wikis at once (#451) [00:35:22] [02miraheze/ManageWiki] 07Universal-Omega deleted branch 03toggle-all [00:35:25] [02ManageWiki] 07Universal-Omega deleted branch 03toggle-all - 13https://github.com/miraheze/ManageWiki [00:36:25] [02ManageWiki] 07Universal-Omega closed pull request 03#410: fix log spam - 13https://github.com/miraheze/ManageWiki/pull/410 [00:36:28] [02ManageWiki] 07Universal-Omega commented on pull request 03#410: fix log spam - 13https://github.com/miraheze/ManageWiki/pull/410#issuecomment-1967971593 [00:39:19] [02ManageWiki] 07Universal-Omega synchronize pull request 03#378: Warn if ManageWiki is locked - 13https://github.com/miraheze/ManageWiki/pull/378 [00:39:29] miraheze/ManageWiki - Universal-Omega the build passed. [00:39:37] miraheze/ManageWiki - Universal-Omega the build passed. [00:40:31] [02ManageWiki] 07Universal-Omega synchronize pull request 03#378: Warn if ManageWiki is locked - 13https://github.com/miraheze/ManageWiki/pull/378 [00:41:02] [02ManageWiki] 07Universal-Omega synchronize pull request 03#378: Warn if ManageWiki is locked - 13https://github.com/miraheze/ManageWiki/pull/378 [00:42:39] [02ManageWiki] 07Universal-Omega synchronize pull request 03#378: Warn if ManageWiki is locked - 13https://github.com/miraheze/ManageWiki/pull/378 [00:43:49] miraheze/ManageWiki - Universal-Omega the build passed. [00:44:57] miraheze/ManageWiki - Universal-Omega the build passed. [00:44:59] [02ManageWiki] 07Universal-Omega closed pull request 03#378: Warn if ManageWiki is locked - 13https://github.com/miraheze/ManageWiki/pull/378 [00:45:01] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/721fd38e1c1f...e0653dcc83ab [00:45:02] [02miraheze/ManageWiki] 07AgentIsai 03e0653dc - Warn if ManageWiki is locked (#378) [00:45:38] miraheze/ManageWiki - Universal-Omega the build passed. [00:46:59] miraheze/ManageWiki - Universal-Omega the build passed. [00:49:54] miraheze/ManageWiki - Universal-Omega the build passed. [01:16:17] [02ManageWiki] 07Universal-Omega commented on pull request 03#375: Warn/lock if in read-only - 13https://github.com/miraheze/ManageWiki/pull/375#issuecomment-1968009386 [01:21:21] [02CreateWiki] 07Universal-Omega closed pull request 03#470: CreateWikiJson: temporarily comment suppressWarnings - 13https://github.com/miraheze/CreateWiki/pull/470 [01:21:23] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03warnings [01:21:24] [02CreateWiki] 07Universal-Omega deleted branch 03warnings - 13https://github.com/miraheze/CreateWiki [01:24:28] [02CreateWiki] 07Universal-Omega closed pull request 03#414: Fix using CreateWikiAIThreshold in approve/decline functions - 13https://github.com/miraheze/CreateWiki/pull/414 [01:24:31] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03paladox-patch-1 [01:24:33] [02CreateWiki] 07Universal-Omega deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/CreateWiki [01:24:42] [02CreateWiki] 07Universal-Omega closed pull request 03#432: Use DeferredUpdates to generate wiki/database list - 13https://github.com/miraheze/CreateWiki/pull/432 [01:24:45] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03paladox-patch-2 [01:24:49] [02CreateWiki] 07Universal-Omega deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/CreateWiki [01:24:59] [02CreateWiki] 07Universal-Omega closed pull request 03#452: Fix tempname - 13https://github.com/miraheze/CreateWiki/pull/452 [01:24:59] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03paladox-patch-3 [01:25:00] [02CreateWiki] 07Universal-Omega deleted branch 03paladox-patch-3 - 13https://github.com/miraheze/CreateWiki [01:25:06] [02CreateWiki] 07Universal-Omega closed pull request 03#453: Add some logging if cache fails to write - 13https://github.com/miraheze/CreateWiki/pull/453 [01:25:08] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03paladox-patch-4 [01:25:11] [02CreateWiki] 07Universal-Omega deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/CreateWiki [01:28:06] [02dns] 07Universal-Omega closed pull request 03#494: wikitide.net: use nameservers from own records - 13https://github.com/miraheze/dns/pull/494 [01:28:08] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/f50f5f8f303c...ccc32af7d6a2 [01:28:09] [02miraheze/dns] 07Universal-Omega 03ccc32af - wikitide.net: use nameservers from own records (#494) [01:28:10] [02miraheze/dns] 07Universal-Omega deleted branch 03wikitide.net-ns [01:28:11] [02dns] 07Universal-Omega deleted branch 03wikitide.net-ns - 13https://github.com/miraheze/dns [01:29:03] [02mw-config] 07Universal-Omega commented on pull request 03#5410: Improvements to CW canned messages - 13https://github.com/miraheze/mw-config/pull/5410#issuecomment-1968021390 [01:29:24] [02mw-config] 07Universal-Omega commented on pull request 03#4971: Add DPE reasons - 13https://github.com/miraheze/mw-config/pull/4971#issuecomment-1968021691 [01:31:38] Thanks! And yeah the main thing I wanted review on was changing from Shell to runChild and rebuildrecentchanges [01:36:03] [02mw-config] 07Tali64 synchronize pull request 03#5410: Improvements to CW canned messages - 13https://github.com/miraheze/mw-config/pull/5410 [01:37:21] [02mw-config] 07Tali64 commented on pull request 03#5410: Improvements to CW canned messages - 13https://github.com/miraheze/mw-config/pull/5410#issuecomment-1968028871 [03:28:22] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 181.92 ms [03:34:29] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 177.60 ms [04:53:20] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=homevideowiki --no-updates homevideowiki_xml_bd3cd9c1180143dbb5df.xml.gz (START) [04:53:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:53:28] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=homevideowiki --no-updates homevideowiki_xml_bd3cd9c1180143dbb5df.xml.gz (END - exit=2) [04:53:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:53:39] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=homevideowiki --no-updates homevideowiki_xml_bd3cd9c1180143dbb5df.xml.gz (START) [04:53:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:54:47] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=homevideowiki . --search-recurisvely (START) [04:54:48] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=homevideowiki . --search-recurisvely (END - exit=256) [04:54:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:54:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:54:55] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=homevideowiki . --search-recursively (START) [04:54:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:00:22] [02miraheze/dns] 07AgentIsai pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/dns/compare/ccc32af7d6a2...b8f4c38cff38 [05:00:24] [02miraheze/dns] 07AgentIsai 03b8f4c38 - Add mwtask171 & homevideo redir [05:04:41] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=homevideowiki --no-updates homevideowiki_xml_bd3cd9c1180143dbb5df.xml.gz (END - exit=0) [05:04:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:05:34] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=homevideowiki . --search-recursively (END - exit=0) [05:05:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:06:21] [02miraheze/dns] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/b8f4c38cff38...89409eaad261 [05:06:23] [02miraheze/dns] 07AgentIsai 0389409ea - Add sherlockholmes.wt [05:07:59] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=homevideowiki (START) [05:08:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:10:53] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=homevideowiki (END - exit=0) [05:10:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:11:11] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=sherlockholmeswiki . --search-recursively (START) [05:11:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:15:45] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=sherlockholmeswiki --no-updates sherlockwiki_xml_98614b7559ab9118416d.xml.gz (START) [05:15:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:15:59] PROBLEM - ns2 Puppet on ns2 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[gdnsd-syntax] [05:20:43] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=sherlockholmeswiki --no-updates sherlockwiki_xml_98614b7559ab9118416d.xml.gz (END - exit=0) [05:20:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:25:39] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[gdnsd-syntax] [05:25:58] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=sherlockholmeswiki . --search-recursively (START) [05:26:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:05] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=sherlockholmeswiki . --search-recursively (END - exit=2) [05:26:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:18] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=sherlockholmeswiki . --search-recursively (START) [05:26:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:32] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=sherlockholmeswiki . --search-recursively (END - exit=0) [05:26:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:47] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 181.01 ms [05:28:49] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 195.04 ms [05:29:12] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=sherlockholmeswiki (START) [05:29:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:30:13] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=sherlockholmeswiki (END - exit=0) [05:30:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:33:29] [02miraheze/dns] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/89409eaad261...0a36c241a230 [05:33:30] [02miraheze/dns] 07AgentIsai 030a36c24 - Add newline [05:33:43] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:37:48] PROBLEM - ns1 Puppet on ns1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [05:38:43] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/edit.php --wiki=sherlockholmeswiki -s Revert to latest version -u MediaWiki_default -b -m --no-rc --bot (END - exit=256) [05:38:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:38:52] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/edit.php --wiki=sherlockholmeswiki Main_Page -s Revert to latest version -u MediaWiki_default -b -m --no-rc --bot (END - exit=256) [05:38:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:39:14] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/edit.php --wiki=sherlockholmeswiki Main_Page -s Revert to latest version -u MediaWiki_default -m --no-rc --bot (END - exit=0) [05:39:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:39:40] PROBLEM - cp28 Disk Space on cp28 is CRITICAL: DISK CRITICAL - free space: / 28996MiB (5% inode=99%); [05:44:09] RECOVERY - ns2 Puppet on ns2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:48:56] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=videocreditarchivewiki --no-updates videocreditarchivewiki_xml_8722e5f391288698b033.xml.gz (START) [05:48:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:54] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures [05:51:57] [02miraheze/dns] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/0a36c241a230...480562c12400 [05:52:00] [02miraheze/dns] 07AgentIsai 03480562c - Add videocreditarchive domain [05:53:25] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 192.21 ms [05:55:26] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 195.68 ms [06:07:20] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importDump.php --wiki=videocreditarchivewiki --no-updates videocreditarchivewiki_xml_8722e5f391288698b033.xml.gz (END - exit=0) [06:07:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:09:54] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=videocreditarchivewiki . --search-recursively (START) [06:09:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:10:16] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/importImages.php --wiki=videocreditarchivewiki . --search-recursively (END - exit=0) [06:10:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:13:39] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=videocreditarchivewiki (START) [06:13:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:04] !log [agent@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php /srv/mediawiki/1.41/maintenance/rebuildall.php --wiki=videocreditarchivewiki (END - exit=0) [06:16:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:55:38] PROBLEM - db171 Backups SQL on db171 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864127 seconds old and 94581 bytes [08:54:14] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 141.92 ms [08:58:20] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 153.10 ms [10:38:45] PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 153.68 ms [10:40:45] RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 147.96 ms [11:23:48] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 176.59 ms [11:25:50] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 190.70 ms [11:50:12] [02miraheze/YouTube] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 [+0/-0/±1] 13https://github.com/miraheze/YouTube/commit/14750b39828a [11:50:15] [02miraheze/YouTube] 07dependabot[bot] 0314750b3 - Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 [11:50:18] [02YouTube] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 - 13https://github.com/miraheze/YouTube [11:50:20] [02YouTube] 07dependabot[bot] labeled pull request 03#25: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/YouTube/pull/25 [11:50:22] [02YouTube] 07dependabot[bot] opened pull request 03#25: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/YouTube/pull/25 [11:51:56] miraheze/YouTube - dependabot[bot] the build has errored. [11:54:28] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 184.30 ms [12:04:43] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 181.97 ms [12:15:23] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:18:04] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 185.34 ms [12:20:06] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 199.47 ms [12:21:33] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [12:37:33] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 194.36 ms [12:39:35] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 189.43 ms [12:45:22] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [12:51:22] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp36.wikitide.net - CNAME OK [13:02:07] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 191.73 ms [13:04:09] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 192.99 ms [13:08:23] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 37%, RTA = 203.48 ms [13:14:31] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 201.27 ms [13:22:52] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 193.98 ms [13:24:54] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 190.03 ms [13:31:10] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 203.33 ms [13:33:11] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 201.93 ms [13:43:36] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 216.87 ms [13:45:19] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [13:49:48] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 204.70 ms [13:53:57] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 202.67 ms [14:00:06] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 203.98 ms [14:04:25] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 50%, RTA = 208.76 ms [14:11:08] [02miraheze/PDFEmbed] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/commit/b7fbd3934948 [14:11:09] [02miraheze/PDFEmbed] 07dependabot[bot] 03b7fbd39 - Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 [14:11:11] [02PDFEmbed] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 - 13https://github.com/miraheze/PDFEmbed [14:11:13] [02PDFEmbed] 07dependabot[bot] opened pull request 03#19: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/PDFEmbed/pull/19 [14:11:16] [02PDFEmbed] 07dependabot[bot] labeled pull request 03#19: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/PDFEmbed/pull/19 [14:12:37] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 210.36 ms [14:12:59] miraheze/PDFEmbed - dependabot[bot] the build has errored. [14:28:00] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 211.60 ms [14:34:09] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 217.30 ms [14:38:21] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 44%, RTA = 204.44 ms [14:48:35] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 209.04 ms [14:55:50] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 214.20 ms [14:59:55] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 227.91 ms [15:04:04] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 211.76 ms [15:08:08] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 210.24 ms [15:14:18] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 227.02 ms [15:30:40] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 208.16 ms [15:43:07] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 214.76 ms [15:47:13] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 209.95 ms [15:51:22] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 201.70 ms [15:53:24] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 204.21 ms [16:54:45] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 190.51 ms [17:07:02] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 203.40 ms [17:21:51] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/3486c7615138...7644e08413c5 [17:21:52] [02miraheze/puppet] 07Universal-Omega 037644e08 - varnish: remove matomo.miraheze.org [17:42:55] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 198.85 ms [17:44:57] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 196.20 ms [17:48:13] [02miraheze/YouTube] 07Universal-Omega pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 [+0/-0/±1] 13https://github.com/miraheze/YouTube/compare/14750b39828a...fb1025364731 [17:48:14] [02miraheze/YouTube] 07Universal-Omega 03fb10253 - Add allow-plugins [17:48:16] [02YouTube] 07Universal-Omega synchronize pull request 03#25: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/YouTube/pull/25 [17:48:52] [02miraheze/PDFEmbed] 07Universal-Omega pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/b7fbd3934948...1041525caf76 [17:48:54] [02miraheze/PDFEmbed] 07Universal-Omega 031041525 - Add allow-plugins [17:48:55] [02PDFEmbed] 07Universal-Omega synchronize pull request 03#19: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/PDFEmbed/pull/19 [17:52:49] miraheze/YouTube - Universal-Omega the build passed. [17:53:01] [02YouTube] 07Universal-Omega closed pull request 03#25: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/YouTube/pull/25 [17:53:04] [02miraheze/YouTube] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/YouTube/compare/30ac0fe8b5ea...144ec8ab46e1 [17:53:06] [02miraheze/YouTube] 07dependabot[bot] 03144ec8a - Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 (#25) [17:53:09] [02miraheze/YouTube] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 [17:53:09] miraheze/PDFEmbed - Universal-Omega the build passed. [17:53:10] [02YouTube] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 - 13https://github.com/miraheze/YouTube [17:53:22] [02PDFEmbed] 07Universal-Omega closed pull request 03#19: Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 - 13https://github.com/miraheze/PDFEmbed/pull/19 [17:53:23] [02miraheze/PDFEmbed] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/5dd6b3afd422...c1c42d0e2fa4 [17:53:25] [02miraheze/PDFEmbed] 07dependabot[bot] 03c1c42d0 - Update mediawiki/mediawiki-codesniffer requirement from 42.0.0 to 43.0.0 (#19) [17:53:27] [02miraheze/PDFEmbed] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 [17:53:28] [02PDFEmbed] 07Universal-Omega deleted branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-43.0.0 - 13https://github.com/miraheze/PDFEmbed [17:56:18] PROBLEM - ping6 on cp41 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 186.11 ms [17:57:37] miraheze/PDFEmbed - Universal-Omega the build passed. [17:57:42] miraheze/YouTube - Universal-Omega the build passed. [18:01:17] PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 157.56 ms [18:04:29] RECOVERY - ping6 on cp41 is OK: PING OK - Packet loss = 0%, RTA = 176.46 ms [18:05:17] RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 148.04 ms [18:09:03] [02miraheze/puppet] 07AgentIsai pushed 031 commit to 03master [+1/-0/±2] 13https://github.com/miraheze/puppet/compare/7644e08413c5...dc866a7a5fb8 [18:09:06] [02miraheze/puppet] 07AgentIsai 03dc866a7 - Provision mwtask171 [18:17:42] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03InitEditCount [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/e20e24fc0165 [18:17:46] [02miraheze/ImportDump] 07Universal-Omega 03e20e24f - ImportDumpJob: run InitEditCount as well [18:17:49] [02ImportDump] 07Universal-Omega created branch 03InitEditCount - 13https://github.com/miraheze/ImportDump [18:17:52] [02ImportDump] 07Universal-Omega opened pull request 03#73: ImportDumpJob: run InitEditCount as well - 13https://github.com/miraheze/ImportDump/pull/73 [18:26:45] miraheze/ImportDump - Universal-Omega the build passed. [18:28:52] !log [universalomega@mwtask181] sudo -u www-data php /srv/mediawiki/1.41/maintenance/run.php InitEditCount --wiki=rosettacodewiki (END - exit=0) [18:28:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:30:49] [02ImportDump] 07Universal-Omega closed pull request 03#73: ImportDumpJob: run InitEditCount as well - 13https://github.com/miraheze/ImportDump/pull/73 [18:30:52] [02miraheze/ImportDump] 07Universal-Omega deleted branch 03InitEditCount [18:30:54] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/7cc98444b1d3...e2f80b676765 [18:30:56] [02miraheze/ImportDump] 07Universal-Omega 03e2f80b6 - ImportDumpJob: run InitEditCount as well (#73) [18:30:57] [02ImportDump] 07Universal-Omega deleted branch 03InitEditCount - 13https://github.com/miraheze/ImportDump [18:39:32] miraheze/ImportDump - Universal-Omega the build passed. [18:43:55] [02mw-config] 07songnguxyz opened pull request 03#5493: Update LocalSettings.php for lhmnwiki - 13https://github.com/miraheze/mw-config/pull/5493 [18:44:46] miraheze/mw-config - songnguxyz the build passed. [18:47:48] PROBLEM - mwtask171 Puppet on mwtask171 is CRITICAL: CRITICAL: Puppet has 6 failures. Last run 3 minutes ago with 6 failures. Failed resources (up to 3 shown): Exec[MediaWiki Config Sync],Exec[Landing Sync],File[/srv/mediawiki/1.41/skins/Femiwiki/node_modules],Service[cgroup] [18:47:58] PROBLEM - mwtask171 HTTPS on mwtask171 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/2 403 [18:48:42] PROBLEM - mwtask171 MediaWiki Rendering on mwtask171 is UNKNOWN: HTTP UNKNOWN: Failed to unchunk message body [18:49:45] [02mw-config] 07Universal-Omega closed pull request 03#5493: Update LocalSettings.php for lhmnwiki - 13https://github.com/miraheze/mw-config/pull/5493 [18:49:46] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/5ef8a94cae81...c4cf08b3fdf1 [18:49:47] [02miraheze/mw-config] 07songnguxyz 03c4cf08b - Update LocalSettings.php for lhmnwiki (#5493) [18:50:51] miraheze/mw-config - Universal-Omega the build passed. [19:02:12] !log [@mwtask181] starting deploy of {'config': True} to all [19:02:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:21] !log [@mwtask181] finished deploy of {'config': True} to all - SUCCESS in 9s [19:02:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:18:15] [02puppet] 07dependabot[bot] created branch 03dependabot/bundler/modules/graylog/yard-0.9.35 - 13https://github.com/miraheze/puppet [19:18:17] [02miraheze/puppet] 07dependabot[bot] pushed 031 commit to 03dependabot/bundler/modules/graylog/yard-0.9.35 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/da02914a59d2 [19:18:19] [02miraheze/puppet] 07dependabot[bot] 03da02914 - build(deps-dev): bump yard from 0.9.34 to 0.9.35 in /modules/graylog [19:18:21] [02puppet] 07dependabot[bot] labeled pull request 03#3766: build(deps-dev): bump yard from 0.9.34 to 0.9.35 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3766 [19:18:22] [02puppet] 07dependabot[bot] opened pull request 03#3766: build(deps-dev): bump yard from 0.9.34 to 0.9.35 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3766 [19:18:23] [02puppet] 07dependabot[bot] labeled pull request 03#3766: build(deps-dev): bump yard from 0.9.34 to 0.9.35 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3766 [19:21:16] PROBLEM - ping6 on cp28 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 153.86 ms [19:22:02] PROBLEM - wiki.kingmingshrimp.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.kingmingshrimp.com' expires in 15 day(s) (Fri 15 Mar 2024 07:05:57 PM GMT +0000). [19:22:14] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/eacf9e63fb7b...16a6670a664a [19:22:16] [02miraheze/ssl] 07MirahezeSSLBot 0316a6670 - Bot: Update SSL cert for wiki.kingmingshrimp.com [19:23:19] RECOVERY - ping6 on cp28 is OK: PING OK - Packet loss = 0%, RTA = 148.52 ms [19:35:21] [02puppet] 07Universal-Omega closed pull request 03#3766: build(deps-dev): bump yard from 0.9.34 to 0.9.35 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3766 [19:35:24] [02miraheze/puppet] 07Universal-Omega deleted branch 03dependabot/bundler/modules/graylog/yard-0.9.35 [19:35:26] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/dc866a7a5fb8...c1339a335320 [19:35:29] [02miraheze/puppet] 07dependabot[bot] 03c1339a3 - build(deps-dev): bump yard from 0.9.34 to 0.9.35 in /modules/graylog (#3766) [19:35:30] [02puppet] 07Universal-Omega deleted branch 03dependabot/bundler/modules/graylog/yard-0.9.35 - 13https://github.com/miraheze/puppet [19:36:01] [02miraheze/puppet] 07dependabot[bot] pushed 031 commit to 03dependabot/bundler/modules/graylog/bolt-3.28.0 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/b20d44a07502 [19:36:04] [02miraheze/puppet] 07dependabot[bot] 03b20d44a - build(deps-dev): bump bolt from 3.27.1 to 3.28.0 in /modules/graylog [19:36:06] [02puppet] 07dependabot[bot] created branch 03dependabot/bundler/modules/graylog/bolt-3.28.0 - 13https://github.com/miraheze/puppet [19:36:08] [02puppet] 07dependabot[bot] opened pull request 03#3767: build(deps-dev): bump bolt from 3.27.1 to 3.28.0 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3767 [19:36:10] [02puppet] 07dependabot[bot] labeled pull request 03#3767: build(deps-dev): bump bolt from 3.27.1 to 3.28.0 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3767 [19:36:11] [02puppet] 07dependabot[bot] labeled pull request 03#3767: build(deps-dev): bump bolt from 3.27.1 to 3.28.0 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3767 [19:40:16] [02puppet] 07Universal-Omega closed pull request 03#3767: build(deps-dev): bump bolt from 3.27.1 to 3.28.0 in /modules/graylog - 13https://github.com/miraheze/puppet/pull/3767 [19:40:18] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/c1339a335320...7dcfb0a1155e [19:40:19] [02miraheze/puppet] 07dependabot[bot] 037dcfb0a - build(deps-dev): bump bolt from 3.27.1 to 3.28.0 in /modules/graylog (#3767) [19:40:22] [02miraheze/puppet] 07Universal-Omega deleted branch 03dependabot/bundler/modules/graylog/bolt-3.28.0 [19:40:24] [02puppet] 07Universal-Omega deleted branch 03dependabot/bundler/modules/graylog/bolt-3.28.0 - 13https://github.com/miraheze/puppet [19:42:22] PROBLEM - cp28 Puppet on cp28 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [19:51:51] RECOVERY - wiki.kingmingshrimp.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.kingmingshrimp.com' will expire on Tue 28 May 2024 06:22:08 PM GMT +0000. [20:00:54] PROBLEM - wiki.oasismp.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.oasismp.com' expires in 15 day(s) (Fri 15 Mar 2024 07:30:11 PM GMT +0000). [20:02:45] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/16a6670a664a...81f85bfbaccf [20:02:47] [02miraheze/ssl] 07MirahezeSSLBot 0381f85bf - Bot: Update SSL cert for wiki.oasismp.com [20:10:08] RECOVERY - cp28 Puppet on cp28 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:29:55] RECOVERY - wiki.oasismp.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.oasismp.com' will expire on Tue 28 May 2024 07:01:00 PM GMT +0000. [22:25:48] [02miraheze/dns] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/480562c12400...d41fcca0d1fb [22:25:51] [02miraheze/dns] 07Universal-Omega 03d41fcca - Depool lu [23:32:41] [02puppet] 07Universal-Omega opened pull request 03#3768: Add strongswan (ipsec) module - 13https://github.com/miraheze/puppet/pull/3768