[00:01:20] RECOVERY - speedscope211 Check unit status of speedscope_hourly_aggregation on speedscope211 is OK: OK: Status of the systemd unit speedscope_hourly_aggregation [00:01:45] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/c1c85fad0493f792663dac8ea000c83adf2118e6 [00:01:45] 02statichelp/03main 07WikiTideBot 03c1c85fa Bot: Auto-update Tech namespace pages 2026-08-24 00:01:42 [00:15:26] [02puppet] 07Universal-Omega created 03beta-nftables (+1 new commit) 13https://github.com/miraheze/puppet/commit/dd9115cbaea5 [00:15:28] [02puppet] 07Universal-Omega opened pull request #4919: mediawiki_beta: include nftables (03main...03beta-nftables) 13https://github.com/miraheze/puppet/pull/4919 [00:15:32] 02puppet/03beta-nftables 07CosmicAlpha 03dd9115c mediawiki_beta: include nftables [00:15:49] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.011 second response time [00:15:52] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [00:16:24] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [00:17:03] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[docker],Exec[docker-compose-speedscope-up -d] [00:17:47] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/b0eded3c00f550f5641a77790ed50de0cd1690f2 [00:17:49] 02puppet/03main 07CosmicAlpha 03b0eded3 mediawiki_beta: include nftables [00:17:51] [02puppet] 07Universal-Omega merged pull request #4919: mediawiki_beta: include nftables (03main...03beta-nftables) 13https://github.com/miraheze/puppet/pull/4919 [00:17:53] [02puppet] 07Universal-Omega 04deleted 03beta-nftables at 03dd9115c 13https://api.github.com/repos/miraheze/puppet/commit/dd9115c [00:30:02] miraheze/puppet - Universal-Omega the build passed. [00:30:47] !log [universalomega@test151] starting deploy of {'versions': '1.46', 'upgrade_extensions': 'CreateWiki'} to test151 [00:30:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:32:27] PROBLEM - speedscope211 Check unit status of speedscope_daily_aggregation on speedscope211 is CRITICAL: CRITICAL: Status of the systemd unit speedscope_daily_aggregation [00:42:55] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures [00:43:33] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [00:43:39] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.022 second response time [00:43:42] [02puppet] 07Universal-Omega pushed 1 new commit to 03mwdeploy-cleanup 13https://github.com/miraheze/puppet/commit/c9540f74292f54972cd8e3cf51ea5a00ab95e577 [00:43:42] 02puppet/03mwdeploy-cleanup 07CosmicAlpha 03c9540f7 Only run RebuildVersionCache once. [00:44:18] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.162 second response time [00:45:18] miraheze/puppet - Universal-Omega the build passed. [00:48:46] [02puppet] 07Universal-Omega merged pull request #4813: mwdeploy: reduce duplication for upgrading extensions and skins (03main...03mwdeploy-cleanup) 13https://github.com/miraheze/puppet/pull/4813 [00:48:46] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/98be17f68c95c6f45864b9551cb780ab8d955351 [00:48:48] 02puppet/03main 07CosmicAlpha 0398be17f mwdeploy: reduce duplication for upgrading extensions and skins… [00:48:50] [02puppet] 07Universal-Omega 04deleted 03mwdeploy-cleanup at 03c9540f7 13https://api.github.com/repos/miraheze/puppet/commit/c9540f7 [00:50:28] miraheze/puppet - Universal-Omega the build passed. [00:50:40] [02puppet] 07Universal-Omega closed pull request #4402: mwdeploy: update gitinfo on --upgrade-{extensions,skins} (03main...03RhinosF1-patch-1) 13https://github.com/miraheze/puppet/pull/4402 [00:50:41] [02puppet] 07Universal-Omega commented on pull request #4402: Done as part of #4813 13https://github.com/miraheze/puppet/pull/4402#issuecomment-5389486034 [00:50:46] [02puppet] 07Universal-Omega 04deleted 03RhinosF1-patch-1 at 03a5719cb 13https://api.github.com/repos/miraheze/puppet/commit/a5719cb [00:52:29] PROBLEM - puppet181 Check unit status of git_pull_puppet on puppet181 is CRITICAL: CRITICAL: Status of the systemd unit git_pull_puppet [00:55:26] [02puppet] 07Universal-Omega readied pull request #4851: Beta: switch default version to 1.46 (07miraheze:03main...07YTFGolf:03patch-2) 13https://github.com/miraheze/puppet/pull/4851 [00:55:42] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/065e54bc3f4240bb60ec1fb1a909fd42cd62b926 [00:55:42] 02puppet/03main 07WWR 03065e54b Beta: switch default version to 1.46 (#4851) [00:55:43] [02puppet] 07Universal-Omega merged 07YTFGolf's pull request #4851: Beta: switch default version to 1.46 (07miraheze:03main...07YTFGolf:03patch-2) 13https://github.com/miraheze/puppet/pull/4851 [00:58:07] PROBLEM - cp201 Disk Space on cp201 is WARNING: DISK WARNING - free space: / 44613MiB (9.8% inode=100%); [01:00:13] RECOVERY - puppet181 Check unit status of git_pull_puppet on puppet181 is OK: OK: Status of the systemd unit git_pull_puppet [01:02:07] RECOVERY - cp201 Disk Space on cp201 is OK: DISK OK - free space: / 87521MiB (19.3% inode=100%); [01:03:01] [02puppet] 07Universal-Omega created 03mwdeploy-rework (+1 new commit) 13https://github.com/miraheze/puppet/commit/ecacb32c2537 [01:03:02] 02puppet/03mwdeploy-rework 07CosmicAlpha 03ecacb32 Massive rework to mwdeploy… [01:03:08] [02puppet] 07Universal-Omega opened pull request #4920: Massive rework to mwdeploy (03main...03mwdeploy-rework) 13https://github.com/miraheze/puppet/pull/4920 [01:04:23] miraheze/puppet - Universal-Omega the build has errored. [01:05:26] [02puppet] 07Universal-Omega pushed 1 new commit to 03mwdeploy-rework 13https://github.com/miraheze/puppet/commit/0432f66cb9e2ffbfbc0f96a7b91b08438f820399 [01:05:26] 02puppet/03mwdeploy-rework 07CosmicAlpha 030432f66 Add tests [01:06:46] miraheze/puppet - Universal-Omega the build has errored. [01:09:45] PROBLEM - mwtask181 Puppet on mwtask181 is WARNING: WARNING: Puppet is currently disabled, message: Universal Omega, last run 6 minutes ago with 0 failures [01:09:50] [02puppet] 07Universal-Omega pushed 1 new commit to 03mwdeploy-rework 13https://github.com/miraheze/puppet/commit/36f4737ad9e0ccd9d0c7eb8bec6d855b6993fd58 [01:09:50] 02puppet/03mwdeploy-rework 07CosmicAlpha 0336f4737 Fix [01:11:02] miraheze/puppet - Universal-Omega the build has errored. [01:11:29] [02puppet] 07Universal-Omega pushed 1 new commit to 03mwdeploy-rework 13https://github.com/miraheze/puppet/commit/e4f25f596bb058332e09acde5a905e7dac59f3c5 [01:11:29] 02puppet/03mwdeploy-rework 07CosmicAlpha 03e4f25f5 Fix [01:15:37] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.010 second response time [01:16:16] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[docker],Exec[docker-compose-speedscope-up -d] [01:16:17] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [01:17:01] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [01:18:45] [02puppet] 07Universal-Omega pushed 1 new commit to 03mwdeploy-rework 13https://github.com/miraheze/puppet/commit/d2a96d6fb79bc15d658bc97048d75a8a021ec16b [01:18:45] 02puppet/03mwdeploy-rework 07CosmicAlpha 03d2a96d6 Fix [01:20:04] miraheze/puppet - Universal-Omega the build has errored. [01:23:25] [02puppet] 07Universal-Omega pushed 1 new commit to 03mwdeploy-rework 13https://github.com/miraheze/puppet/commit/f308f1352c1c5118c37a559dab6c98719135a2b8 [01:23:25] 02puppet/03mwdeploy-rework 07CosmicAlpha 03f308f13 Fix [01:25:06] miraheze/puppet - Universal-Omega the build has errored. [01:37:37] [02puppet] 07Universal-Omega pushed 1 new commit to 03mwdeploy-rework 13https://github.com/miraheze/puppet/commit/1fc49d444606ea09bbcbc028c77bf1f0db2e785b [01:37:37] 02puppet/03mwdeploy-rework 07CosmicAlpha 031fc49d4 Fixes [01:39:05] miraheze/puppet - Universal-Omega the build has errored. [01:44:17] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.166 second response time [01:44:58] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [01:45:37] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.016 second response time [01:45:46] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:48:44] [02puppet] 07Universal-Omega pushed 1 new commit to 03mwdeploy-rework 13https://github.com/miraheze/puppet/commit/1d776798cb3349abf11a6395df9941e7a10cedc5 [01:48:44] 02puppet/03mwdeploy-rework 07CosmicAlpha 031d77679 Update [01:50:06] miraheze/puppet - Universal-Omega the build has errored. [01:50:37] [02puppet] 07Universal-Omega pushed 1 new commit to 03mwdeploy-rework 13https://github.com/miraheze/puppet/commit/e66e83c9c35edaa36923d0cfbc372c591eb0dedb [01:50:37] 02puppet/03mwdeploy-rework 07CosmicAlpha 03e66e83c Update [01:52:14] miraheze/puppet - Universal-Omega the build passed. [01:55:48] !log [universalomega@test151] starting deploy of {'pr': 6506, 'pr_repo': 'config', 'config': True} to test151 [01:55:49] !log [universalomega@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [01:55:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:55:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:56:39] !log [universalomega@test151] starting deploy of {'pr': 6506, 'pr_repo': 'config', 'config': True} to test151 [01:56:40] !log [universalomega@test151] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [01:56:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:56:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:57:01] !log [universalomega@test151] starting deploy of {'pr': 6506, 'pr_repo': 'config', 'config': True} to test151 [01:57:02] !log [universalomega@test151] finished deploy of {'pr': 6506, 'pr_repo': 'config', 'config': True} to test151 - SUCCESS in 1s [01:57:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:57:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:57:59] @abaddriverlol re https://issue-tracker.miraheze.org/T13932 [02:01:26] RECOVERY - mwtask181 Puppet on mwtask181 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [02:15:37] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.009 second response time [02:15:47] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[docker],Exec[docker-compose-speedscope-up -d] [02:16:17] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.012 second response time [02:16:21] miraheze/CreateWiki - Universal-Omega the build passed. [02:16:58] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [02:21:22] [02puppet] 07Universal-Omega created 03openai-config (+1 new commit) 13https://github.com/miraheze/puppet/commit/671f3fdf77a8 [02:21:22] 02puppet/03openai-config 07CosmicAlpha 03671f3fd Update OpenAI config [02:21:29] [02puppet] 07Universal-Omega opened pull request #4921: Update OpenAI config (03main...03openai-config) 13https://github.com/miraheze/puppet/pull/4921 [02:22:42] [02puppet] 07Universal-Omega pushed 1 new commit to 03openai-config 13https://github.com/miraheze/puppet/commit/e1a01cc31f4eb5dabec047a21a80f6124de4d393 [02:22:43] 02puppet/03openai-config 07CosmicAlpha 03e1a01cc Update [02:33:45] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/19587b4ead21d5f82383f9d97ecc86bed019f660 [02:33:45] 02mw-config/03main 07CosmicAlpha 0319587b4 Proxy SMTP through bastion [02:33:45] [02mw-config] 07Universal-Omega merged pull request #6506: Proxy SMTP through bastion (03main...03smtp-bastion) 13https://github.com/miraheze/mw-config/pull/6506 [02:33:47] [02mw-config] 07Universal-Omega 04deleted 03smtp-bastion at 0348daaf6 13https://api.github.com/repos/miraheze/mw-config/commit/48daaf6 [02:34:28] !log [universalomega@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [02:34:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:34:55] !log [universalomega@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 27s [02:34:58] [02puppet] 07Universal-Omega merged pull request #4917: Set relayhost to bastion on all servers (03main...03relayhost-bastion) 13https://github.com/miraheze/puppet/pull/4917 [02:34:58] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/9e3b373821d573440132b459b055333481d56bb2 [02:34:58] 02puppet/03main 07CosmicAlpha 039e3b373 Set relayhost to bastion on all servers [02:34:59] miraheze/mw-config - Universal-Omega the build passed. [02:34:59] [02puppet] 07Universal-Omega 04deleted 03relayhost-bastion at 03248f148 13https://api.github.com/repos/miraheze/puppet/commit/248f148 [02:35:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:39:37] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.023 second response time [02:39:46] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [02:40:17] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.166 second response time [02:40:58] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [02:44:58] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [02:45:37] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.009 second response time [02:45:47] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[docker],Exec[docker-compose-speedscope-up -d] [02:46:17] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [03:03:44] PROBLEM - speedscope211 Check unit status of speedscope_hourly_aggregation on speedscope211 is CRITICAL: CRITICAL: Status of the systemd unit speedscope_hourly_aggregation [03:13:46] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 2 seconds ago with 0 failures [03:14:17] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.167 second response time [03:14:58] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [03:15:37] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.016 second response time [03:44:58] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [03:45:37] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.010 second response time [03:45:47] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[docker],Exec[docker-compose-speedscope-up -d] [03:46:17] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.013 second response time [03:46:56] [02mw-config] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/mw-config/commit/5d57eb1862a160e43f9645a9930b5763b09d3e41 [03:46:56] 02mw-config/03main 07CosmicAlpha 035d57eb1 Use $wi->isBeta() [04:12:58] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [04:13:37] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.022 second response time [04:13:46] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [04:14:17] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.175 second response time [04:22:40] [02puppet] 07Universal-Omega pushed 1 new commit to 03ntp-11.1.0 13https://github.com/miraheze/puppet/commit/5d0047374ade8c94181a06167cd68f38c1559960 [04:22:41] 02puppet/03ntp-11.1.0 07CosmicAlpha 035d00473 Merge branch 'main' into ntp-11.1.0 [04:23:45] [02puppet] 07Universal-Omega merged pull request #4762: Update ntp module to 11.1.0 (03main...03ntp-11.1.0) 13https://github.com/miraheze/puppet/pull/4762 [04:23:46] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/b8ad5e5bac2baec12a17c772af40245fc33f6c6c [04:23:46] 02puppet/03main 07CosmicAlpha 03b8ad5e5 Update ntp module to 11.1.0 [04:23:46] [02puppet] 07Universal-Omega 04deleted 03ntp-11.1.0 at 035d00473 13https://api.github.com/repos/miraheze/puppet/commit/5d00473 [04:33:55] [02puppet] 07Universal-Omega created 03chrony (+1 new commit) 13https://github.com/miraheze/puppet/commit/8dd7efb36981 [04:33:55] 02puppet/03chrony 07CosmicAlpha 038dd7efb Add chrony module [04:34:08] [02puppet] 07Universal-Omega opened pull request #4922: Add chrony module (03main...03chrony) 13https://github.com/miraheze/puppet/pull/4922 [04:39:50] [02puppet] 07Universal-Omega merged pull request #4922: Add chrony module (03main...03chrony) 13https://github.com/miraheze/puppet/pull/4922 [04:39:52] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/bbd0864f3cfc7b5c5a47e7e254c80a8b32a4d575 [04:39:54] [02puppet] 07Universal-Omega 04deleted 03chrony at 038dd7efb 13https://api.github.com/repos/miraheze/puppet/commit/8dd7efb [04:39:55] 02puppet/03main 07CosmicAlpha 03bbd0864 Add chrony module… [04:44:58] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [04:45:37] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.010 second response time [04:45:47] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[docker],Exec[docker-compose-speedscope-up -d] [04:46:17] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.010 second response time [05:00:17] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/e49760baa29ff6b188ff965c80916fc1d410aefd [05:00:18] 02ssl/03main 07WikiTideBot 03e49760b Bot: Auto-update domain lists [05:13:37] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.022 second response time [05:13:46] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 12 seconds ago with 0 failures [05:14:17] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.175 second response time [05:14:58] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [05:40:26] [02puppet] 07Universal-Omega created 03use-chrony (+1 new commit) 13https://github.com/miraheze/puppet/commit/ca17a8ff0b91 [05:40:26] 02puppet/03use-chrony 07CosmicAlpha 03ca17a8f Migrate ntpsec to chrony [05:40:40] [02puppet] 07Universal-Omega opened pull request #4923: Migrate ntpsec to chrony (03main...03use-chrony) 13https://github.com/miraheze/puppet/pull/4923 [05:46:17] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [05:46:37] PROBLEM - bast181 ntp peers on bast181 is CRITICAL: NTP CRITICAL: No response from NTP server [05:46:58] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [05:51:38] [02puppet] 07Universal-Omega pushed 1 new commit to 03use-chrony 13https://github.com/miraheze/puppet/commit/17e7788e5bb2eb7f3297dae035e53b9d99bd69ac [05:51:38] 02puppet/03use-chrony 07CosmicAlpha 0317e7788 Fix monitoring [05:55:53] [02puppet] 07Universal-Omega pushed 1 new commit to 03use-chrony 13https://github.com/miraheze/puppet/commit/5b637aa1b83a34c27a5e4efed156e0f1e1e04d6e [05:55:54] 02puppet/03use-chrony 07CosmicAlpha 035b637aa Fix [05:58:54] [02puppet] 07Universal-Omega pushed 1 new commit to 03use-chrony 13https://github.com/miraheze/puppet/commit/13f8bee95f380c5257b0904715ee3aa58d5bf734 [05:58:54] 02puppet/03use-chrony 07CosmicAlpha 0313f8bee Update [06:02:46] [02puppet] 07Universal-Omega pushed 1 new commit to 03use-chrony 13https://github.com/miraheze/puppet/commit/a677acb1790c0d4ca242afc42ca3a491cf67abf2 [06:02:46] 02puppet/03use-chrony 07CosmicAlpha 03a677acb Absent [06:14:47] !log stop ircecho on mon181 [06:14:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:22:36] PROBLEM - test151 chrony on test151 is WARNING: chrony stratum too high: 4 > 3 [06:22:36] PROBLEM - mon181 chrony on mon181 is WARNING: chrony stratum too high: 4 > 3 [06:22:37] PROBLEM - mw161 chrony on mw161 is UNKNOWN: NRPE: Command 'check_chrony' not defined [06:22:40] PROBLEM - swiftobject201 chrony on swiftobject201 is WARNING: chrony stratum too high: 4 > 3 [06:22:41] PROBLEM - mem191 chrony on mem191 is WARNING: chrony stratum too high: 4 > 3 [06:22:43] PROBLEM - mw183 chrony on mw183 is WARNING: chrony stratum too high: 4 > 3 [06:22:48] PROBLEM - os202 chrony on os202 is WARNING: chrony stratum too high: 4 > 3 [06:26:16] [02puppet] 07Universal-Omega pushed 1 new commit to 03use-chrony 13https://github.com/miraheze/puppet/commit/46d913eed3f6a6c2acb39a4233c767f82f074b6b [06:26:16] 02puppet/03use-chrony 07CosmicAlpha 0346d913e stratum limit [06:42:10] [02puppet] 07Universal-Omega pushed 1 new commit to 03use-chrony 13https://github.com/miraheze/puppet/commit/153d3c3883d1d2ec16e6adc7645fd3e06d02a666 [06:42:10] 02puppet/03use-chrony 07CosmicAlpha 03153d3c3 - [06:42:26] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/8ab58d7b69cd3689d3646828e78899de8fd89840 [06:42:26] 02puppet/03main 07CosmicAlpha 038ab58d7 Migrate ntpsec to chrony [06:42:26] [02puppet] 07Universal-Omega merged pull request #4923: Migrate ntpsec to chrony (03main...03use-chrony) 13https://github.com/miraheze/puppet/pull/4923 [06:42:27] [02puppet] 07Universal-Omega 04deleted 03use-chrony at 03153d3c3 13https://api.github.com/repos/miraheze/puppet/commit/153d3c3 [06:43:30] RECOVERY - mon181 IRCEcho on mon181 is OK: PROCS OK: 1 process with args '/usr/local/bin/ircecho' [06:43:37] !log start ircecho on mon181 [06:43:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:44:13] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [06:45:04] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.009 second response time [06:45:37] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[docker],Exec[docker-compose-speedscope-up -d] [06:45:38] [02puppet] 07Universal-Omega created 03remove-ntp (+1 new commit) 13https://github.com/miraheze/puppet/commit/29ff98f20de9 [06:45:38] 02puppet/03remove-ntp 07CosmicAlpha 0329ff98f Remove ntp module… [06:45:45] [02puppet] 07Universal-Omega opened pull request #4924: Remove ntp module (03main...03remove-ntp) 13https://github.com/miraheze/puppet/pull/4924 [06:45:50] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [06:45:54] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [06:46:10] [02puppet] 07Universal-Omega merged pull request #4924: Remove ntp module (03main...03remove-ntp) 13https://github.com/miraheze/puppet/pull/4924 [06:46:12] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/faa872ea3afd17115481d0ae78f14334d32bf1c1 [06:46:14] [02puppet] 07Universal-Omega 04deleted 03remove-ntp at 0329ff98f 13https://api.github.com/repos/miraheze/puppet/commit/29ff98f [06:46:14] 02puppet/03main 07CosmicAlpha 03faa872e Remove ntp module… [06:56:03] @cosmicalpha looking at phorge recent activity is funny rn [07:00:26] hmm? [07:00:45] just a lot of commits [07:01:05] oh yeah lol. [07:01:27] I am doing everything I had planned for like over a year... in a single day lol [07:01:38] wow [07:02:04] I still understand squat about puppet so [07:02:58] anything noteworthy for public knowledge? [07:03:09] pulls out notepad for Miraheze Monthly [07:03:36] Not really, other than speedscope. The other changes were internal modernization. [07:03:47] aight [07:04:49] I have changed about 15k lines today alone in puppet lol. [07:06:06] you what [07:14:28] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.022 second response time [07:14:49] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [07:15:19] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.157 second response time [07:15:26] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:18:09] insert SpongeBob SquarePants GIF of that fish saying the same thing here [07:46:04] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.009 second response time [07:46:44] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [07:46:49] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [07:47:26] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[docker],Exec[docker-compose-speedscope-up -d] [08:13:26] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 4 seconds ago with 0 failures [08:14:04] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.025 second response time [08:14:15] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.171 second response time [08:14:49] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [08:46:04] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.010 second response time [08:46:04] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.018 second response time [08:46:49] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [08:47:26] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[docker],Exec[docker-compose-speedscope-up -d] [09:14:04] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.023 second response time [09:14:04] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.158 second response time [09:14:49] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [09:15:26] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [09:30:18] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/ff4854e98a287503fbab14e59e141a766a686974 [09:30:18] 02ssl/03main 07WikiTideBot 03ff4854e Bot: Auto-update domain lists [11:23:52] [02puppet] 07SomeMWDev created 03docker-require-service (+1 new commit) 13https://github.com/miraheze/puppet/commit/f097909ec661 [11:23:52] 02puppet/03docker-require-service 07SomeRandomDeveloper 03f097909 docker: require docker service before running docker compose [11:24:00] [02puppet] 07SomeMWDev opened pull request #4925: docker: require docker service before running docker compose (03main...03docker-require-service) 13https://github.com/miraheze/puppet/pull/4925 [11:25:10] [02puppet] 07SomeMWDev merged pull request #4925: docker: require docker service before running docker compose (03main...03docker-require-service) 13https://github.com/miraheze/puppet/pull/4925 [11:25:10] [02puppet] 07SomeMWDev pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/b90b6a3f097e31676ba19726ca19a246c1ff2d5e [11:25:10] 02puppet/03main 07SomeRandomDeveloper 03b90b6a3 docker: require docker service before running docker compose (#4925) [11:25:12] [02puppet] 07SomeMWDev 04deleted 03docker-require-service at 03f097909 13https://api.github.com/repos/miraheze/puppet/commit/f097909 [11:28:46] RECOVERY - speedscope211 Check unit status of speedscope_hourly_aggregation on speedscope211 is OK: OK: Status of the systemd unit speedscope_hourly_aggregation [11:29:03] RECOVERY - speedscope211 Check unit status of speedscope_daily_aggregation on speedscope211 is OK: OK: Status of the systemd unit speedscope_daily_aggregation [11:33:32] very cool, thanks! [11:45:09] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [11:45:17] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.010 second response time [11:45:26] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [11:47:26] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[docker] [11:50:23] [02CreateWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/56472bec258dd7a0a83119a07007a5990cf9e530 [11:50:23] 02CreateWiki/03main 07translatewiki.net 0356472be Localisation updates from https://translatewiki.net. [11:50:25] [02DiscordNotifications] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/DiscordNotifications/commit/bc732f8253cbf0092b7921181bd41b321cf029ca [11:50:25] 02DiscordNotifications/03main 07translatewiki.net 03bc732f8 Localisation updates from https://translatewiki.net. [11:50:27] [02ErrorPages] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ErrorPages/commit/dbca29342c5687453b86b94924e265cb47832ee6 [11:50:28] 02ErrorPages/03main 07translatewiki.net 03dbca293 Localisation updates from https://translatewiki.net. [11:50:30] [02DataDump] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/DataDump/commit/37ba7876bc171ca29934ff06740caad02a5b39bd [11:50:32] [02GlobalNewFiles] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/GlobalNewFiles/commit/b0f098540c1baf2d25c7d670f7745758f7c43737 [11:50:34] [02ImportDump] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ImportDump/commit/cb33e0a8a0b965cae88be97c46f88bcbeb273db4 [11:50:36] 02DataDump/03main 07translatewiki.net 0337ba787 Localisation updates from https://translatewiki.net. [11:50:38] [02landing] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/landing/commit/a54db7e206d133664a7d43a4c197676be5324042 [11:50:39] 02GlobalNewFiles/03main 07translatewiki.net 03b0f0985 Localisation updates from https://translatewiki.net. [11:50:41] [02MatomoAnalytics] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MatomoAnalytics/commit/388a90891713013ff9c8ac14106623527078797b [11:50:43] 02ImportDump/03main 07translatewiki.net 03cb33e0a Localisation updates from https://translatewiki.net. [11:50:45] [02PDFEmbed] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/PDFEmbed/commit/9a6f0b0dd9c7c3d6e302a381475a525599775cb7 [11:50:47] [02MirahezeMagic] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/43504a72e82056db33d3891e2b1b1cdfde499a11 [11:50:49] [02ManageWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ManageWiki/commit/0d1b734817cb6f48fd2dcbf0714fdf43ceac232a [11:50:50] 02landing/03main 07translatewiki.net 03a54db7e Localisation updates from https://translatewiki.net. [11:50:52] [02RemovePII] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/RemovePII/commit/05f6a5394f1977ccc6fb0a86a76b7f61db3936a2 [11:50:54] [02RequestCustomDomain] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/RequestCustomDomain/commit/2efbae296fd9f72c129b90490560a40c0da58c74 [11:50:56] [02RottenLinks] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/RottenLinks/commit/72279c6f452cf8e7e1318abaca6765b202e525c0 [11:50:58] 02MatomoAnalytics/03main 07translatewiki.net 03388a908 Localisation updates from https://translatewiki.net. [11:51:00] [02WikiDiscover] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/WikiDiscover/commit/0323977f734b6136ac42b7b73d64f419850e6bf3 [11:51:01] 02PDFEmbed/03main 07translatewiki.net 039a6f0b0 Localisation updates from https://translatewiki.net. [11:51:03] 02MirahezeMagic/03main 07translatewiki.net 0343504a7 Localisation updates from https://translatewiki.net. [11:51:05] 02ManageWiki/03main 07translatewiki.net 030d1b734 Localisation updates from https://translatewiki.net. [11:51:06] 02RemovePII/03main 07translatewiki.net 0305f6a53 Localisation updates from https://translatewiki.net. [11:51:08] 02RequestCustomDomain/03main 07translatewiki.net 032efbae2 Localisation updates from https://translatewiki.net. [11:51:09] 02RottenLinks/03main 07translatewiki.net 0372279c6 Localisation updates from https://translatewiki.net. [11:51:11] 02WikiDiscover/03main 07translatewiki.net 030323977 Localisation updates from https://translatewiki.net. [11:54:45] miraheze/landing - translatewiki the build passed. [11:55:05] miraheze/GlobalNewFiles - translatewiki the build passed. [11:56:01] miraheze/ErrorPages - translatewiki the build passed. [11:56:31] miraheze/ImportDump - translatewiki the build passed. [11:57:01] miraheze/MatomoAnalytics - translatewiki the build passed. [11:57:09] miraheze/DataDump - translatewiki the build passed. [11:57:35] miraheze/CreateWiki - translatewiki the build passed. [11:57:41] miraheze/RemovePII - translatewiki the build passed. [11:58:38] miraheze/PDFEmbed - translatewiki the build passed. [11:59:19] miraheze/WikiDiscover - translatewiki the build passed. [11:59:30] miraheze/MirahezeMagic - translatewiki the build passed. [11:59:54] miraheze/ManageWiki - translatewiki the build passed. [12:00:04] miraheze/RottenLinks - translatewiki the build passed. [12:00:13] miraheze/RequestCustomDomain - translatewiki the build passed. [12:00:33] miraheze/DiscordNotifications - translatewiki the build passed. [12:02:12] PROBLEM - speedscope211 Check unit status of speedscope_hourly_aggregation on speedscope211 is CRITICAL: CRITICAL: Status of the systemd unit speedscope_hourly_aggregation [12:12:57] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.175 second response time [12:13:26] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 27 seconds ago with 0 failures [12:14:41] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.021 second response time [12:14:49] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [12:16:50] PROBLEM - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [12:17:26] PROBLEM - speedscope211 Puppet on speedscope211 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[docker] [12:18:34] PROBLEM - speedscope211 HTTPS on speedscope211 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 113 bytes in 0.010 second response time [12:18:49] PROBLEM - speedscope211 speedscope 3000 check on speedscope211 is CRITICAL: connect to address 127.0.0.1 and port 3000: Connection refused [12:20:37] ^ downtimed for now so it stops spamming [14:00:21] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/6c4629ee5592493844b1e7f326a7e52f3ca81185 [14:00:21] 02ssl/03main 07WikiTideBot 036c4629e Bot: Auto-update domain lists [14:12:30] [02mw-config] 07dependabot[bot] created 03dependabot/composer/justinrainbow/json-schema-6.11.0 (+1 new commit) 13https://github.com/miraheze/mw-config/commit/7555919b808d [14:12:30] 02mw-config/03dependabot/composer/justinrainbow/json-schema-6.11.0 07dependabot[bot] 037555919 Update justinrainbow/json-schema requirement from 6.10.0 to 6.11.0… [14:12:31] [02mw-config] 07dependabot[bot] added the label 'dependencies' to pull request #6507 (Update justinrainbow/json-schema requirement from 6.10.0 to 6.11.0) 13https://github.com/miraheze/mw-config/pull/6507 [14:12:33] [02mw-config] 07dependabot[bot] added the label 'php' to pull request #6507 (Update justinrainbow/json-schema requirement from 6.10.0 to 6.11.0) 13https://github.com/miraheze/mw-config/pull/6507 [14:12:35] [02mw-config] 07dependabot[bot] opened pull request #6507: Update justinrainbow/json-schema requirement from 6.10.0 to 6.11.0 (03main...03dependabot/composer/justinrainbow/json-schema-6.11.0) 13https://github.com/miraheze/mw-config/pull/6507 [14:12:37] [02mw-config] 07dependabot[bot] added the label 'dependencies' to pull request #6507 (Update justinrainbow/json-schema requirement from 6.10.0 to 6.11.0) 13https://github.com/miraheze/mw-config/pull/6507 [14:12:39] [02mw-config] 07dependabot[bot] added the label 'php' to pull request #6507 (Update justinrainbow/json-schema requirement from 6.10.0 to 6.11.0) 13https://github.com/miraheze/mw-config/pull/6507 [14:39:16] PROBLEM - matomo151 Current Load on matomo151 is WARNING: LOAD WARNING - total load average: 13.96, 13.28, 12.33 [14:41:16] RECOVERY - matomo151 Current Load on matomo151 is OK: LOAD OK - total load average: 12.79, 13.02, 12.35 [16:00:24] [02ssl] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/ssl/commit/bcb5230f1c2cb55b742f3bdc6829d62f1904104b [16:00:24] 02ssl/03main 07WikiTideBot 03bcb5230 Bot: Auto-update domain lists [16:02:12] [02puppet] 07Universal-Omega created 03speedscope-nftables (+1 new commit) 13https://github.com/miraheze/puppet/commit/8858a2713866 [16:02:12] 02puppet/03speedscope-nftables 07CosmicAlpha 038858a27 speedscope211: include nftables alongside ferm… [16:02:18] [02puppet] 07Universal-Omega opened pull request #4926: speedscope211: include nftables alongside ferm (03main...03speedscope-nftables) 13https://github.com/miraheze/puppet/pull/4926 [16:08:36] [02puppet] 07Universal-Omega merged pull request #4926: speedscope211: include nftables alongside ferm (03main...03speedscope-nftables) 13https://github.com/miraheze/puppet/pull/4926 [16:08:38] [02puppet] 07Universal-Omega 04deleted 03speedscope-nftables at 038858a27 13https://api.github.com/repos/miraheze/puppet/commit/8858a27 [16:08:42] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/924ca6e3fcd32e1c76630d35396bbdd5e452c62a [16:08:43] 02puppet/03main 07CosmicAlpha 03924ca6e speedscope211: include nftables alongside ferm… [16:14:09] [02puppet] 07Universal-Omega created 03task-nftables (+1 new commit) 13https://github.com/miraheze/puppet/commit/63c27343c150 [16:14:09] 02puppet/03task-nftables 07CosmicAlpha 0363c2734 mediawiki_task: include nftables alongside ferm… [16:14:15] [02puppet] 07Universal-Omega opened pull request #4927: mediawiki_task: include nftables alongside ferm (03main...03task-nftables) 13https://github.com/miraheze/puppet/pull/4927 [16:20:29] https://cdn.discordapp.com/attachments/808001911868489748/1541482339111149638/image.png?ex=6a8dc0cd&is=6a8c6f4d&hm=6001dbad6824f47556b361f07d14b0d587ff607d824efb64b126b8f621aff0bc& [16:36:56] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/431b9049c2bff6fafc63177b7fb20644929d3991 [16:36:57] 02puppet/03main 07CosmicAlpha 03431b904 Update some comments [16:37:34] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/7aa41356672b596c9005a6ae54085cbb890d9731 [16:37:34] 02puppet/03main 07CosmicAlpha 037aa4135 Add . [16:44:25] RECOVERY - speedscope211 Check unit status of speedscope_hourly_aggregation on speedscope211 is OK: OK: Status of the systemd unit speedscope_hourly_aggregation [16:44:40] RECOVERY - speedscope211 speedscope.wikitide.net HTTPS on speedscope211 is OK: HTTP OK: HTTP/1.1 200 OK - 295 bytes in 0.019 second response time [16:44:45] RECOVERY - speedscope211 HTTPS on speedscope211 is OK: HTTP OK: HTTP/2 200 - 354 bytes in 0.013 second response time [16:44:45] RECOVERY - speedscope211 speedscope 3000 check on speedscope211 is OK: TCP OK - 0.000 second response time on 127.0.0.1 port 3000 [16:44:52] (^ removed downtimes) [16:45:10] RECOVERY - speedscope211 Puppet on speedscope211 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:46:43] PROBLEM - cp201 Varnish Backends on cp201 is CRITICAL: 1 backends are down. mw182 [17:46:51] PROBLEM - cp171 Varnish Backends on cp171 is CRITICAL: 1 backends are down. mw182 [17:47:08] PROBLEM - cp161 Varnish Backends on cp161 is CRITICAL: 1 backends are down. mw182 [17:47:51] PROBLEM - cp191 Varnish Backends on cp191 is CRITICAL: 1 backends are down. mw182 [17:52:43] RECOVERY - cp201 Varnish Backends on cp201 is OK: All 32 backends are healthy [17:52:46] RECOVERY - cp171 Varnish Backends on cp171 is OK: All 32 backends are healthy [17:53:02] RECOVERY - cp161 Varnish Backends on cp161 is OK: All 32 backends are healthy [17:53:51] RECOVERY - cp191 Varnish Backends on cp191 is OK: All 32 backends are healthy [17:55:05] RECOVERY - mw182 Puppet on mw182 is OK: OK: Puppet is currently enabled, last run 3 minutes ago with 0 failures [17:55:05] RECOVERY - mw182 chrony on mw182 is OK: chrony OK: System Time 0.000010067 seconds slow of NTP time, Stratum 4 [18:03:22] [02puppet] 07Universal-Omega created 03improve-nftables (+1 new commit) 13https://github.com/miraheze/puppet/commit/119aa67ba05d [18:03:22] 02puppet/03improve-nftables 07CosmicAlpha 03119aa67 Improvements to nftables [18:05:16] [02puppet] 07Universal-Omega opened pull request #4928: Improvements to nftables (03main...03improve-nftables) 13https://github.com/miraheze/puppet/pull/4928 [18:06:04] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/34e128f1ed3f7566bcd8c9d630610a43e717329d [18:06:04] 02puppet/03improve-nftables 07CosmicAlpha 0334e128f - [18:07:20] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/e72208a4c5144c7a4f823879e0e27fa9fa3f6367 [18:07:21] 02puppet/03improve-nftables 07CosmicAlpha 03e72208a - [18:08:02] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/eb8ee508ed08ad6a954fb96ab8d3d89db4384a1a [18:08:02] 02puppet/03improve-nftables 07CosmicAlpha 03eb8ee50 - [18:08:41] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/81f7cdb632e020dcfcbf529dc8ec0bc2f1125c1d [18:08:41] 02puppet/03improve-nftables 07CosmicAlpha 0381f7cdb - [18:57:10] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/2f12ef033c289662eede9896b4aa2160987c29de [18:57:11] 02puppet/03improve-nftables 07CosmicAlpha 032f12ef0 Update [18:58:32] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/ec7651177f8a354ac6f3ac52e977b2cc5bdf2604 [18:58:32] 02puppet/03improve-nftables 07CosmicAlpha 03ec76511 Fix [20:01:10] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/b6771b83cea7d130853db3a73711eb8bcdb269dd [20:01:10] 02puppet/03improve-nftables 07CosmicAlpha 03b6771b8 Update [20:08:40] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/6ac0536bfe34f1efd5649b61f12c6c2b26c60088 [20:08:40] 02puppet/03improve-nftables 07CosmicAlpha 036ac0536 Update [20:33:47] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/ddc424d6bdfb2a17abe54514bec1c80bf46219ac [20:33:47] 02puppet/03improve-nftables 07CosmicAlpha 03ddc424d Update [21:40:20] [02puppet] 07paladox created 03paladox-patch-2 (+1 new commit) 13https://github.com/miraheze/puppet/commit/9d964f99de73 [21:40:21] 02puppet/03paladox-patch-2 07paladox 039d964f9 base::monitoring: allow nagios user to run /usr/sbin/ipmi-dcmi [21:40:24] [02puppet] 07paladox opened pull request #4929: base::monitoring: allow nagios user to run /usr/sbin/ipmi-dcmi (03main...03paladox-patch-2) 13https://github.com/miraheze/puppet/pull/4929 [21:48:38] [02puppet] 07paladox merged pull request #4929: base::monitoring: allow nagios user to run /usr/sbin/ipmi-dcmi (03main...03paladox-patch-2) 13https://github.com/miraheze/puppet/pull/4929 [21:48:38] [02puppet] 07paladox pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/5fc1ae1dc8fcb8b8ee8b22228cad6a65de2bd83f [21:48:40] 02puppet/03main 07paladox 035fc1ae1 base::monitoring: allow nagios user to run /usr/sbin/ipmi-dcmi (#4929) [21:48:42] [02puppet] 07paladox 04deleted 03paladox-patch-2 at 039d964f9 13https://api.github.com/repos/miraheze/puppet/commit/9d964f9 [22:10:03] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/503cf69c3d8e1da87fdb403cdece1fa2c7ffbc22 [22:10:03] 02puppet/03improve-nftables 07CosmicAlpha 03503cf69 Update [22:13:59] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/6b891bc0aaf9f3dab50ad100ee2f4511dc5daccf [22:13:59] 02puppet/03improve-nftables 07CosmicAlpha 036b891bc - [22:46:16] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/d65e0d67c26075d3d28d5290cc13f23b757133d7 [22:46:16] 02puppet/03improve-nftables 07CosmicAlpha 03d65e0d6 Update [22:46:58] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/ecc247ff642e904f9d0dba3c59d5e263fbf31e8f [22:46:58] 02puppet/03improve-nftables 07CosmicAlpha 03ecc247f - [22:47:48] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/0a6ab5526bdafe77a131311b703ab05112e9d070 [22:47:48] 02puppet/03improve-nftables 07CosmicAlpha 030a6ab55 - [22:49:11] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/297a1dd62898d5922ab2629ed7c64132a06b5058 [22:49:11] 02puppet/03improve-nftables 07CosmicAlpha 03297a1dd - [22:51:28] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/5428ba7bc1bce8270cfe3262412306fdc231b2b3 [22:51:28] 02puppet/03improve-nftables 07CosmicAlpha 035428ba7 Use VMlib::Ensure [22:52:26] [02puppet] 07Universal-Omega pushed 1 new commit to 03improve-nftables 13https://github.com/miraheze/puppet/commit/f6592230d34ee241a13865b9950c7ee17a20d464 [22:52:26] 02puppet/03improve-nftables 07CosmicAlpha 03f659223 Use VMlib::Ensure [23:08:14] [02puppet] 07Universal-Omega merged pull request #4928: Improvements to nftables (03main...03improve-nftables) 13https://github.com/miraheze/puppet/pull/4928 [23:08:14] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/9a50222b2a35831bd46eaa4d982243326f4ff2ef [23:08:14] 02puppet/03main 07CosmicAlpha 039a50222 Improvements to nftables [23:08:16] [02puppet] 07Universal-Omega 04deleted 03improve-nftables at 03f659223 13https://api.github.com/repos/miraheze/puppet/commit/f659223 [23:13:43] [02puppet] 07Universal-Omega merged pull request #4927: mediawiki_task: include nftables alongside ferm (03main...03task-nftables) 13https://github.com/miraheze/puppet/pull/4927 [23:13:43] [02puppet] 07Universal-Omega pushed 1 new commit to 03main 13https://github.com/miraheze/puppet/commit/3a8f43681e833d7caf7cf70293bd248d91a0dea8 [23:13:43] 02puppet/03main 07CosmicAlpha 033a8f436 mediawiki_task: include nftables alongside ferm… [23:13:45] [02puppet] 07Universal-Omega 04deleted 03task-nftables at 0363c2734 13https://api.github.com/repos/miraheze/puppet/commit/63c2734 [23:29:23] RECOVERY - mon181 IRCEcho on mon181 is OK: PROCS OK: 1 process with args '/usr/local/bin/ircecho'