[00:01:17] PROBLEM - cp1 HTTP 4xx/5xx ERROR Rate on cp1 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:03:17] PROBLEM - cp1 HTTP 4xx/5xx ERROR Rate on cp1 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [01:14:59] RECOVERY - wc.wikitide.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [01:18:59] PROBLEM - wc.wikitide.org on sslhost is WARNING: WARNING - Certificate 'wikitide.org' expires in 29 day(s) (Tue 20 Feb 2024 12:20:10 PM GMT +0000). [01:20:26] [02WikiTideOrg/Reports] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/Reports/compare/79583eaaf3c8...4844845fd910 [01:20:29] [02WikiTideOrg/Reports] 07Universal-Omega 034844845 - ARCHIVE [01:21:59] [02GlobalNewFiles] 07Universal-Omega closed pull request 03#2: Remove CreateWiki dependency - 13https://github.com/WikiTideOrg/GlobalNewFiles/pull/2 [01:22:02] [02WikiTideOrg/GlobalNewFiles] 07Universal-Omega deleted branch 03remove-CreateWiki [01:22:03] [02GlobalNewFiles] 07Universal-Omega deleted branch 03remove-CreateWiki - 13https://github.com/WikiTideOrg/GlobalNewFiles [01:22:53] [02WikiTideOrg/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/GlobalNewFiles/compare/86b230e883c7...78344f99178b [01:22:56] [02WikiTideOrg/GlobalNewFiles] 07Universal-Omega 0378344f9 - ARCHIVE [01:30:05] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/991ef13d8b75...03264833a67b [01:30:06] [02WikiTideOrg/puppet] 07Universal-Omega 030326483 - Use miraheze repo for mathoid-deploy [01:31:38] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/03264833a67b...6834246a73fe [01:31:39] [02WikiTideOrg/puppet] 07Universal-Omega 036834246 - Use miraheze repo for femiwiki-deploy [01:32:44] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/6834246a73fe...73b37eda3287 [01:32:45] [02WikiTideOrg/puppet] 07Universal-Omega 0373b37ed - Use miraheze repo for 3d2png-deploy [01:44:59] RECOVERY - wc.wikitide.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [01:48:59] PROBLEM - wc.wikitide.org on sslhost is WARNING: WARNING - Certificate 'wikitide.org' expires in 29 day(s) (Tue 20 Feb 2024 12:20:10 PM GMT +0000). [08:44:59] RECOVERY - wc.wikitide.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [08:48:59] PROBLEM - wc.wikitide.org on sslhost is WARNING: WARNING - Certificate 'wikitide.org' expires in 29 day(s) (Tue 20 Feb 2024 12:20:10 PM GMT +0000). [14:14:59] RECOVERY - wc.wikitide.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [14:18:59] PROBLEM - wc.wikitide.org on sslhost is WARNING: WARNING - Certificate 'wikitide.org' expires in 28 day(s) (Tue 20 Feb 2024 12:20:10 PM GMT +0000). [15:14:59] RECOVERY - wc.wikitide.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [15:18:59] PROBLEM - wc.wikitide.org on sslhost is WARNING: WARNING - Certificate 'wikitide.org' expires in 28 day(s) (Tue 20 Feb 2024 12:20:10 PM GMT +0000). [19:14:59] RECOVERY - wc.wikitide.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Mon 18 Nov 2024 11:59:59 PM GMT +0000. [19:17:26] why does this alert keep going back and fourth between two certs (one being an expiry warning) [19:18:48] *.miraheze.org would not be valid for wc.wikitide.org [19:18:59] PROBLEM - wc.wikitide.org on sslhost is WARNING: WARNING - Certificate 'wikitide.org' expires in 28 day(s) (Tue 20 Feb 2024 12:20:10 PM GMT +0000). [20:49:06] MacFan4000: ignore, I thinit is only caused because all WT DNS is now done through Miraheze DNS, so it keeps flickering back and forth. [20:49:51] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [21:19:51] RECOVERY - jobrunner1 Puppet on jobrunner1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:28:17] !log [universalomega@jobrunner1] starting deploy of {'pull': 'errorpages', 'errorpages': True, 'versions': ['1.40']} to [mw1, mw2, jobrunner1] [21:28:21] !log [universalomega@jobrunner1] finished deploy of {'pull': 'errorpages', 'errorpages': True, 'versions': ['1.40']} to [mw1, mw2, jobrunner1] - SUCCESS in 3s [21:28:24] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [21:28:31] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [21:28:50] !log [universalomega@jobrunner1] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw1, mw2, jobrunner1] [21:28:54] !log [universalomega@jobrunner1] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40']} to [mw1, mw2, jobrunner1] - SUCCESS in 3s [21:28:57] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [21:29:04] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [21:29:36] !log [universalomega@jobrunner1] starting deploy of {'pull': 'config', 'config': True, 'versions': ['1.40'], 'ignore_time': True} to [mw1, mw2, jobrunner1] [21:29:40] !log [universalomega@jobrunner1] finished deploy of {'pull': 'config', 'config': True, 'versions': ['1.40'], 'ignore_time': True} to [mw1, mw2, jobrunner1] - SUCCESS in 3s [21:29:43] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log [21:29:50] Logged the message at https://meta.wikitide.org/wiki/Tech:Server_admin_log