[00:01:06] PROBLEM - db1 MariaDB on db1 is UNKNOWN: check_mysql: Invalid hostname/address - db1.inside.wfUsage: check_mysql [-d database] [-H host] [-P port] [-s socket] [-u user] [-p password] [-S] [-l] [-a cert] [-k key] [-C ca-cert] [-D ca-dir] [-L ciphers] [-f optfile] [-g group] [00:01:26] PROBLEM - wc.wikiforge.net on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:01:40] PROBLEM - os1 Puppet on os1 is UNKNOWN: NRPE: Unable to read output [00:03:03] PROBLEM - db1 MariaDB on db1 is CRITICAL: Access denied for user 'icinga'@'10.0.0.110' (using password: YES) [00:03:20] RECOVERY - wc.wikiforge.net on sslhost is OK: OK - Certificate 'wikiforge.net' will expire on Sun 04 Feb 2024 02:51:55 AM GMT +0000. [03:50:34] [02WikiForge/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiForge/puppet/compare/615dd5a18609...a42cee9c1762 [03:50:37] [02WikiForge/puppet] 07Universal-Omega 03a42cee9 - Remove purged extensions [13:44:18] PROBLEM - www.rosettacode.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Cannot make SSL connection.40D7F47AF7140000:error:0A000410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure:../ssl/record/rec_layer_s3.c:1586:SSL alert number 40 [14:42:10] RECOVERY - www.rosettacode.org - LetsEncrypt on sslhost is OK: OK - Certificate 'rosettacode.org' will expire on Sat 20 Jan 2024 06:52:33 AM GMT +0000. [15:51:19] PROBLEM - db1 APT on db1 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [15:53:12] PROBLEM - jobchron1 APT on jobchron1 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [15:53:28] PROBLEM - mem1 APT on mem1 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [15:53:52] PROBLEM - jobrunner1 APT on jobrunner1 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates). [15:55:04] PROBLEM - mw1 APT on mw1 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [16:00:06] PROBLEM - graylog1 APT on graylog1 is CRITICAL: APT CRITICAL: 10 packages available for upgrade (1 critical updates). [16:02:20] PROBLEM - mw2 APT on mw2 is CRITICAL: APT CRITICAL: 2 packages available for upgrade (1 critical updates). [17:11:54] [02WikiForge/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiForge/mw-config/compare/54c54b0dc001...636375aaff7c [17:11:56] [02WikiForge/mw-config] 07Universal-Omega 03636375a - Remove X-Wiki-Visibility header Not needed [17:12:46] WikiForge/mw-config - Universal-Omega the build passed. [17:14:22] PROBLEM - www.rosettacode.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Cannot make SSL connection.403788C783140000:error:0A000410:SSL routines:ssl3_read_bytes:sslv3 alert handshake failure:../ssl/record/rec_layer_s3.c:1586:SSL alert number 40 [17:38:12] !log [@jobrunner1] starting deploy of {'config': True, 'versions': ['']} to [mw1, mw2, mw3, jobrunner1] [17:38:15] !log [@jobrunner1] DEPLOY ABORTED: Canary check failed for hub.wikiforge.net@mw3.inside.wf [18:32:02] [02WikiForge/puppet] 07Universal-Omega pushed 031 commit to 03master [+3/-3/±58] 13https://github.com/WikiForge/puppet/compare/a42cee9c1762...36772d97cc28 [18:32:04] [02WikiForge/puppet] 07Universal-Omega 0336772d9 - Update apt module to 9.1.0 [18:46:55] [02WikiForge/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiForge/puppet/compare/36772d97cc28...64acaf67c873 [18:46:57] [02WikiForge/puppet] 07Universal-Omega 0364acaf6 - graylog: upgrade to 5.2.1 [18:47:37] [02WikiForge/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiForge/puppet/compare/64acaf67c873...f34695c2f86c [18:47:38] [02WikiForge/puppet] 07Universal-Omega 03f34695c - xconsole -> console [19:05:43] [02WikiForge/puppet] 07Universal-Omega created branch 03mathoid 13https://github.com/WikiForge/puppet/commit/f34695c2f86cefc89315548f5298d404cca26109 [19:05:44] [02puppet] 07Universal-Omega created branch 03mathoid - 13https://github.com/WikiForge/puppet [19:07:05] [02WikiForge/puppet] 07Universal-Omega pushed 031 commit to 03mathoid [+3/-1/±2] 13https://github.com/WikiForge/puppet/compare/f34695c2f86c...99c68a1feca3 [19:07:06] [02WikiForge/puppet] 07Universal-Omega 0399c68a1 - Add mathoid to services [19:07:18] [02puppet] 07Universal-Omega opened pull request 03#206: Add mathoid to services - 13https://github.com/WikiForge/puppet/pull/206 [19:07:53] [02WikiForge/puppet] 07github-actions[bot] pushed 031 commit to 03mathoid [+0/-0/±1] 13https://github.com/WikiForge/puppet/compare/99c68a1feca3...cb8977ff4868 [19:07:54] [02WikiForge/puppet] 07github-actions 03cb8977f - CI: lint puppet code to standards Check commit and GitHub actions for more details [19:07:56] [02puppet] 07github-actions[bot] synchronize pull request 03#206: Add mathoid to services - 13https://github.com/WikiForge/puppet/pull/206 [19:12:11] RECOVERY - www.rosettacode.org - LetsEncrypt on sslhost is OK: OK - Certificate 'rosettacode.org' will expire on Sat 20 Jan 2024 06:52:33 AM GMT +0000. [20:33:22] [02WikiForge/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiForge/puppet/compare/f34695c2f86c...f51d48afc0ca [20:33:23] [02WikiForge/puppet] 07Universal-Omega 03f51d48a - check_puppet_run: fix support for ruby 3.2.0+ [20:43:48] [02WikiForge/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiForge/puppet/compare/f51d48afc0ca...8a093a646e8d [20:43:51] [02WikiForge/puppet] 07Universal-Omega 038a093a6 - expand_path: fix support for ruby 3.2.0+ [20:47:48] RECOVERY - mon1 Puppet on mon1 is OK: OK: Puppet is currently enabled, last run 52 seconds ago with 0 failures [20:54:41] RECOVERY - os1 Puppet on os1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:57:15] RECOVERY - graylog1 Puppet on graylog1 is OK: OK: Puppet is currently enabled, last run 47 seconds ago with 0 failures [20:58:03] RECOVERY - ldap1 Puppet on ldap1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:29:00] [02WikiForge/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiForge/puppet/compare/8a093a646e8d...721e601f4275 [21:29:01] [02WikiForge/puppet] 07Universal-Omega 03721e601 - Fix part 2 [21:33:35] PROBLEM - mw1 Puppet on mw1 is UNKNOWN: NRPE: Unable to read output [21:36:11] PROBLEM - cloud1 Puppet on cloud1 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 52 seconds ago with 2 failures. Failed resources (up to 3 shown): Service[pdns-recursor],File[/etc/resolv.conf] [21:39:33] PROBLEM - jobrunner1 Puppet on jobrunner1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 1 minute ago with 1 failures. Failed resources (up to 3 shown): Exec[git_checkout_MediaWiki-REL1_41 Femiwiki] [21:44:33] PROBLEM - mw2 Puppet on mw2 is UNKNOWN: NRPE: Unable to read output [21:56:07] PROBLEM - puppet1 Puppet on puppet1 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 1 minute ago with 1 failures. Failed resources (up to 3 shown): Augeas[hba_create-puppetdb@localhost]