[05:35:32] PROBLEM - swiftac1 NTP time on swiftac1 is WARNING: NTP WARNING: Offset 0.1039369404 secs [05:49:46] RECOVERY - swiftac1 NTP time on swiftac1 is OK: NTP OK: Offset 0.09489861131 secs [16:51:16] PROBLEM - mon1 PowerDNS Recursor on mon1 is CRITICAL: CRITICAL - Plugin timed out while executing system call PROBLEM - mon1 Current Load on mon1 is CRITICAL: LOAD CRITICAL - total load average: 24.26, 13.71, 5.61 [16:52:28] PROBLEM - mon1 SSH on mon1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:02:29] PROBLEM - ns2 Auth DNS on ns2 is CRITICAL: CRITICAL - Plugin timed out while executing system call [17:12:06] PROBLEM - mon1 grafana.inside.wf HTTPS on mon1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:16:28] PROBLEM - ns2 Puppet on ns2 is UNKNOWN: PROBLEM - mon1 Check correctness of the icinga configuration on mon1 is UNKNOWN: PROBLEM - mon1 Check correctness of the icinga configuration on mon1 is UNKNOWN: PROBLEM - swiftproxy1 HTTPS on swiftproxy1 is UNKNOWN: d.> PROBLEM - ns2 Disk Space on ns2 is UNKNOWN: PROBLEM - cp3 Disk Space on cp3 is UNKNOWN: [17:17:21] PROBLEM - ns1 Auth DNS on ns1 is CRITICAL: CRITICAL - Plugin timed out while executing system call [17:17:31] RECOVERY - ns2 Auth DNS on ns2 is OK: DNS OK: 3.476 seconds response time. inside.wf returns 158.69.62.132,2607:5300:201:3100::175d [17:17:38] PROBLEM - ns2 Disk Space on ns2 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.68.215.13: 1 [17:17:39] PROBLEM - cp3 Disk Space on cp3 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.68.214.246: 1 [18:07:08] PROBLEM - mon1 Puppet on mon1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. PROBLEM - ns2 Puppet on ns2 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.68.215.13: 1 PROBLEM - swiftproxy1 HTTPS on swiftproxy1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds PROBLEM - cp6 Nginx Backend for test1 on cp6 is UNKNOWN: OBLEM - cp2 Nginx Backend for phorge1 on cp2 is UNKNOWN: PROBLEM - mon1 Check correctness of the icinga configuration on mon1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:08:02] RECOVERY - mon1 SSH on mon1 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0) RECOVERY - mon1 PowerDNS Recursor on mon1 is OK: DNS OK: 3.697 seconds response time. wikiforge.net returns 2607:5300:201:3100::175d,51.68.214.246 RECOVERY - ns1 Auth DNS on ns1 is OK: DNS OK: 5.246 seconds response time. inside.wf returns 2001:41d0:801:2000::2200,51.68.214.246 [18:08:05] RECOVERY - mon1 grafana.inside.wf HTTPS on mon1 is OK: HTTP OK: HTTP/1.1 302 Found - 429 bytes in 1.752 second response time [18:09:04] PROBLEM - cp2 Nginx Backend for phorge1 on cp2 is CRITICAL: CHECK_NRPE: Error - Could not connect to 158.69.62.132: Connection reset by peer [18:09:04] PROBLEM - cp6 Nginx Backend for test1 on cp6 is CRITICAL: CHECK_NRPE: Error - Could not connect to 51.161.131.113: Connection reset by peer [18:09:05] RECOVERY - mon1 Check correctness of the icinga configuration on mon1 is OK: Icinga configuration is correct [18:11:07] RECOVERY - mon1 Puppet on mon1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [18:35:00] PROBLEM - mon1 Current Load on mon1 is WARNING: LOAD WARNING - total load average: 0.09, 0.24, 5.46 [18:36:59] RECOVERY - mon1 Current Load on mon1 is OK: LOAD OK - total load average: 0.06, 0.18, 4.83 [18:42:00] [02WikiForge/mw-config] 07dependabot[bot] pushed 031 commit to 03dependabot/github_actions/styfle/cancel-workflow-action-0.12.1 [+0/-0/±1] 13https://github.com/WikiForge/mw-config/commit/0b72af05ac86 [18:42:03] [02WikiForge/mw-config] 07dependabot[bot] 030b72af0 - Bump styfle/cancel-workflow-action from 0.12.0 to 0.12.1 Bumps [styfle/cancel-workflow-action](https://github.com/styfle/cancel-workflow-action) from 0.12.0 to 0.12.1. - [Release notes](https://github.com/styfle/cancel-workflow-action/releases) - [Commits](https://github.com/styfle/cancel-workflow-action/compare/0.12.0...0.12.1) --- updated-dependencies: - dependency-name: styfle/cance [18:42:05] [02mw-config] 07dependabot[bot] created branch 03dependabot/github_actions/styfle/cancel-workflow-action-0.12.1 - 13https://github.com/WikiForge/mw-config [18:42:06] [02mw-config] 07dependabot[bot] labeled pull request 03#142: Bump styfle/cancel-workflow-action from 0.12.0 to 0.12.1 - 13https://github.com/WikiForge/mw-config/pull/142 [18:42:07] [02mw-config] 07dependabot[bot] opened pull request 03#142: Bump styfle/cancel-workflow-action from 0.12.0 to 0.12.1 - 13https://github.com/WikiForge/mw-config/pull/142 [18:42:10] [02mw-config] 07dependabot[bot] labeled pull request 03#142: Bump styfle/cancel-workflow-action from 0.12.0 to 0.12.1 - 13https://github.com/WikiForge/mw-config/pull/142 [18:43:05] WikiForge/mw-config - dependabot[bot] the build passed. [21:55:18] PROBLEM - ns1 Auth DNS on ns1 is CRITICAL: CRITICAL - Plugin timed out while executing system call [21:55:40] PROBLEM - ns1 Auth DNS on ns1 is CRITICAL: CRITICAL - Plugin timed out while executing system call [21:56:39] PROBLEM - mon1 Current Load on mon1 is CRITICAL: LOAD CRITICAL - total load average: 20.55, 16.72, 8.48 [22:18:38] PROBLEM - mon1 grafana.inside.wf HTTPS on mon1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds PROBLEM - mon1 PowerDNS Recursor on mon1 is CRITICAL: CRITICAL - Plugin timed out while executing system call PROBLEM - mon1 PowerDNS Recursor on mon1 is CRITICAL: CRITICAL - Plugin timed out while executing system call [22:19:13] PROBLEM - mon1 Check correctness of the icinga configuration on mon1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [22:19:25] RECOVERY - mw1 MediaWiki Rendering on mw1 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 2.553 second response time [22:19:35] PROBLEM - cp2 NTP time on cp2 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 158.69.62.132: 1 PROBLEM - cp3 Puppet on cp3 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.68.214.246: 1 PROBLEM - cp3 Nginx Backend for test1 on cp3 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.68.214.246: 1 PROBLEM - cp6 Nginx Backen [22:19:35] on cp6 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.161.131.113: 1 PROBLEM - cp4 Varnish Backends on cp4 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.38.134.38: 1 PROBLEM - cp3 Nginx Backend for mwdedi1 on cp3 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.68.214.246: 1 PROBLEM - cp2 Nginx Backend for mail1 [22:19:35] RITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 158.69.62.132: 1 PROBLEM - cp6 NTP time on cp6 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.161.131.113: 1 PROBLEM - cp2 Nginx Backend for mw1 on cp2 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 158.69.62.132: 1 PROBLEM - mw2 APT on mw2 is CRITICAL: APT CRITICAL: 3 packa [22:19:35] e for upgrade (3 critical updates). PROBLEM - cp4 Nginx Backend for mail1 on cp4 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 51.38.134.38: 1 PROBLEM - cp2 Nginx Backend for test1 on cp2 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 158.69.62.132: 1 PROBLEM - cp6 Nginx Backend for mw2 on cp6 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not comple [22:19:35] hake with 51.161.131.113: 1 PROBLEM - cp5 Nginx Backend for puppet1 on cp5 is CRITICAL: CHECK_NRPE: (ssl_err != 5) Error - Could not complete SSL handshake with 15.235.192.162: 1 [22:25:01] PROBLEM - mon1 Puppet on mon1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. PROBLEM - wc.wikiforge.net on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:32:23] PROBLEM - mon1 monitoring.inside.wf HTTPS on mon1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds PROBLEM - mon1 monitoring.inside.wf HTTPS on mon1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:32:58] PROBLEM - cp4 Puppet on cp4 is UNKNOWN: PROBLEM - cp2 Disk Space on cp2 is UNKNOWN: PROBLEM - ns2 NTP time on ns2 is UNKNOWN: PROBLEM - mon1 Current Load on mon1 is UNKNOWN: PROBLEM - ns1 Disk Space on [22:33:00] WN: [22:33:08] PROBLEM - cp6 Nginx Backend for puppet1 on cp6 is UNKNOWN: PROBLEM - cp6 Puppet on cp6 is UNKNOWN: PROBLEM - cp6 Current Load on cp6 is UNKNOWN: [22:33:15] PROBLEM - cloud1 APT on cloud1 is UNKNOWN: PROBLEM - mon1 Check correctness of the icinga configuration on mon1 is UNKNOWN: [22:33:45] PROBLEM - cp6 Nginx Backend for matomo1 on cp6 is UNKNOWN: PROBLEM - mon1 APT on mon1 is UNKNOWN: PROBLEM - cp2 Nginx Backend for mwdedi1 on cp2 is UNKNOWN: PROBLEM - cp5 Nginx Backend for matomo1 on cp5 is UNKNOWN: [22:33:51] PROBLEM - cp6 Nginx Backend for phorge1 on cp6 is UNKNOWN: PROBLEM - cp5 APT on cp5 is UNKNOWN: PROBLEM - cp4 Current Load on cp4 is UNKNOWN: PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is UNKNOWN: