[01:08:07] PROBLEM - puppet1 NTP time on puppet1 is WARNING: NTP WARNING: Offset 0.1238097548 secs [01:14:07] RECOVERY - puppet1 NTP time on puppet1 is OK: NTP OK: Offset 0.06152802706 secs [01:44:44] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [02:18:07] PROBLEM - puppet1 NTP time on puppet1 is WARNING: NTP WARNING: Offset 0.1073325872 secs [02:30:07] RECOVERY - puppet1 NTP time on puppet1 is OK: NTP OK: Offset 0.07392278314 secs [02:44:43] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net All nameservers failed to answer the query. [05:23:45] PROBLEM - farthestfrontier.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'farthestfrontier.wiki' expires in 15 day(s) (Sat 20 Jan 2024 05:08:31 AM GMT +0000). [05:36:34] PROBLEM - www.farthestfrontier.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'farthestfrontier.wiki' expires in 15 day(s) (Sat 20 Jan 2024 05:08:31 AM GMT +0000). [06:36:59] PROBLEM - meta.sagan4.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'meta.sagan4.org' expires in 15 day(s) (Sat 20 Jan 2024 06:33:39 AM GMT +0000). [06:40:34] PROBLEM - alpha.sagan4.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'meta.sagan4.org' expires in 15 day(s) (Sat 20 Jan 2024 06:33:39 AM GMT +0000). [06:43:00] PROBLEM - greatamerica.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'greatamerica.wiki' expires in 15 day(s) (Sat 20 Jan 2024 06:37:56 AM GMT +0000). [06:43:05] PROBLEM - mason.sagan4.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'beta.sagan4.org' expires in 15 day(s) (Sat 20 Jan 2024 06:35:08 AM GMT +0000). [06:45:51] PROBLEM - lophocmatngu.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'lophocmatngu.wiki' expires in 15 day(s) (Sat 20 Jan 2024 06:40:34 AM GMT +0000). [06:49:04] PROBLEM - distrowiki.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'distrowiki.net' expires in 15 day(s) (Sat 20 Jan 2024 06:36:29 AM GMT +0000). [06:53:35] PROBLEM - thegreatwar.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'thegreatwar.uk' expires in 15 day(s) (Sat 20 Jan 2024 06:49:55 AM GMT +0000). [06:53:45] PROBLEM - www.polandballwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'polandballwiki.com' expires in 15 day(s) (Sat 20 Jan 2024 06:47:38 AM GMT +0000). [06:54:50] PROBLEM - rosettacode.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'rosettacode.org' expires in 15 day(s) (Sat 20 Jan 2024 06:52:33 AM GMT +0000). [07:02:22] PROBLEM - valorantjp.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'valorantjp.wiki' expires in 15 day(s) (Sat 20 Jan 2024 06:52:59 AM GMT +0000). [07:05:30] PROBLEM - beta.sagan4.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'beta.sagan4.org' expires in 15 day(s) (Sat 20 Jan 2024 06:35:08 AM GMT +0000). [07:06:44] PROBLEM - wiki.colleimadcat.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.colleimadcat.com' expires in 15 day(s) (Sat 20 Jan 2024 06:42:51 AM GMT +0000). [07:06:59] PROBLEM - hsck.lophocmatngu.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'lophocmatngu.wiki' expires in 15 day(s) (Sat 20 Jan 2024 06:40:34 AM GMT +0000). [07:09:52] PROBLEM - www.greatamerica.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'greatamerica.wiki' expires in 15 day(s) (Sat 20 Jan 2024 06:37:56 AM GMT +0000). [07:11:38] PROBLEM - www.rosettacode.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'rosettacode.org' expires in 15 day(s) (Sat 20 Jan 2024 06:52:33 AM GMT +0000). [07:12:32] PROBLEM - polandballwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'polandballwiki.com' expires in 15 day(s) (Sat 20 Jan 2024 06:47:38 AM GMT +0000). [07:16:29] PROBLEM - www.lgbtqia.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.lgbtqia.wiki' expires in 15 day(s) (Sat 20 Jan 2024 06:55:06 AM GMT +0000). [13:40:07] PROBLEM - puppet1 NTP time on puppet1 is WARNING: NTP WARNING: Offset 0.107639432 secs [14:10:07] RECOVERY - puppet1 NTP time on puppet1 is OK: NTP OK: Offset 0.017111063 secs [16:14:44] PROBLEM - newcascadia.net - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out.; Server 1.1.1.1 UDP port 53 answered The DNS operation timed out. [16:44:43] PROBLEM - newcascadia.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - newcascadia.net All nameservers failed to answer the query. [19:42:11] PROBLEM - swiftproxy1 SSH on swiftproxy1 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:43:40] PROBLEM - swiftproxy1 PowerDNS Recursor on swiftproxy1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:43:56] PROBLEM - swiftproxy1 ferm_active on swiftproxy1 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:44:07] PROBLEM - swiftproxy1 Current Load on swiftproxy1 is CRITICAL: LOAD CRITICAL - total load average: 49.37, 34.51, 15.69 [19:44:15] RECOVERY - swiftproxy1 SSH on swiftproxy1 is OK: SSH OK - OpenSSH_9.2p1 Debian-2+deb12u2 (protocol 2.0) [19:45:39] RECOVERY - swiftproxy1 PowerDNS Recursor on swiftproxy1 is OK: DNS OK: 0.276 seconds response time. wikitide.org returns 2001:41d0:801:2000::4089,51.75.170.66 [19:45:55] RECOVERY - swiftproxy1 ferm_active on swiftproxy1 is OK: OK ferm input default policy is set [19:57:43] PROBLEM - swiftproxy1 Current Load on swiftproxy1 is WARNING: LOAD WARNING - total load average: 0.09, 3.03, 7.89 [20:01:36] RECOVERY - swiftproxy1 Current Load on swiftproxy1 is OK: LOAD OK - total load average: 0.31, 1.61, 6.24 [22:56:55] [02WikiTideOrg/dns] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/dns/compare/abf4b7867071...049ef5cc61e7 [22:56:58] [02WikiTideOrg/dns] 07AgentIsai 03049ef5c - Add cloud15 [23:12:01] [02WikiTideOrg/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/WikiTideOrg/puppet/compare/704401e17912...b24acef85105 [23:12:04] [02WikiTideOrg/puppet] 07Universal-Omega 03b24acef - Add paladox to sre [23:36:49] RECOVERY - puppet1 puppetserver on puppet1 is OK: TCP OK - 0.001 second response time on 10.0.0.100 port 8140 [23:39:29] PROBLEM - puppet1 APT on puppet1 is CRITICAL: APT CRITICAL: 31 packages available for upgrade (4 critical updates). [23:40:04] RECOVERY - cp4 Puppet on cp4 is OK: OK: Puppet is currently enabled, last run 53 seconds ago with 0 failures [23:41:08] RECOVERY - prometheus1 Puppet on prometheus1 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [23:41:31] RECOVERY - mon1 Puppet on mon1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:42:20] RECOVERY - phorge1 Puppet on phorge1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:43:32] RECOVERY - ldap1 Puppet on ldap1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:45:46] RECOVERY - swiftobject1 Puppet on swiftobject1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:47:15] RECOVERY - jobchron1 Puppet on jobchron1 is OK: OK: Puppet is currently enabled, last run 8 seconds ago with 0 failures [23:47:20] RECOVERY - cp6 Puppet on cp6 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [23:50:29] RECOVERY - puppet1 Puppet on puppet1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:50:54] RECOVERY - matomo1 Puppet on matomo1 is OK: OK: Puppet is currently enabled, last run 20 seconds ago with 0 failures [23:51:07] RECOVERY - cp2 Puppet on cp2 is OK: OK: Puppet is currently enabled, last run 6 seconds ago with 0 failures [23:51:26] RECOVERY - cp3 Puppet on cp3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:52:12] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [23:53:02] RECOVERY - cp5 Puppet on cp5 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [23:56:23] RECOVERY - db1 Puppet on db1 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [23:56:39] RECOVERY - cp1 Puppet on cp1 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [23:56:44] RECOVERY - bast1 Puppet on bast1 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures