[00:00:04] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.71, 7.06, 6.95 [00:00:37] RECOVERY - swiftproxy131 Current Load on swiftproxy131 is OK: OK - load average: 4.10, 4.60, 6.65 [00:02:16] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/7b25e08b3bb8...38641037ad10 [00:02:18] [02miraheze/puppet] 07paladox 033864103 - varnish: slightly tune config [00:02:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/38641037ad10...22e7420a9e31 [00:02:30] [02miraheze/puppet] 07paladox 0322e7420 - Update varnish.systemd.erb [00:04:07] PROBLEM - cp24 Current Load on cp24 is WARNING: LOAD WARNING - total load average: 0.12, 1.44, 7.54 [00:05:55] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 12.12, 8.41, 7.47 [00:06:07] RECOVERY - cp24 Current Load on cp24 is OK: LOAD OK - total load average: 0.02, 0.97, 6.63 [00:06:20] PROBLEM - cp25 Current Load on cp25 is WARNING: LOAD WARNING - total load average: 0.02, 1.06, 7.94 [00:07:17] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.95, 6.89, 5.85 [00:07:35] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.54, 2.54, 1.59 [00:08:34] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 5.05, 3.90, 3.28 [00:08:38] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 9.89, 8.43, 7.19 [00:09:13] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.74, 7.51, 6.19 [00:09:22] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is CRITICAL: CRITICAL - load average: 11.42, 8.89, 7.63 [00:10:20] RECOVERY - cp25 Current Load on cp25 is OK: LOAD OK - total load average: 0.01, 0.49, 6.13 [00:10:26] [02dns] 07paladox closed pull request 03#439: Remove cp22/23 and cp32/33 from dns - 13https://github.com/miraheze/dns/pull/439 [00:10:27] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/56be3cf9c875...d4d08f362e5c [00:10:29] [02miraheze/dns] 07paladox 03d4d08f3 - Remove cp22/23 and cp32/33 from dns (#439) [00:10:31] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [00:10:33] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [00:11:01] !log [void@puppet141] restarting ns1 through cloud panel [00:11:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:11:24] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:11:35] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.49, 2.65, 1.87 [00:12:05] RECOVERY - ns1 Disk Space on ns1 is OK: DISK OK - free space: / 3847MiB (53% inode=83%); [00:12:25] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset -0.2572357357 secs [00:12:31] PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 3.30, 3.68, 3.33 [00:12:47] RECOVERY - ns1 Current Load on ns1 is OK: LOAD OK - total load average: 1.14, 0.62, 0.24 [00:13:05] RECOVERY - ns1 conntrack_table_size on ns1 is OK: OK: nf_conntrack is 0 % full [00:13:06] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 5.33, 6.95, 6.30 [00:13:06] RECOVERY - ns1 Puppet on ns1 is OK: OK: Puppet is currently enabled, last run 40 seconds ago with 0 failures [00:13:08] RECOVERY - ns1 SSH on ns1 is OK: SSH OK - OpenSSH_9.2p1 Debian-2 (protocol 2.0) [00:13:12] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is WARNING: WARNING - load average: 5.91, 7.41, 7.35 [00:13:25] RECOVERY - ns1 ferm_active on ns1 is OK: OK ferm input default policy is set [00:14:07] PROBLEM - cp24 Current Load on cp24 is CRITICAL: LOAD CRITICAL - total load average: 8.72, 5.19, 6.00 [00:14:20] PROBLEM - cp25 Current Load on cp25 is CRITICAL: LOAD CRITICAL - total load average: 9.05, 5.34, 6.85 [00:14:28] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.63, 7.87, 7.37 [00:15:02] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.59, 6.56, 6.23 [00:15:25] PROBLEM - mail121 Current Load on mail121 is CRITICAL: CRITICAL - load average: 11.51, 8.51, 3.75 [00:16:07] RECOVERY - cp24 Current Load on cp24 is OK: LOAD OK - total load average: 4.26, 5.40, 6.03 [00:16:20] RECOVERY - cp25 Current Load on cp25 is OK: LOAD OK - total load average: 3.21, 4.93, 6.56 [00:16:28] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 2.14, 2.89, 3.10 [00:17:01] RECOVERY - swiftproxy131 Current Load on swiftproxy131 is OK: OK - load average: 5.69, 6.11, 6.80 [00:19:35] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.84, 3.29, 2.46 [00:21:35] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.94, 3.11, 2.49 [00:22:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 10.40, 8.04, 7.50 [00:23:54] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.37, 7.46, 7.97 [00:26:08] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 5.80, 7.15, 7.30 [00:26:53] PROBLEM - mail121 Current Load on mail121 is WARNING: WARNING - load average: 0.82, 1.26, 1.99 [00:30:43] RECOVERY - mail121 Current Load on mail121 is OK: OK - load average: 0.15, 0.79, 1.65 [00:33:55] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.09, 6.27, 6.78 [00:35:35] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.55, 3.29, 2.81 [00:37:35] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.88, 3.18, 2.84 [00:45:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.55, 7.41, 6.79 [00:47:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.34, 6.93, 6.69 [00:49:45] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.86, 6.59, 6.59 [00:51:54] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.66, 5.91, 6.53 [00:53:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/22e7420a9e31...e47706200543 [00:53:58] [02miraheze/puppet] 07paladox 03e477062 - Update default.vcl [01:08:32] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/8085e8dea5e5 [01:08:33] [02miraheze/puppet] 07paladox 038085e8d - Update default.vcl [01:08:34] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [01:08:37] [02puppet] 07paladox opened pull request 03#3413: Update default.vcl - 13https://github.com/miraheze/puppet/pull/3413 [01:15:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 4.21, 6.13, 7.75 [01:17:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.62, 6.86, 7.79 [01:19:30] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.56, 6.72, 7.60 [01:19:54] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.96, 7.19, 6.44 [01:21:54] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.08, 7.05, 6.48 [01:25:54] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.13, 6.54, 6.40 [01:37:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.99, 7.30, 7.98 [01:39:29] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.14, 5.97, 6.75 [01:49:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.07, 7.13, 7.34 [01:53:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.09, 7.31, 7.35 [02:11:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.37, 6.13, 6.63 [02:22:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.71, 6.54, 6.18 [02:24:00] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.46, 6.38, 6.15 [02:39:50] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.05, 6.58, 6.05 [02:41:50] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.84, 5.81, 5.83 [02:42:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.85, 7.44, 6.62 [02:44:13] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.73, 6.60, 6.40 [03:01:08] RECOVERY - db131 Backups SQL on db131 is OK: FILE_AGE OK: /var/log/sql-backup.log is 67 seconds old and 0 bytes [03:34:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [04:03:47] [02CreateWiki] 07The-Voidwalker closed pull request 03#437: setContainersAccess: skip invalid/empty zone paths - 13https://github.com/miraheze/CreateWiki/pull/437 [04:03:50] [02miraheze/CreateWiki] 07The-Voidwalker deleted branch 03The-Voidwalker-patch-1 [04:03:52] [02CreateWiki] 07The-Voidwalker deleted branch 03The-Voidwalker-patch-1 - 13https://github.com/miraheze/CreateWiki [04:04:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [04:40:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.52, 3.37, 2.97 [04:42:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.63, 3.06, 2.91 [04:44:02] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset -0.09870263934 secs [05:05:35] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [05:29:54] PROBLEM - wiki.litek.top - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.litek.top All nameservers failed to answer the query. [05:30:35] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [05:40:22] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.30, 3.41, 3.22 [05:42:19] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.90, 3.19, 3.16 [05:59:54] PROBLEM - wiki.litek.top - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['dry.dnspod.net.', 'python.dnspod.net.'], 'CNAME': 'kahmiz.miraheze.org.'} [06:10:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.68, 3.26, 2.85 [06:12:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.20, 3.25, 2.90 [06:22:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.71, 3.54, 3.19 [06:24:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.18, 3.71, 3.29 [06:26:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.49, 3.56, 3.28 [06:38:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.31, 3.38, 3.39 [06:52:47] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.95, 3.74, 3.54 [07:01:54] PROBLEM - wiki.templeofludus.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query templeofludus.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:02:33] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.26, 3.10, 3.33 [07:16:42] PROBLEM - opendatascot.org - LetsEncrypt on sslhost is CRITICAL: connect to address opendatascot.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [07:21:08] PROBLEM - opendatascot.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for opendatascot.org could not be found [07:31:19] RECOVERY - wiki.templeofludus.org - reverse DNS on sslhost is OK: SSL OK - wiki.templeofludus.org reverse DNS resolves to cp25.miraheze.org - CNAME OK [09:04:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [09:34:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [10:05:55] [02puppet] 07paladox synchronize pull request 03#3413: Update default.vcl - 13https://github.com/miraheze/puppet/pull/3413 [10:05:58] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/8085e8dea5e5...ef0ccd1a152f [10:06:01] [02miraheze/puppet] 07paladox 03ef0ccd1 - Update default.vcl [10:07:06] [02puppet] 07paladox edited pull request 03#3413: varnish: slightly tune config - 13https://github.com/miraheze/puppet/pull/3413 [10:08:48] [02puppet] 07paladox closed pull request 03#3413: varnish: slightly tune config - 13https://github.com/miraheze/puppet/pull/3413 [10:08:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e47706200543...032b07f350b5 [10:08:54] [02miraheze/puppet] 07paladox 03032b07f - varnish: slightly tune config (#3413) [10:08:56] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [10:08:57] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [10:30:02] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.102001071 secs [11:13:32] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/4e9d2b94e616...7075f6399b4e [11:13:35] [02miraheze/MirahezeMagic] 07translatewiki 037075f63 - Localisation updates from https://translatewiki.net. [11:13:37] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/DataDump/compare/6b0b64b64ded...dfeed49dc50e [11:13:40] [02miraheze/DataDump] 07translatewiki 03dfeed49 - Localisation updates from https://translatewiki.net. [11:15:45] PROBLEM - ie.unigon.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ie.unigon.net' expires in 15 day(s) (Wed 04 Oct 2023 10:57:22 GMT +0000). [11:18:32] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/f1caddbfc410...c19e170aac21 [11:18:33] [02miraheze/ssl] 07MirahezeSSLBot 03c19e170 - Bot: Update SSL cert for ie.unigon.net [11:21:18] miraheze/DataDump - translatewiki the build passed. [11:24:04] miraheze/MirahezeMagic - translatewiki the build passed. [11:44:29] RECOVERY - ie.unigon.net - LetsEncrypt on sslhost is OK: OK - Certificate 'ie.unigon.net' will expire on Sun 17 Dec 2023 10:18:24 GMT +0000. [11:47:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/cf1d9f762878 [11:47:13] [02miraheze/puppet] 07paladox 03cf1d9f7 - varnish: lower thread_pool_max to 12k [11:47:15] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [11:47:18] [02puppet] 07paladox opened pull request 03#3414: varnish: lower thread_pool_max to 12k - 13https://github.com/miraheze/puppet/pull/3414 [11:47:35] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/cf1d9f762878...67c7d0f3ea18 [11:47:38] [02miraheze/puppet] 07paladox 0367c7d0f - Update cp24.yaml [11:47:38] [02puppet] 07paladox synchronize pull request 03#3414: varnish: lower thread_pool_max to 12k - 13https://github.com/miraheze/puppet/pull/3414 [11:47:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/67c7d0f3ea18...3f047830a110 [11:47:47] [02miraheze/puppet] 07paladox 033f04783 - Update cp25.yaml [11:47:49] [02puppet] 07paladox synchronize pull request 03#3414: varnish: lower thread_pool_max to 12k - 13https://github.com/miraheze/puppet/pull/3414 [11:47:56] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/3f047830a110...8659b17084f3 [11:47:57] [02miraheze/puppet] 07paladox 038659b17 - Update cp34.yaml [11:47:59] [02puppet] 07paladox synchronize pull request 03#3414: varnish: lower thread_pool_max to 12k - 13https://github.com/miraheze/puppet/pull/3414 [11:48:12] [02puppet] 07paladox closed pull request 03#3414: varnish: lower thread_pool_max to 12k - 13https://github.com/miraheze/puppet/pull/3414 [11:48:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/puppet/compare/032b07f350b5...60908b53a57b [11:48:16] [02miraheze/puppet] 07paladox 0360908b5 - varnish: lower thread_pool_max to 12k (#3414) [11:48:19] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [11:48:22] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [11:50:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-1/±0] 13https://github.com/miraheze/puppet/commit/2ba34918135f [11:50:18] [02miraheze/puppet] 07paladox 032ba3491 - Remove cp22/23 [11:50:21] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [11:50:22] [02puppet] 07paladox opened pull request 03#3415: Remove cp22/23 - 13https://github.com/miraheze/puppet/pull/3415 [11:50:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-1/±0] 13https://github.com/miraheze/puppet/compare/2ba34918135f...eb8769c8da78 [11:50:42] [02miraheze/puppet] 07paladox 03eb8769c - Delete hieradata/hosts/cp23.yaml [11:50:43] [02puppet] 07paladox synchronize pull request 03#3415: Remove cp22/23 - 13https://github.com/miraheze/puppet/pull/3415 [11:50:50] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/eb8769c8da78...c5556a0d353e [11:50:52] [02miraheze/puppet] 07paladox 03c5556a0 - Update site.pp [11:50:55] [02puppet] 07paladox synchronize pull request 03#3415: Remove cp22/23 - 13https://github.com/miraheze/puppet/pull/3415 [11:50:58] [02puppet] 07paladox closed pull request 03#3415: Remove cp22/23 - 13https://github.com/miraheze/puppet/pull/3415 [11:51:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-2/±1] 13https://github.com/miraheze/puppet/compare/60908b53a57b...d6b9fa33451d [11:51:01] [02miraheze/puppet] 07paladox 03d6b9fa3 - Remove cp22/23 (#3415) [11:51:04] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [11:51:05] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [11:51:55] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 14.52, 9.21, 6.00 [11:52:47] PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 4.00, 2.76, 2.10 [11:53:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 14.87, 14.37, 8.96 [11:53:30] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 16.85, 11.25, 7.20 [11:53:46] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 10.33, 6.73, 4.96 [11:53:50] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.84, 6.47, 4.69 [11:55:50] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.90, 6.09, 4.77 [11:56:47] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 3.39, 2.99, 2.35 [11:56:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.58, 3.38, 2.88 [11:57:55] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.90, 7.74, 6.43 [11:58:57] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.33, 3.35, 2.93 [11:59:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.23, 7.76, 6.04 [12:03:45] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.69, 6.67, 5.99 [12:05:54] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.66, 7.78, 6.88 [12:07:40] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.83, 3.92, 3.34 [12:07:55] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.09, 7.34, 6.82 [12:09:54] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.01, 6.71, 6.64 [12:13:54] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.39, 6.87, 6.74 [12:15:54] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.40, 6.63, 6.66 [13:03:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.76, 6.91, 7.79 [13:04:18] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.21, 3.63, 3.99 [13:05:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.06, 7.94, 8.07 [13:11:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.51, 7.47, 7.89 [13:12:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.19, 2.48, 3.26 [13:13:30] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.04, 7.23, 7.93 [13:15:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.11, 8.04, 8.04 [13:19:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.16, 8.50, 8.25 [13:22:47] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 4.30, 3.23, 2.56 [13:23:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.44, 7.37, 7.83 [13:23:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.40, 7.63, 7.97 [13:24:47] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 3.34, 3.38, 2.71 [13:25:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.06, 7.94, 8.05 [13:27:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.48, 8.44, 8.13 [13:29:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.34, 7.48, 7.80 [13:29:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.19, 7.38, 7.84 [13:39:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.55, 7.07, 7.30 [13:39:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.20, 7.37, 7.37 [13:41:01] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.93, 3.46, 3.05 [13:41:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.89, 7.15, 7.29 [13:43:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.34, 7.28, 7.30 [13:43:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.69, 7.87, 7.64 [13:45:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.19, 7.03, 7.22 [13:48:50] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.84, 3.34, 3.18 [13:59:29] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.00, 5.56, 6.54 [14:03:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 15.51, 8.78, 7.59 [14:06:25] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 7.27, 9.07, 7.99 [14:07:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.70, 7.55, 7.43 [14:08:24] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 4.28, 7.43, 7.52 [14:10:23] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.27, 8.63, 7.93 [14:12:22] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.87, 7.49, 7.59 [14:16:19] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.33, 7.44, 7.46 [14:18:18] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.35, 6.81, 7.21 [14:21:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.83, 8.25, 7.79 [14:23:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.41, 7.39, 7.52 [14:24:14] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.76, 5.90, 6.68 [14:29:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.65, 5.58, 6.67 [14:32:08] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.25, 7.48, 7.04 [14:38:05] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.71, 6.22, 6.67 [14:45:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.43, 8.21, 7.02 [14:45:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.83, 7.07, 6.89 [14:47:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.99, 7.56, 6.93 [14:51:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.73, 6.57, 6.69 [14:53:53] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.64, 6.52, 6.77 [14:57:49] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.57, 6.99, 7.00 [14:59:48] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.03, 6.06, 6.66 [15:01:19] [02miraheze/PDFEmbed] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-phan-config-0.13.0 [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/commit/82142f841903 [15:01:20] [02miraheze/PDFEmbed] 07dependabot[bot] 0382142f8 - Update mediawiki/mediawiki-phan-config requirement from 0.12.1 to 0.13.0 [15:01:22] [02PDFEmbed] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-phan-config-0.13.0 - 13https://github.com/miraheze/PDFEmbed [15:01:24] [02PDFEmbed] 07dependabot[bot] opened pull request 03#16: Update mediawiki/mediawiki-phan-config requirement from 0.12.1 to 0.13.0 - 13https://github.com/miraheze/PDFEmbed/pull/16 [15:01:25] [02PDFEmbed] 07dependabot[bot] labeled pull request 03#16: Update mediawiki/mediawiki-phan-config requirement from 0.12.1 to 0.13.0 - 13https://github.com/miraheze/PDFEmbed/pull/16 [15:05:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.33, 6.83, 6.63 [15:07:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.50, 6.38, 6.50 [15:07:37] miraheze/PDFEmbed - dependabot[bot] the build has errored. [15:23:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.06, 7.15, 6.77 [15:23:55] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.09, 3.47, 2.75 [15:25:53] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.76, 3.55, 2.87 [15:27:16] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.96, 6.53, 6.59 [15:34:25] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.09, 7.76, 6.80 [15:36:24] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.98, 7.33, 6.76 [15:37:36] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.18, 3.40, 3.18 [15:40:22] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.66, 6.05, 6.37 [15:45:29] PROBLEM - cp25 Disk Space on cp25 is WARNING: DISK WARNING - free space: / 8479MiB (10% inode=98%); [15:51:14] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.99, 6.90, 6.48 [15:55:11] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.56, 6.98, 6.55 [15:57:10] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.42, 6.80, 6.52 [15:57:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.88, 6.80, 6.32 [15:59:09] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.39, 6.25, 6.35 [15:59:17] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.47, 6.38, 6.22 [16:28:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.67, 3.46, 3.20 [16:36:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.23, 3.26, 3.23 [16:38:24] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.50, 3.55, 2.98 [16:40:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.30, 3.45, 3.33 [16:40:23] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 3.08, 3.33, 2.98 [16:46:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.93, 3.33, 3.33 [16:50:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.57, 3.66, 3.48 [16:54:18] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.90, 3.37, 3.05 [16:56:17] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.32, 2.89, 2.91 [17:05:24] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.83, 7.22, 6.08 [17:06:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.80, 3.07, 3.31 [17:09:21] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.24, 6.26, 5.96 [17:10:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.19, 3.69, 3.50 [17:12:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.46, 3.57, 3.47 [17:22:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.91, 3.27, 3.38 [17:25:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.33, 6.73, 6.15 [17:26:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.29, 3.68, 3.52 [17:27:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.80, 6.73, 6.22 [17:30:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.57, 3.72, 3.59 [17:39:53] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.38, 6.89, 6.51 [17:40:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.04, 3.93, 3.73 [17:41:47] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.06, 6.53, 6.42 [17:44:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.15, 3.71, 3.70 [18:06:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.27, 3.74, 3.62 [18:56:13] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.20, 6.73, 5.87 [18:58:12] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.36, 6.09, 5.74 [19:13:46] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.05, 6.51, 6.19 [19:15:40] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.53, 6.57, 6.26 [19:18:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.18, 3.51, 3.97 [19:22:39] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/d1163d052661 [19:22:42] [02miraheze/puppet] 07paladox 03d1163d0 - Fix thumb video generation [19:22:44] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [19:22:47] [02puppet] 07paladox opened pull request 03#3416: Fix thumb video generation - 13https://github.com/miraheze/puppet/pull/3416 [19:22:51] [02puppet] 07paladox closed pull request 03#3416: Fix thumb video generation - 13https://github.com/miraheze/puppet/pull/3416 [19:22:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/d6b9fa33451d...9b7b3f2fadf8 [19:22:55] [02miraheze/puppet] 07paladox 039b7b3f2 - Fix thumb video generation (#3416) [19:22:58] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [19:22:59] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [19:29:03] PROBLEM - antiguabarbudacalypso.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for antiguabarbudacalypso.com could not be found [19:40:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.30, 3.86, 3.73 [19:41:57] PROBLEM - antiguabarbudacalypso.com - LetsEncrypt on sslhost is CRITICAL: connect to address antiguabarbudacalypso.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [19:42:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.85, 3.85, 3.74 [20:04:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.13, 3.73, 3.62 [20:06:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.42, 3.56, 3.56 [20:07:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.27, 6.98, 6.19 [20:09:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.96, 6.10, 5.96 [20:10:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.13, 3.77, 3.63 [20:12:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.61, 3.69, 3.63 [20:54:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.12, 3.71, 3.58 [20:58:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.31, 3.72, 3.63 [21:15:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/dc4ec2d7161a [21:16:02] [02miraheze/puppet] 07paladox 03dc4ec2d - mediawiki: set proxy_buffering to off for static nginx config [21:16:04] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [21:16:06] [02puppet] 07paladox opened pull request 03#3417: mediawiki: set proxy_buffering to off for static nginx config - 13https://github.com/miraheze/puppet/pull/3417 [21:16:48] [02puppet] 07paladox closed pull request 03#3417: mediawiki: set proxy_buffering to off for static nginx config - 13https://github.com/miraheze/puppet/pull/3417 [21:16:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/9b7b3f2fadf8...eabe1215d76b [21:16:53] [02miraheze/puppet] 07paladox 03eabe121 - mediawiki: set proxy_buffering to off for static nginx config (#3417) [21:16:56] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [21:16:57] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [21:43:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/eabe1215d76b...2de86fe0551a [21:43:01] [02miraheze/puppet] 07paladox 032de86fe - varnish: change rate to 0.0 [21:44:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.21, 3.65, 3.53 [21:45:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/56473e1377a0 [21:45:14] [02miraheze/puppet] 07paladox 0356473e1 - varnish: use disk size [21:45:17] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [21:45:19] [02puppet] 07paladox opened pull request 03#3418: varnish: use disk size - 13https://github.com/miraheze/puppet/pull/3418 [21:46:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.56, 3.62, 3.54 [21:46:50] [02puppet] 07paladox closed pull request 03#3418: varnish: use disk size - 13https://github.com/miraheze/puppet/pull/3418 [21:46:51] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/2de86fe0551a...bb9453e2230a [21:46:54] [02miraheze/puppet] 07paladox 03bb9453e - varnish: use disk size (#3418) [21:46:56] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [21:46:57] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [21:52:02] PROBLEM - ns1 NTP time on ns1 is CRITICAL: NTP CRITICAL: Offset 0.501075834 secs [21:58:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.35, 3.04, 3.32 [22:05:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.24, 6.36, 5.54 [22:05:14] PROBLEM - cp24 HTTP 4xx/5xx ERROR Rate on cp24 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [22:05:19] PROBLEM - cp25 Stunnel for puppet141 on cp25 is CRITICAL: connect to address localhost and port 8204: Connection refused [22:05:24] PROBLEM - cp25 Stunnel for mw132 on cp25 is CRITICAL: connect to address localhost and port 8107: Connection refused [22:05:25] PROBLEM - cp35 Current Load on cp35 is CRITICAL: LOAD CRITICAL - total load average: 113.04, 49.81, 18.99 [22:05:25] PROBLEM - cp25 Stunnel for mw133 on cp25 is CRITICAL: connect to address localhost and port 8110: Connection refused [22:05:31] PROBLEM - cp34 Current Load on cp34 is CRITICAL: LOAD CRITICAL - total load average: 85.38, 59.53, 23.98 [22:05:32] PROBLEM - cp25 Stunnel for mw142 on cp25 is CRITICAL: connect to address localhost and port 8109: Connection refused [22:05:33] PROBLEM - cp25 Stunnel for test131 on cp25 is CRITICAL: connect to address localhost and port 8180: Connection refused [22:05:40] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 6 datacenters are down: 51.195.201.140/cpweb, 2001:41d0:801:2000::5d68/cpweb, 51.222.14.30/cpweb, 51.222.12.133/cpweb, 2607:5300:205:200::3121/cpweb, 2607:5300:205:200::1c93/cpweb [22:05:44] PROBLEM - cp25 Stunnel for phab121 on cp25 is CRITICAL: connect to address localhost and port 8202: Connection refused [22:05:45] PROBLEM - cp25 HTTP 4xx/5xx ERROR Rate on cp25 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [22:05:56] PROBLEM - recaptime.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:05:56] PROBLEM - wiki.cubestudios.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:05:57] PROBLEM - www.dovearchives.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:05:59] PROBLEM - swiftproxy111 Current Load on swiftproxy111 is CRITICAL: CRITICAL - load average: 27.72, 13.96, 5.79 [22:06:01] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:04] PROBLEM - cp25 Stunnel for mw141 on cp25 is CRITICAL: connect to address localhost and port 8108: Connection refused [22:06:07] PROBLEM - cp24 Current Load on cp24 is CRITICAL: LOAD CRITICAL - total load average: 155.77, 208.88, 94.70 [22:06:07] PROBLEM - cp34 Stunnel for mw131 on cp34 is CRITICAL: connect to address localhost and port 8106: Connection refused [22:06:09] PROBLEM - cp34 Stunnel for puppet141 on cp34 is CRITICAL: connect to address localhost and port 8204: Connection refused [22:06:09] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:09] PROBLEM - cp34 Stunnel for matomo121 on cp34 is CRITICAL: connect to address localhost and port 8203: Connection refused [22:06:10] PROBLEM - wiki.scvo.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:12] PROBLEM - pokemonwiki.info - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:14] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:15] PROBLEM - cp34 Stunnel for test131 on cp34 is CRITICAL: connect to address localhost and port 8180: Connection refused [22:06:16] PROBLEM - cp25 Stunnel for reports121 on cp25 is CRITICAL: connect to address localhost and port 8205: Connection refused [22:06:17] PROBLEM - baharna.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:17] PROBLEM - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:18] PROBLEM - cp34 HTTP 4xx/5xx ERROR Rate on cp34 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [22:06:19] PROBLEM - cp25 Stunnel for mw134 on cp25 is CRITICAL: connect to address localhost and port 8111: Connection refused [22:06:20] PROBLEM - cp34 Stunnel for mw141 on cp34 is CRITICAL: connect to address localhost and port 8108: Connection refused [22:06:21] PROBLEM - cp25 Current Load on cp25 is CRITICAL: LOAD CRITICAL - total load average: 8.84, 5.00, 2.11 [22:06:26] PROBLEM - cp25 Stunnel for mw143 on cp25 is CRITICAL: connect to address localhost and port 8112: Connection refused [22:06:29] PROBLEM - cp25 Stunnel for mon141 on cp25 is CRITICAL: connect to address localhost and port 8201: Connection refused [22:06:29] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: connect to address 2001:41d0:801:2000::5d68 and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [22:06:30] PROBLEM - cp34 Stunnel for mw133 on cp34 is CRITICAL: connect to address localhost and port 8110: Connection refused [22:06:31] PROBLEM - cp25 Stunnel for mw131 on cp25 is CRITICAL: connect to address localhost and port 8106: Connection refused [22:06:34] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 8 backends are down. mw131 mw132 mw141 mw142 mw133 mw134 mw143 mediawiki [22:06:35] PROBLEM - cp35 HTTP 4xx/5xx ERROR Rate on cp35 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [22:06:38] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is CRITICAL: CRITICAL - load average: 44.62, 25.16, 10.76 [22:06:40] PROBLEM - cp34 Stunnel for phab121 on cp34 is CRITICAL: connect to address localhost and port 8202: Connection refused [22:06:43] PROBLEM - cp34 Stunnel for mail121 on cp34 is CRITICAL: connect to address localhost and port 8200: Connection refused [22:06:44] PROBLEM - cp34 Stunnel for mw132 on cp34 is CRITICAL: connect to address localhost and port 8107: Connection refused [22:06:47] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 5.82, 4.30, 2.78 [22:06:50] PROBLEM - cp35 Varnish Backends on cp35 is WARNING: No backends detected. If this is an error, see readme.txt [22:06:53] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:54] PROBLEM - cp25 Stunnel for mwtask141 on cp25 is CRITICAL: connect to address localhost and port 8150: Connection refused [22:06:58] PROBLEM - cp25 Stunnel for matomo121 on cp25 is CRITICAL: connect to address localhost and port 8203: Connection refused [22:07:00] PROBLEM - cp25 Varnish Backends on cp25 is CRITICAL: 8 backends are down. mw131 mw132 mw141 mw142 mw133 mw134 mw143 mediawiki [22:07:02] PROBLEM - cp34 Stunnel for mw143 on cp34 is CRITICAL: connect to address localhost and port 8112: Connection refused [22:07:04] PROBLEM - cp25 Stunnel for mail121 on cp25 is CRITICAL: connect to address localhost and port 8200: Connection refused [22:07:04] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 7 datacenters are down: 51.195.201.140/cpweb, 51.89.139.24/cpweb, 2001:41d0:801:2000::5d68/cpweb, 2001:41d0:801:2000::3a18/cpweb, 51.222.12.133/cpweb, 2607:5300:205:200::3121/cpweb, 2607:5300:205:200::1c93/cpweb [22:07:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.43, 6.40, 5.66 [22:07:09] PROBLEM - nonciclopedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:07:13] PROBLEM - wiki.fediverse.kr - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.fediverse.kr and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:07:16] PROBLEM - wiki.valkyrienskies.org - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.valkyrienskies.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:07:21] PROBLEM - you.r-fit.cc - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:07:22] PROBLEM - www.lab612.at - LetsEncrypt on sslhost is CRITICAL: connect to address www.lab612.at and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:07:26] PROBLEM - cp34 Stunnel for mw134 on cp34 is CRITICAL: connect to address localhost and port 8111: Connection refused [22:07:28] PROBLEM - cp34 Stunnel for mon141 on cp34 is CRITICAL: connect to address localhost and port 8201: Connection refused [22:07:30] PROBLEM - cp34 Stunnel for mw142 on cp34 is CRITICAL: connect to address localhost and port 8109: Connection refused [22:07:34] PROBLEM - cp34 Stunnel for mwtask141 on cp34 is CRITICAL: connect to address localhost and port 8150: Connection refused [22:07:44] PROBLEM - cp34 Stunnel for reports121 on cp34 is CRITICAL: connect to address localhost and port 8205: Connection refused [22:07:55] PROBLEM - lab.wikimimo.com - LetsEncrypt on sslhost is CRITICAL: connect to address lab.wikimimo.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:07:55] PROBLEM - taswin.miraheze.org - Sectigo on sslhost is CRITICAL: connect to address taswin.miraheze.org and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:08:00] PROBLEM - mcdev.grantlmul.xyz - LetsEncrypt on sslhost is CRITICAL: connect to address mcdev.grantlmul.xyz and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:08:00] PROBLEM - wiki.kirbygang.com - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.kirbygang.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:08:01] PROBLEM - wiki.alathramc.com - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.alathramc.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:08:07] PROBLEM - www.hebammenwiki.de - LetsEncrypt on sslhost is CRITICAL: connect to address www.hebammenwiki.de and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:08:07] PROBLEM - wiki.oasismp.com - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.oasismp.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:08:08] PROBLEM - www.ethene.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.ethene.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:08:08] PROBLEM - notes.mridulpm.in - LetsEncrypt on sslhost is CRITICAL: connect to address notes.mridulpm.in and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [22:08:10]