[00:00:47] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 2.83, 2.82, 2.91 [00:05:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.67, 7.38, 7.79 [00:09:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.58, 7.95, 7.87 [00:10:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.16, 3.61, 3.50 [00:11:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.27, 7.62, 7.76 [00:12:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.40, 3.45, 3.45 [00:13:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.11, 7.73, 7.77 [00:14:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.11, 3.55, 3.48 [00:14:11] RECOVERY - cp25 Puppet on cp25 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:14:26] RECOVERY - cp24 Puppet on cp24 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [00:15:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.10, 7.64, 7.75 [00:16:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.37, 3.52, 3.48 [00:23:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.13, 7.28, 7.87 [00:27:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.51, 7.00, 7.53 [00:27:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.28, 6.91, 7.13 [00:29:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.68, 7.30, 7.59 [00:29:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.24, 6.33, 6.89 [00:30:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.24, 3.25, 3.37 [00:31:29] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.57, 6.24, 6.80 [00:39:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.86, 5.80, 6.65 [00:39:59] RECOVERY - antiguabarbudacalypso.com - LetsEncrypt on sslhost is OK: OK - Certificate 'antiguabarbudacalypso.com' will expire on Tue 19 Dec 2023 22:10:23 GMT +0000. [00:40:58] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.64, 3.43, 3.35 [00:42:55] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.37, 3.33, 3.32 [00:43:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.40, 6.99, 6.89 [00:44:25] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.13, 7.41, 6.92 [00:45:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.08, 6.65, 6.78 [00:46:24] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.66, 7.25, 6.93 [00:46:47] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.98, 3.72, 3.49 [00:49:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.48, 7.24, 6.99 [00:50:21] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.63, 6.46, 6.70 [00:53:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.09, 7.57, 7.17 [00:55:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.29, 6.92, 6.97 [00:57:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.53, 8.45, 7.50 [01:00:27] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.00, 3.29, 3.40 [01:04:11] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.23, 7.53, 7.00 [01:05:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.20, 7.39, 7.54 [01:06:10] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.27, 6.63, 6.73 [01:06:16] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.70, 3.53, 3.46 [01:07:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.93, 8.70, 7.98 [01:10:06] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.26, 6.66, 6.81 [01:11:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.81, 7.87, 7.77 [01:12:05] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.03, 7.08, 6.92 [01:12:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.95, 3.25, 3.36 [01:13:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.08, 7.92, 7.80 [01:14:03] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.64, 6.17, 6.61 [01:17:45] PROBLEM - cp25 HTTP 4xx/5xx ERROR Rate on cp25 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [01:18:07] PROBLEM - cp24 Current Load on cp24 is CRITICAL: LOAD CRITICAL - total load average: 370.72, 174.90, 65.91 [01:18:08] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 7.636 second response time [01:18:18] PROBLEM - cp34 HTTP 4xx/5xx ERROR Rate on cp34 is CRITICAL: CRITICAL - NGINX Error Rate is 99% [01:18:20] PROBLEM - cp25 Current Load on cp25 is CRITICAL: LOAD CRITICAL - total load average: 131.01, 81.80, 32.31 [01:18:36] PROBLEM - cp35 HTTP 4xx/5xx ERROR Rate on cp35 is CRITICAL: CRITICAL - NGINX Error Rate is 98% [01:18:44] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 8191 bytes in 0.353 second response time [01:19:04] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 51.222.12.133/cpweb, 2607:5300:205:200::1c93/cpweb [01:19:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.36, 7.64, 7.70 [01:19:24] PROBLEM - cp35 Current Load on cp35 is CRITICAL: LOAD CRITICAL - total load average: 143.02, 114.29, 49.06 [01:19:26] PROBLEM - cp34 Stunnel for mw134 on cp34 is CRITICAL: connect to address localhost and port 8111: Connection refused [01:19:28] PROBLEM - cp34 Stunnel for mon141 on cp34 is CRITICAL: connect to address localhost and port 8201: Connection refused [01:19:30] PROBLEM - cp34 Stunnel for mw142 on cp34 is CRITICAL: connect to address localhost and port 8109: Connection refused [01:19:31] PROBLEM - cp34 Current Load on cp34 is CRITICAL: LOAD CRITICAL - total load average: 14.40, 22.66, 10.95 [01:19:34] PROBLEM - cp34 Stunnel for mwtask141 on cp34 is CRITICAL: connect to address localhost and port 8150: Connection refused [01:19:34] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 4.52, 3.88, 2.95 [01:19:43] PROBLEM - cp34 Stunnel for reports121 on cp34 is CRITICAL: connect to address localhost and port 8205: Connection refused [01:19:45] RECOVERY - cp25 HTTP 4xx/5xx ERROR Rate on cp25 is OK: OK - NGINX Error Rate is 6% [01:20:05] RECOVERY - cp35 HTTPS on cp35 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3725 bytes in 0.404 second response time [01:20:07] PROBLEM - cp34 Stunnel for mw131 on cp34 is CRITICAL: connect to address localhost and port 8106: Connection refused [01:20:09] PROBLEM - cp34 Stunnel for puppet141 on cp34 is CRITICAL: connect to address localhost and port 8204: Connection refused [01:20:09] PROBLEM - cp34 Stunnel for matomo121 on cp34 is CRITICAL: connect to address localhost and port 8203: Connection refused [01:20:15] PROBLEM - cp34 Stunnel for test131 on cp34 is CRITICAL: connect to address localhost and port 8180: Connection refused [01:20:20] PROBLEM - cp34 Stunnel for mw141 on cp34 is CRITICAL: connect to address localhost and port 8108: Connection refused [01:20:30] PROBLEM - cp34 Stunnel for mw133 on cp34 is CRITICAL: connect to address localhost and port 8110: Connection refused [01:20:34] RECOVERY - cp35 HTTP 4xx/5xx ERROR Rate on cp35 is OK: OK - NGINX Error Rate is 7% [01:20:34] PROBLEM - cp34 Varnish Backends on cp34 is CRITICAL: 8 backends are down. mw131 mw132 mw141 mw142 mw133 mw134 mw143 mediawiki [01:20:40] PROBLEM - cp34 Stunnel for phab121 on cp34 is CRITICAL: connect to address localhost and port 8202: Connection refused [01:20:42] PROBLEM - cp34 Stunnel for mail121 on cp34 is CRITICAL: connect to address localhost and port 8200: Connection refused [01:20:43] PROBLEM - cp34 Stunnel for mw132 on cp34 is CRITICAL: connect to address localhost and port 8107: Connection refused [01:21:02] PROBLEM - cp34 Stunnel for mw143 on cp34 is CRITICAL: connect to address localhost and port 8112: Connection refused [01:21:04] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [01:21:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.18, 9.48, 8.47 [01:21:32] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 2.43, 3.18, 2.80 [01:25:26] RECOVERY - cp34 Stunnel for mw134 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8111 [01:25:28] RECOVERY - cp34 Stunnel for mon141 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8201 [01:25:30] RECOVERY - cp34 Stunnel for mw142 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8109 [01:25:31] PROBLEM - cp34 Current Load on cp34 is WARNING: LOAD WARNING - total load average: 0.24, 6.87, 7.45 [01:25:34] RECOVERY - cp34 Stunnel for mwtask141 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8150 [01:25:43] RECOVERY - cp34 Stunnel for reports121 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8205 [01:26:07] RECOVERY - cp34 Stunnel for mw131 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8106 [01:26:09] RECOVERY - cp34 Stunnel for puppet141 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8204 [01:26:09] RECOVERY - cp34 Stunnel for matomo121 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8203 [01:26:15] RECOVERY - cp34 Stunnel for test131 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8180 [01:26:18] RECOVERY - cp34 HTTP 4xx/5xx ERROR Rate on cp34 is OK: OK - NGINX Error Rate is 4% [01:26:20] RECOVERY - cp34 Stunnel for mw141 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8108 [01:26:28] RECOVERY - cp34 HTTPS on cp34 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3725 bytes in 0.398 second response time [01:26:30] RECOVERY - cp34 Stunnel for mw133 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8110 [01:26:34] RECOVERY - cp34 Varnish Backends on cp34 is OK: All 15 backends are healthy [01:26:40] RECOVERY - cp34 Stunnel for phab121 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8202 [01:26:42] RECOVERY - cp34 Stunnel for mail121 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8200 [01:26:43] RECOVERY - cp34 Stunnel for mw132 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8107 [01:27:02] RECOVERY - cp34 Stunnel for mw143 on cp34 is OK: TCP OK - 0.000 second response time on localhost port 8112 [01:27:31] RECOVERY - cp34 Current Load on cp34 is OK: LOAD OK - total load average: 0.56, 4.78, 6.60 [01:27:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 10.63, 7.01, 5.33 [01:28:27] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.89, 7.42, 6.35 [01:28:52] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 18.14, 12.14, 8.79 [01:29:25] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 4.23, 3.56, 3.06 [01:29:50] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.30, 6.76, 5.45 [01:30:21] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.59, 7.27, 6.43 [01:31:23] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 2.50, 3.19, 2.99 [01:31:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.28, 7.41, 5.90 [01:33:50] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 6.42, 7.02, 5.89 [01:34:10] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.03, 7.15, 6.56 [01:35:45] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.41, 6.46, 5.86 [01:36:04] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.02, 6.48, 6.40 [01:37:50] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.50, 6.48, 5.97 [01:40:20] PROBLEM - cp25 Current Load on cp25 is WARNING: LOAD WARNING - total load average: 0.04, 1.04, 7.84 [01:44:20] RECOVERY - cp25 Current Load on cp25 is OK: LOAD OK - total load average: 0.06, 0.49, 6.06 [01:49:24] PROBLEM - cp35 Current Load on cp35 is WARNING: LOAD WARNING - total load average: 0.47, 0.76, 7.42 [01:49:55] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 3.18, 2.05, 1.03 [01:51:24] RECOVERY - cp35 Current Load on cp35 is OK: LOAD OK - total load average: 0.58, 0.73, 6.60 [01:52:07] PROBLEM - cp24 Current Load on cp24 is WARNING: LOAD WARNING - total load average: 0.06, 0.26, 7.39 [01:54:07] RECOVERY - cp24 Current Load on cp24 is OK: LOAD OK - total load average: 0.02, 0.18, 6.50 [02:02:34] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.04, 6.88, 7.90 [02:10:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.02, 6.45, 7.10 [02:12:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.98, 6.90, 7.22 [02:15:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.45, 6.96, 7.91 [02:17:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.06, 7.49, 7.95 [02:18:29] PROBLEM - tep.wiki - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406495094299316 seconds [02:19:19] PROBLEM - burnout.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'burnout.wiki' expires in 15 day(s) (Sat 07 Oct 2023 02:06:30 GMT +0000). [02:20:24] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.60, 6.17, 6.77 [02:21:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.96, 6.63, 7.49 [02:23:52] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/462e5085c587...965f230d47f6 [02:23:53] [02miraheze/ssl] 07MirahezeSSLBot 03965f230 - Bot: Update SSL cert for burnout.wiki [02:25:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.99, 8.42, 7.95 [02:25:54] PROBLEM - phab121 Current Load on phab121 is WARNING: WARNING - load average: 0.63, 1.26, 1.98 [02:27:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.47, 7.51, 7.67 [02:29:14] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.88, 3.86, 3.49 [02:29:54] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.40, 0.83, 1.63 [02:30:17] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.50, 6.96, 6.91 [02:31:40] PROBLEM - legacygt.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'legacygt.wiki' expires in 15 day(s) (Sat 07 Oct 2023 02:19:13 GMT +0000). [02:32:15] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.31, 6.49, 6.75 [02:33:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.42, 3.68, 3.50 [02:35:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.19, 5.93, 6.77 [02:35:51] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/965f230d47f6...a622977495d1 [02:35:52] [02miraheze/ssl] 07MirahezeSSLBot 03a622977 - Bot: Update SSL cert for legacygt.wiki [02:41:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.85, 6.58, 6.84 [02:43:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.76, 8.17, 7.41 [02:45:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.80, 7.52, 7.26 [02:46:06] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.80, 7.28, 6.89 [02:48:05] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.37, 7.91, 7.12 [02:48:12] RECOVERY - tep.wiki - reverse DNS on sslhost is OK: SSL OK - tep.wiki reverse DNS resolves to cp24.miraheze.org - CNAME OK [02:48:38] RECOVERY - burnout.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'burnout.wiki' will expire on Wed 20 Dec 2023 01:23:45 GMT +0000. [02:49:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.11, 8.70, 7.76 [02:50:04] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.75, 7.30, 6.99 [02:51:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.76, 7.67, 7.50 [02:52:04] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.63, 6.31, 6.67 [02:53:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 14.21, 9.25, 8.03 [02:56:00] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.32, 6.83, 6.85 [02:57:59] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.23, 8.14, 7.31 [02:58:14] PROBLEM - evil.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'evil.wiki' expires in 15 day(s) (Sat 07 Oct 2023 02:44:08 GMT +0000). [02:59:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 4.56, 6.58, 6.83 [03:01:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.21, 7.71, 7.78 [03:01:43] RECOVERY - db142 Backups SQL on db142 is OK: FILE_AGE OK: /var/log/sql-backup.log is 102 seconds old and 0 bytes [03:01:56] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.53, 6.11, 6.64 [03:02:57] PROBLEM - wiki.evscope.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.evscope.org' expires in 15 day(s) (Sat 07 Oct 2023 02:53:24 GMT +0000). [03:03:16] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a622977495d1...62b080856359 [03:03:17] [02miraheze/ssl] 07MirahezeSSLBot 0362b0808 - Bot: Update SSL cert for evil.wiki [03:03:30] PROBLEM - mon141 Backups Grafana on mon141 is WARNING: FILE_AGE WARNING: /var/log/grafana-backup.log is 864188 seconds old and 92 bytes [03:05:54] PROBLEM - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikipedia.yogfront.ooo' expires in 15 day(s) (Sat 07 Oct 2023 02:36:09 GMT +0000). [03:06:21] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.51, 3.15, 3.35 [03:10:24] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/62b080856359...37edad6a4d72 [03:10:26] [02miraheze/ssl] 07MirahezeSSLBot 0337edad6 - Bot: Update SSL cert for wiki.evscope.org [03:13:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/37edad6a4d72...70ea88892b9a [03:13:09] [02miraheze/ssl] 07MirahezeSSLBot 0370ea888 - Bot: Update SSL cert for wikipedia.yogfront.ooo [03:16:18] PROBLEM - mystiverse.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'mystiverse.wiki' expires in 15 day(s) (Sat 07 Oct 2023 03:03:11 GMT +0000). [03:19:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.59, 6.33, 6.80 [03:22:00] PROBLEM - wiki.recaptime.eu.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.recaptime.eu.org' expires in 15 day(s) (Sat 07 Oct 2023 02:58:05 GMT +0000). [03:24:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/70ea88892b9a...b6e174a326d1 [03:24:04] [02miraheze/ssl] 07MirahezeSSLBot 03b6e174a - Bot: Update SSL cert for mystiverse.wiki [03:24:13] PROBLEM - wiki.kachow.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.kachow.org' expires in 15 day(s) (Sat 07 Oct 2023 02:52:43 GMT +0000). [03:25:54] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 4.88, 2.41, 1.27 [03:28:17] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b6e174a326d1...55af70cc7923 [03:28:18] [02miraheze/ssl] 07MirahezeSSLBot 0355af70c - Bot: Update SSL cert for wiki.recaptime.eu.org [03:28:41] PROBLEM - wiki.veloren.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.veloren.net' expires in 15 day(s) (Sat 07 Oct 2023 02:58:27 GMT +0000). [03:31:01] RECOVERY - legacygt.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'legacygt.wiki' will expire on Wed 20 Dec 2023 01:35:44 GMT +0000. [03:32:55] PROBLEM - dragdown.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dragdown.wiki' expires in 15 day(s) (Sat 07 Oct 2023 03:25:09 GMT +0000). [03:34:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [03:35:18] RECOVERY - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is OK: OK - Certificate 'wikipedia.yogfront.ooo' will expire on Wed 20 Dec 2023 02:13:02 GMT +0000. [03:35:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/55af70cc7923...353da94ea57b [03:35:43] [02miraheze/ssl] 07MirahezeSSLBot 03353da94 - Bot: Update SSL cert for wiki.kachow.org [03:37:54] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.70, 1.61, 1.60 [03:39:20] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/353da94ea57b...6a05021c08cf [03:39:21] [02miraheze/ssl] 07MirahezeSSLBot 036a05021 - Bot: Update SSL cert for wiki.veloren.net [03:39:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.70, 6.49, 6.20 [03:41:41] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.19, 6.18, 6.11 [03:44:01] PROBLEM - wikicompliance.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikicompliance.com' expires in 15 day(s) (Sat 07 Oct 2023 03:18:36 GMT +0000). [03:45:35] RECOVERY - mystiverse.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mystiverse.wiki' will expire on Wed 20 Dec 2023 02:23:56 GMT +0000. [03:47:15] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6a05021c08cf...f1a19c6dbe7a [03:47:18] [02miraheze/ssl] 07MirahezeSSLBot 03f1a19c6 - Bot: Update SSL cert for dragdown.wiki [03:51:00] RECOVERY - wiki.recaptime.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.recaptime.eu.org' will expire on Wed 20 Dec 2023 02:28:09 GMT +0000. [03:51:42] PROBLEM - persist.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'persist.wiki' expires in 15 day(s) (Sat 07 Oct 2023 03:34:41 GMT +0000). [03:53:10] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/f1a19c6dbe7a...b213744473d0 [03:53:12] [02miraheze/ssl] 07MirahezeSSLBot 03b213744 - Bot: Update SSL cert for wikicompliance.com [03:56:42] RECOVERY - evil.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'evil.wiki' will expire on Wed 20 Dec 2023 02:03:09 GMT +0000. [03:59:23] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/b213744473d0...98403409934f [03:59:26] [02miraheze/ssl] 07MirahezeSSLBot 039840340 - Bot: Update SSL cert for persist.wiki [03:59:48] RECOVERY - sparabel.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'sparabel.wiki' will expire on Sat 07 Oct 2023 20:33:09 GMT +0000. [04:01:54] RECOVERY - wiki.evscope.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.evscope.org' will expire on Wed 20 Dec 2023 02:10:17 GMT +0000. [04:03:14] PROBLEM - mariopedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'mariopedia.org' expires in 15 day(s) (Sat 07 Oct 2023 03:50:01 GMT +0000). [04:03:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/98403409934f...469310f15b12 [04:03:44] [02miraheze/ssl] 07MirahezeSSLBot 03469310f - Bot: Update SSL cert for mariopedia.org [04:04:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [04:07:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.65, 6.85, 6.51 [04:10:44] PROBLEM - swests.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'swests.org' expires in 15 day(s) (Sat 07 Oct 2023 03:41:52 GMT +0000). [04:11:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.76, 6.70, 6.55 [04:11:38] PROBLEM - www.lgbtqia.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.lgbtqia.wiki' expires in 15 day(s) (Sat 07 Oct 2023 04:07:51 GMT +0000). [04:12:31] RECOVERY - wikicompliance.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wikicompliance.com' will expire on Wed 20 Dec 2023 02:53:03 GMT +0000. [04:15:57] PROBLEM - wiki.cjgh.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.cjgh.xyz' expires in 15 day(s) (Sat 07 Oct 2023 03:57:31 GMT +0000). [04:16:54] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/469310f15b12...d30553a8c583 [04:16:54] [02miraheze/ssl] 07MirahezeSSLBot 03d30553a - Bot: Update SSL cert for swests.org [04:22:46] PROBLEM - knifepointhorror.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'knifepointhorror.wiki' expires in 15 day(s) (Sat 07 Oct 2023 04:12:03 GMT +0000). [04:23:39] RECOVERY - wiki.kachow.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.kachow.org' will expire on Wed 20 Dec 2023 02:35:32 GMT +0000. [04:25:43] PROBLEM - wiki.aoemods.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.aoemods.com' expires in 15 day(s) (Sat 07 Oct 2023 04:06:59 GMT +0000). [04:25:58] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d30553a8c583...d69c3b7d7df6 [04:25:59] [02miraheze/ssl] 07MirahezeSSLBot 03d69c3b7 - Bot: Update SSL cert for knifepointhorror.wiki [04:27:58] RECOVERY - wiki.veloren.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.veloren.net' will expire on Wed 20 Dec 2023 02:39:13 GMT +0000. [04:29:20] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.49, 6.85, 3.97 [04:30:03] PROBLEM - wiki.yahyabd.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.yahyabd.xyz' expires in 15 day(s) (Sat 07 Oct 2023 04:04:00 GMT +0000). [04:31:40] PROBLEM - sparabel.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address sparabel.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [04:31:43] RECOVERY - dragdown.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'dragdown.wiki' will expire on Wed 20 Dec 2023 02:47:07 GMT +0000. [04:33:30] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d69c3b7d7df6...6ad1832f02ac [04:33:32] [02miraheze/ssl] 07MirahezeSSLBot 036ad1832 - Bot: Update SSL cert for wiki.aoemods.com [04:34:40] PROBLEM - wiki.infomedia.co.uk - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.infomedia.co.uk' expires in 15 day(s) (Sat 07 Oct 2023 04:15:56 GMT +0000). [04:38:20] PROBLEM - roll-of-arms.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'roll-of-arms.com' expires in 15 day(s) (Sat 07 Oct 2023 04:08:25 GMT +0000). [04:38:49] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7567 MB (5% inode=99%); [04:40:27] RECOVERY - swests.org - LetsEncrypt on sslhost is OK: OK - Certificate 'swests.org' will expire on Wed 20 Dec 2023 03:16:46 GMT +0000. [04:41:33] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6ad1832f02ac...a49fd4d08947 [04:41:36] [02miraheze/ssl] 07MirahezeSSLBot 03a49fd4d - Bot: Update SSL cert for wiki.yahyabd.xyz [04:45:11] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 2.77, 7.10, 7.34 [04:46:38] PROBLEM - squareenixwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'squareenixwiki.com' expires in 15 day(s) (Sat 07 Oct 2023 04:21:47 GMT +0000). [04:47:10] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 2.75, 5.67, 6.78 [04:47:29] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a49fd4d08947...73f50561c57e [04:47:30] [02miraheze/ssl] 07MirahezeSSLBot 0373f5056 - Bot: Update SSL cert for roll-of-arms.com [04:49:42] RECOVERY - persist.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'persist.wiki' will expire on Wed 20 Dec 2023 02:59:16 GMT +0000. [04:51:06] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 25.72, 14.68, 9.95 [04:55:37] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/73f50561c57e...6290d9f9ecad [04:55:38] [02miraheze/ssl] 07MirahezeSSLBot 036290d9f - Bot: Update SSL cert for squareenixwiki.com [04:59:46] PROBLEM - wiki.yahyabd.xyz - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:00:37] PROBLEM - cp35 HTTP 4xx/5xx ERROR Rate on cp35 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [05:00:49] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 15166 MB (11% inode=99%); [05:01:00] PROBLEM - buildabearwiki.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'buildabearwiki.info' expires in 15 day(s) (Sat 07 Oct 2023 04:50:20 GMT +0000). [05:01:04] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 8 datacenters are down: 51.195.201.140/cpweb, 51.89.139.24/cpweb, 2001:41d0:801:2000::5d68/cpweb, 2001:41d0:801:2000::3a18/cpweb, 51.222.14.30/cpweb, 51.222.12.133/cpweb, 2607:5300:205:200::3121/cpweb, 2607:5300:205:200::1c93/cpweb [05:01:13] PROBLEM - cp24 HTTP 4xx/5xx ERROR Rate on cp24 is CRITICAL: CRITICAL - NGINX Error Rate is 73% [05:01:25] PROBLEM - cp35 Current Load on cp35 is CRITICAL: LOAD CRITICAL - total load average: 394.50, 227.07, 93.10 [05:01:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.28, 6.95, 6.11 [05:01:29] PROBLEM - swiftproxy111 HTTPS on swiftproxy111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:01:33] PROBLEM - cp34 Current Load on cp34 is CRITICAL: LOAD CRITICAL - total load average: 254.16, 76.78, 27.56 [05:01:39] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 51.222.14.30/cpweb, 51.222.12.133/cpweb, 2607:5300:205:200::3121/cpweb, 2607:5300:205:200::1c93/cpweb [05:02:07] PROBLEM - cp24 Current Load on cp24 is CRITICAL: LOAD CRITICAL - total load average: 71.41, 88.35, 39.20 [05:02:12] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 4.648 second response time [05:02:20] PROBLEM - cp25 Current Load on cp25 is CRITICAL: LOAD CRITICAL - total load average: 127.91, 152.04, 67.38 [05:02:22] PROBLEM - cp34 HTTP 4xx/5xx ERROR Rate on cp34 is CRITICAL: CRITICAL - NGINX Error Rate is 98% [05:02:24] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6290d9f9ecad...fe7a9d31ea22 [05:02:27] [02miraheze/ssl] 07MirahezeSSLBot 03fe7a9d3 - Bot: Update SSL cert for wiki.infomedia.co.uk [05:02:39] RECOVERY - mariopedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'mariopedia.org' will expire on Wed 20 Dec 2023 03:03:36 GMT +0000. [05:02:47] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 7.20, 4.78, 3.19 [05:02:53] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:03:13] RECOVERY - cp24 HTTP 4xx/5xx ERROR Rate on cp24 is OK: OK - NGINX Error Rate is 7% [05:03:26] RECOVERY - swiftproxy111 HTTPS on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 352 bytes in 2.659 second response time [05:03:39] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [05:04:09] RECOVERY - cp35 HTTPS on cp35 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3724 bytes in 0.413 second response time [05:04:18] RECOVERY - cp34 HTTP 4xx/5xx ERROR Rate on cp34 is OK: OK - NGINX Error Rate is 4% [05:04:34] RECOVERY - cp35 HTTP 4xx/5xx ERROR Rate on cp35 is OK: OK - NGINX Error Rate is 7% [05:04:50] RECOVERY - cp34 HTTPS on cp34 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3723 bytes in 0.422 second response time [05:05:04] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [05:05:38] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 13.70, 9.74, 6.81 [05:05:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.84, 5.38, 4.41 [05:06:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/fe7a9d31ea22...233e0450904a [05:06:09] [02miraheze/ssl] 07MirahezeSSLBot 03233e045 - Bot: Update SSL cert for buildabearwiki.info [05:06:49] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 13331 MB (10% inode=99%); [05:07:10] RECOVERY - roll-of-arms.com - LetsEncrypt on sslhost is OK: OK - Certificate 'roll-of-arms.com' will expire on Wed 20 Dec 2023 03:47:23 GMT +0000. [05:07:44] PROBLEM - txt-dex.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'txt-dex.com' expires in 15 day(s) (Sat 07 Oct 2023 04:47:35 GMT +0000). [05:07:45] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.91, 5.64, 4.64 [05:08:47] PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 2.61, 3.82, 3.36 [05:12:32] PROBLEM - en.omniversalis.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'en.omniversalis.org' expires in 15 day(s) (Sat 07 Oct 2023 05:05:00 GMT +0000). [05:12:41] PROBLEM - royal-wiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'royal-wiki.org' expires in 15 day(s) (Sat 07 Oct 2023 05:06:55 GMT +0000). [05:12:47] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 4.69, 4.17, 3.59 [05:14:32] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/233e0450904a...741e3a8a8bb9 [05:14:35] [02miraheze/ssl] 07MirahezeSSLBot 03741e3a8 - Bot: Update SSL cert for txt-dex.com [05:17:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/741e3a8a8bb9...19208c0dc50c [05:17:46] [02miraheze/ssl] 07MirahezeSSLBot 0319208c0 - Bot: Update SSL cert for en.omniversalis.org [05:18:47] PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 2.61, 3.50, 3.52 [05:18:49] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 16150 MB (12% inode=99%); [05:20:53] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 1.12, 5.35, 7.80 [05:21:07] PROBLEM - iol.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'iol.wiki' expires in 15 day(s) (Sat 07 Oct 2023 04:58:04 GMT +0000). [05:21:08] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.24, 7.00, 6.19 [05:21:37] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/19208c0dc50c...05a70a93e0a0 [05:21:38] [02miraheze/ssl] 07MirahezeSSLBot 0305a70a9 - Bot: Update SSL cert for royal-wiki.org [05:22:18] RECOVERY - knifepointhorror.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'knifepointhorror.wiki' will expire on Wed 20 Dec 2023 03:25:52 GMT +0000. [05:24:53] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.81, 2.97, 6.25 [05:24:57] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.81, 6.54, 6.20 [05:25:08] RECOVERY - wiki.aoemods.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.aoemods.com' will expire on Wed 20 Dec 2023 03:33:23 GMT +0000. [05:28:07] PROBLEM - cp24 Current Load on cp24 is WARNING: LOAD WARNING - total load average: 0.14, 0.67, 7.41 [05:29:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/05a70a93e0a0...73ffc08025e8 [05:29:10] [02miraheze/ssl] 07MirahezeSSLBot 0373ffc08 - Bot: Update SSL cert for iol.wiki [05:29:19] RECOVERY - wiki.yahyabd.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.yahyabd.xyz' will expire on Wed 20 Dec 2023 03:41:26 GMT +0000. [05:30:07] RECOVERY - cp24 Current Load on cp24 is OK: LOAD OK - total load average: 0.23, 0.53, 6.54 [05:33:31] PROBLEM - cp34 Current Load on cp34 is WARNING: LOAD WARNING - total load average: 0.50, 0.61, 7.90 [05:34:00] RECOVERY - wiki.infomedia.co.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.infomedia.co.uk' will expire on Wed 20 Dec 2023 04:02:16 GMT +0000. [05:34:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [05:36:20] PROBLEM - cp25 Current Load on cp25 is WARNING: LOAD WARNING - total load average: 0.07, 0.27, 7.61 [05:36:47] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 2.19, 3.10, 3.36 [05:37:28] RECOVERY - txt-dex.com - LetsEncrypt on sslhost is OK: OK - Certificate 'txt-dex.com' will expire on Wed 20 Dec 2023 04:14:25 GMT +0000. [05:37:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.78, 7.42, 7.90 [05:37:31] RECOVERY - cp34 Current Load on cp34 is OK: LOAD OK - total load average: 0.09, 0.35, 6.13 [05:38:15] PROBLEM - wiki.virtualjet.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.virtualjet.net' expires in 15 day(s) (Sat 07 Oct 2023 05:15:03 GMT +0000). [05:38:20] RECOVERY - cp25 Current Load on cp25 is OK: LOAD OK - total load average: 0.23, 0.25, 6.71 [05:41:07] RECOVERY - en.omniversalis.org - LetsEncrypt on sslhost is OK: OK - Certificate 'en.omniversalis.org' will expire on Wed 20 Dec 2023 04:17:35 GMT +0000. [05:41:22] RECOVERY - royal-wiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'royal-wiki.org' will expire on Wed 20 Dec 2023 04:21:30 GMT +0000. [05:43:24] PROBLEM - cp35 Current Load on cp35 is WARNING: LOAD WARNING - total load average: 0.12, 0.32, 7.48 [05:45:24] RECOVERY - cp35 Current Load on cp35 is OK: LOAD OK - total load average: 0.25, 0.30, 6.60 [05:45:48] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/73ffc08025e8...9840a4a6bc3a [05:45:49] [02miraheze/ssl] 07MirahezeSSLBot 039840a4a - Bot: Update SSL cert for wiki.virtualjet.net [05:45:54] RECOVERY - squareenixwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'squareenixwiki.com' will expire on Wed 20 Dec 2023 03:55:30 GMT +0000. [05:47:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.82, 6.49, 7.78 [05:51:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.82, 7.39, 7.83 [05:51:29] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.86, 6.12, 6.76 [05:53:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.38, 7.20, 7.70 [05:54:13] PROBLEM - wiki.mostly.vet - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.mostly.vet' expires in 15 day(s) (Sat 07 Oct 2023 05:27:03 GMT +0000). [05:55:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.34, 7.78, 7.24 [05:57:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.59, 6.98, 7.03 [05:59:01] RECOVERY - buildabearwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'buildabearwiki.info' will expire on Wed 20 Dec 2023 04:06:01 GMT +0000. [05:59:08] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/9840a4a6bc3a...b27d3947df37 [05:59:09] [02miraheze/ssl] 07MirahezeSSLBot 03b27d394 - Bot: Update SSL cert for wiki.mostly.vet [06:01:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.04, 7.17, 7.33 [06:03:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.51, 7.17, 7.01 [06:04:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [06:05:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.67, 7.45, 7.43 [06:05:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.85, 7.08, 7.00 [06:07:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.06, 7.38, 7.10 [06:09:29] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.96, 6.44, 6.79 [06:11:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.36, 6.12, 6.78 [06:11:22] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.02, 3.57, 3.02 [06:13:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.76, 3.54, 3.06 [06:15:16] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.76, 4.33, 3.41 [06:21:04] RECOVERY - iol.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'iol.wiki' will expire on Wed 20 Dec 2023 04:29:01 GMT +0000. [06:21:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.01, 3.98, 3.63 [06:23:05] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 3.96, 4.03, 3.69 [06:25:02] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.76, 3.88, 3.67 [06:26:59] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.33, 4.03, 3.75 [06:31:41] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.43, 7.52, 6.92 [06:35:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.97, 6.48, 6.66 [06:36:15] RECOVERY - wiki.virtualjet.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.virtualjet.net' will expire on Wed 20 Dec 2023 04:45:41 GMT +0000. [06:40:40] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.32, 3.86, 3.98 [06:44:34] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.10, 3.86, 3.94 [06:48:29] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.81, 3.99, 3.98 [06:53:41] RECOVERY - wiki.mostly.vet - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mostly.vet' will expire on Wed 20 Dec 2023 04:59:01 GMT +0000. [06:55:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.24, 6.93, 6.51 [06:57:41] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.36, 6.45, 6.37 [06:58:15] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.51, 4.10, 3.97 [07:26:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.81, 3.26, 3.88 [07:32:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.78, 2.66, 3.38 [07:44:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.60, 3.59, 3.34 [07:46:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.95, 3.34, 3.29 [08:06:37] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is WARNING: WARNING - load average: 0.61, 1.29, 7.22 [08:08:37] RECOVERY - swiftproxy131 Current Load on swiftproxy131 is OK: OK - load average: 0.97, 1.23, 6.48 [08:12:17] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.94, 5.96, 5.56 [08:14:16] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.03, 5.23, 5.34 [09:13:41] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.83, 6.75, 6.08 [09:15:35] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.87, 6.19, 5.96 [09:47:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.71, 7.53, 6.45 [09:51:37] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.27, 6.38, 6.26 [10:15:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.70, 6.48, 6.11 [10:17:22] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.48, 5.65, 5.85 [10:20:16] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.93, 3.43, 2.99 [10:22:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.07, 3.25, 2.98 [10:28:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.79, 3.40, 3.12 [10:30:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.92, 3.28, 3.11 [11:04:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [11:11:01] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.50, 4.01, 3.31 [11:14:55] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.23, 3.35, 3.23 [11:20:57] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/4915e17254b1...ebeb12e7232b [11:21:00] [02miraheze/CreateWiki] 07translatewiki 03ebeb12e - Localisation updates from https://translatewiki.net. [11:21:08] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/dfeed49dc50e...dfb04d5c0791 [11:21:10] [02miraheze/DataDump] 07translatewiki 03dfb04d5 - Localisation updates from https://translatewiki.net. [11:28:44] miraheze/DataDump - translatewiki the build passed. [11:32:37] miraheze/CreateWiki - translatewiki the build passed. [11:34:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query pt.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:40:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-11 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/100817031a39 [11:40:16] [02miraheze/puppet] 07paladox 031008170 - var ish: Don't track port 81 in ferm [11:40:18] [02puppet] 07paladox created branch 03paladox-patch-11 - 13https://github.com/miraheze/puppet [11:40:20] [02puppet] 07paladox opened pull request 03#3428: var ish: Don't track port 81 in ferm - 13https://github.com/miraheze/puppet/pull/3428 [11:42:41] [02puppet] 07paladox synchronize pull request 03#3428: var ish: Don't track port 81 in ferm - 13https://github.com/miraheze/puppet/pull/3428 [11:42:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-11 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/100817031a39...bc7862e3cd8f [11:42:43] [02miraheze/puppet] 07paladox 03bc7862e - Update varnish.pp [11:48:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.52, 3.28, 3.00 [11:52:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.68, 3.88, 3.29 [11:58:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.43, 3.81, 3.50 [12:02:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.10, 3.79, 3.54 [12:04:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.41, 3.61, 3.51 [12:04:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [12:06:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.56, 4.29, 3.77 [12:23:23] [02puppet] 07paladox closed pull request 03#3428: var ish: Don't track port 81 in ferm - 13https://github.com/miraheze/puppet/pull/3428 [12:23:26]