[00:01:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 12.18, 6.24, 4.56 [00:06:04] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.49, 3.29, 2.15 [00:06:42] RECOVERY - cp33 Disk Space on cp33 is OK: DISK OK - free space: / 14209 MB (18% inode=98%); [00:08:04] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.61, 3.22, 2.26 [00:10:04] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.80, 3.00, 2.29 [00:14:04] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.56, 3.19, 2.52 [00:20:04] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.27, 2.83, 2.61 [00:29:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.91, 2.82, 3.81 [00:33:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.97, 3.85, 3.98 [00:35:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.22, 3.86, 3.99 [00:37:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.85, 4.81, 4.32 [00:42:04] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.61, 3.35, 2.94 [00:46:04] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 5.11, 4.09, 3.32 [00:48:04] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.07, 3.60, 3.23 [00:49:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.41, 3.52, 3.96 [00:50:04] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.63, 3.40, 3.21 [00:51:02] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [00:57:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.81, 2.64, 3.39 [01:03:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.50, 3.21, 3.36 [01:04:58] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.51, 3.53, 3.29 [01:05:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.00, 3.08, 3.28 [01:06:56] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.95, 3.39, 3.27 [01:11:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.14, 3.51, 3.40 [01:15:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.82, 2.85, 3.19 [01:20:36] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [01:23:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.81, 3.95, 3.49 [02:17:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.23, 3.43, 3.94 [02:17:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.57, 3.07, 2.42 [02:19:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.79, 3.60, 3.92 [02:21:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.52, 3.33, 3.77 [02:21:59] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.39, 3.32, 2.68 [02:25:23] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [02:31:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.10, 2.69, 3.25 [02:44:04] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.70, 3.01, 2.45 [02:48:04] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.86, 3.17, 2.66 [02:53:10] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [02:55:23] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nj.cn.eu.org could not be found [02:56:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.49, 3.67, 3.34 [02:58:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.38, 3.09, 3.16 [03:02:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 12.28, 7.35, 4.78 [03:16:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.39, 3.33, 3.98 [03:17:59] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.91, 5.75, 4.77 [03:31:06] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1102981269 secs [03:41:06] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.09708827734 secs [03:41:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.45, 3.67, 3.98 [03:47:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.05, 3.77, 3.88 [03:49:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.20, 3.25, 3.68 [03:52:18] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [03:53:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.87, 5.28, 4.37 [03:59:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.68, 3.69, 3.93 [04:07:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.12, 4.14, 3.96 [04:09:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.15, 3.78, 3.85 [04:15:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.42, 3.78, 3.71 [04:17:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.06, 3.51, 3.62 [04:21:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.25, 4.33, 3.95 [04:27:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.21, 3.96, 3.94 [04:37:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.57, 2.46, 3.18 [05:07:26] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.16, 4.05, 3.36 [05:09:00] PROBLEM - cloud.neptune.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'cloud.neptune.wiki' expires in 15 day(s) (Tue 15 Aug 2023 05:02:11 GMT +0000). [05:09:23] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.07, 3.60, 3.26 [05:10:48] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/1cf6bdb45499...a0db4e913ed3 [05:10:49] [02miraheze/ssl] 07MirahezeSSLBot 03a0db4e9 - Bot: Update SSL cert for cloud.neptune.wiki [05:11:20] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.05, 3.11, 3.13 [05:15:17] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.79, 3.70, 3.38 [05:17:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.68, 3.96, 3.51 [05:32:49] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.24, 3.27, 3.80 [05:34:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.32, 3.94, 3.95 [05:36:43] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.36, 3.31, 3.72 [05:38:30] RECOVERY - cloud.neptune.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'cloud.neptune.wiki' will expire on Sat 28 Oct 2023 04:10:40 GMT +0000. [05:47:06] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1185796261 secs [05:48:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.80, 2.81, 3.40 [05:55:23] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [05:59:06] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.08628556132 secs [06:00:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.75, 3.43, 3.33 [06:00:58] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:06:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.71, 3.40, 3.35 [06:11:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.99, 3.29, 2.40 [06:13:59] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.91, 3.16, 2.46 [06:19:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.62, 3.35, 2.76 [06:25:59] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.15, 3.85, 3.17 [06:27:55] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.64, 5.84, 3.00 [06:27:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.60, 3.69, 3.20 [06:31:55] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.79, 2.93, 2.43 [06:35:59] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.54, 3.40, 3.30 [06:39:59] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.64, 3.85, 3.49 [06:41:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.43, 3.72, 3.49 [06:51:59] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.02, 3.81, 3.62 [06:55:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.57, 3.87, 3.70 [07:00:36] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [07:01:59] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.99, 2.82, 3.32 [07:06:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.52, 4.36, 3.53 [07:08:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.26, 3.50, 3.30 [07:10:36] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.17, 3.03, 3.15 [07:25:22] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nj.cn.eu.org could not be found [07:30:25] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:40:49] PROBLEM - puppetdb121 APT on puppetdb121 is CRITICAL: APT CRITICAL: 3 packages available for upgrade (3 critical updates). [07:59:33] PROBLEM - mw142 APT on mw142 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [08:01:34] PROBLEM - mw142 APT on mw142 is CRITICAL: APT CRITICAL: 85 packages available for upgrade (30 critical updates). [08:25:23] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [08:30:03] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [08:52:44] PROBLEM - cloud13 Puppet on cloud13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [08:59:52] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [09:20:43] RECOVERY - cloud13 Puppet on cloud13 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [09:25:22] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nj.cn.eu.org could not be found [09:29:10] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:58:44] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [10:01:27] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:25:24] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [11:30:57] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [11:55:23] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nj.cn.eu.org could not be found [12:02:43] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [12:11:59] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.44, 3.37, 2.54 [12:13:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.86, 3.36, 2.63 [12:15:59] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.85, 3.14, 2.64 [12:25:23] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [12:32:32] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:36:53] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.13, 3.41, 3.07 [12:42:49] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.18, 3.87, 3.45 [12:50:44] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.72, 3.34, 3.37 [13:03:50] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [13:32:11] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [13:32:40] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [13:58:53] PROBLEM - wiki.zulaclub.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.zulaclub.net' expires in 15 day(s) (Tue 15 Aug 2023 13:56:21 GMT +0000). [14:07:13] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a0db4e913ed3...57db6cb405b5 [14:07:16] [02miraheze/ssl] 07MirahezeSSLBot 0357db6cb - Bot: Update SSL cert for wiki.zulaclub.net [14:23:33] PROBLEM - dutki.kro.kr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dutki.kro.kr' expires in 15 day(s) (Tue 15 Aug 2023 14:13:56 GMT +0000). [14:28:47] RECOVERY - wiki.zulaclub.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zulaclub.net' will expire on Sat 28 Oct 2023 13:06:40 GMT +0000. [14:31:46] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/57db6cb405b5...660b9488d7f7 [14:31:48] [02miraheze/ssl] 07MirahezeSSLBot 03660b948 - Bot: Update SSL cert for dutki.kro.kr [14:52:36] RECOVERY - dutki.kro.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'dutki.kro.kr' will expire on Sat 28 Oct 2023 13:31:39 GMT +0000. [14:59:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.66, 3.12, 2.56 [15:05:59] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.19, 2.96, 2.72 [15:25:23] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nj.cn.eu.org could not be found [15:41:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.47, 2.64, 2.25 [15:43:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.04, 3.18, 2.48 [15:45:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.92, 3.17, 2.54 [15:47:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.30, 2.78, 2.48 [15:55:28] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [16:14:57] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.09, 3.41, 2.46 [16:16:55] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 3.15, 3.25, 2.51 [16:20:49] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.58, 3.49, 2.77 [16:25:22] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nj.cn.eu.org could not be found [16:26:43] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.42, 3.17, 2.92 [16:30:38] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.32, 3.43, 3.08 [16:32:36] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.48, 3.15, 3.03 [16:36:30] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.33, 3.67, 3.29 [16:38:28] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.50, 3.97, 3.45 [16:40:26] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.59, 3.76, 3.43 [16:44:23] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.82, 3.39, 3.36 [16:56:10] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.65, 3.42, 3.33 [17:00:06] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.56, 3.36, 3.36 [17:06:55] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.62, 3.22, 2.61 [17:08:54] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.22, 3.53, 2.80 [17:10:06] PROBLEM - wariopedia.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wariopedia.com' expires in 15 day(s) (Tue 15 Aug 2023 16:52:14 GMT +0000). [17:10:52] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.63, 3.68, 2.96 [17:12:51] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.12, 3.80, 3.09 [17:14:20] PROBLEM - emmytherobot.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'emmytherobot.wiki' expires in 15 day(s) (Tue 15 Aug 2023 17:10:44 GMT +0000). [17:14:50] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.44, 3.62, 3.10 [17:14:58] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/660b9488d7f7...dd45e6248e73 [17:15:00] [02miraheze/ssl] 07MirahezeSSLBot 03dd45e62 - Bot: Update SSL cert for wariopedia.com [17:18:48] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.92, 3.15, 3.03 [17:19:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/dd45e6248e73...cf83808b7df9 [17:19:41] [02miraheze/ssl] 07MirahezeSSLBot 03cf83808 - Bot: Update SSL cert for emmytherobot.wiki [17:25:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.05, 4.05, 3.27 [17:27:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.02, 3.76, 3.27 [17:29:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.82, 3.08, 3.08 [17:43:10] RECOVERY - emmytherobot.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'emmytherobot.wiki' will expire on Sat 28 Oct 2023 16:19:33 GMT +0000. [17:49:31] PROBLEM - wiki.ooer.ooo - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ooer.ooo' expires in 15 day(s) (Tue 15 Aug 2023 17:34:04 GMT +0000). [17:55:17] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/cf83808b7df9...360f654c840e [17:55:19] [02miraheze/ssl] 07MirahezeSSLBot 03360f654 - Bot: Update SSL cert for wiki.ooer.ooo [17:55:25] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [18:02:25] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zulaclub.net All nameservers failed to answer the query. [18:08:19] RECOVERY - wariopedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wariopedia.com' will expire on Sat 28 Oct 2023 16:14:50 GMT +0000. [18:14:10] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.34, 3.59, 2.73 [18:16:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.74, 3.68, 2.87 [18:18:08] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.51, 3.96, 3.07 [18:19:01] RECOVERY - wiki.ooer.ooo - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ooer.ooo' will expire on Sat 28 Oct 2023 16:55:10 GMT +0000. [18:24:04] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.57, 3.95, 3.39 [18:25:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.45, 3.64, 3.09 [18:27:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.35, 3.07, 2.94 [18:30:00] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.54, 4.10, 3.61 [18:35:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.80, 3.95, 3.70 [18:53:32] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.92, 4.00, 3.58 [18:55:22] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nj.cn.eu.org could not be found [18:55:29] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 9.23, 5.45, 4.13 [18:57:59] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.61, 2.79, 3.25 [19:00:28] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.zulaclub.net. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:03:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.71, 3.81, 3.81 [19:05:13] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.13, 3.90, 3.84 [19:07:10] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.53, 3.57, 3.74 [19:11:04] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.18, 4.22, 3.96 [19:13:01] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.25, 3.80, 3.83 [19:25:58] PROBLEM - cp23 APT on cp23 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [19:27:58] PROBLEM - cp23 APT on cp23 is CRITICAL: APT CRITICAL: 42 packages available for upgrade (7 critical updates). [19:28:36] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.43, 2.93, 3.29 [19:30:09] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:30:27] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [19:32:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.06, 4.64, 3.90 [19:40:24] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: connect to address 2a10:6740::6:403 and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [19:41:12] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 1 backends are down. mw131 [19:41:50] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 1 backends are down. mw131 [19:41:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.54, 2.96, 2.43 [19:42:03] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 1 backends are down. mw131 [19:42:24] RECOVERY - mw131 HTTPS on mw131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.012 second response time [19:42:39] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 1 backends are down. mw131 [19:43:59] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.05, 3.05, 2.53 [19:44:03] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 15 backends are healthy [19:44:42] PROBLEM - cp33 Disk Space on cp33 is WARNING: DISK WARNING - free space: / 8218 MB (10% inode=98%); [19:45:12] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 15 backends are healthy [19:45:50] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 15 backends are healthy [19:46:27] PROBLEM - mw131 HTTPS on mw131 is CRITICAL: connect to address 2a10:6740::6:403 and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [19:47:06] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: connect to address 2a10:6740::6:403 and port 443: Connection refusedHTTP CRITICAL - Unable to open TCP socket [19:48:03] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 1 backends are down. mw131 [19:48:24] RECOVERY - mw131 HTTPS on mw131 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 545 bytes in 0.008 second response time [19:49:07] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 1.707 second response time [19:49:12] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 1 backends are down. mw131 [19:49:50] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 1 backends are down. mw131 [19:49:56] PROBLEM - arru.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - arru.xyz All nameservers failed to answer the query. [19:50:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.79, 3.03, 3.85 [19:51:12] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 15 backends are healthy [19:51:50] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 15 backends are healthy [19:52:03] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 15 backends are healthy [19:52:39] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 15 backends are healthy [19:59:44] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [20:01:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.14, 2.72, 3.32 [20:07:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.97, 4.78, 3.92 [20:15:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.00, 3.93, 3.87 [20:19:56] PROBLEM - arru.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for arru.xyz could not be found [20:21:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.14, 3.30, 3.54 [20:23:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.20, 3.20, 3.47 [20:25:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.95, 3.08, 3.38 [20:31:57] [02miraheze/CreateWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/6cb253240ea3 [20:31:58] [02miraheze/CreateWiki] 07The-Voidwalker 036cb2532 - RequestWiki use zero instead of null if values missing [20:32:00] [02CreateWiki] 07The-Voidwalker created branch 03The-Voidwalker-patch-1 - 13https://github.com/miraheze/CreateWiki [20:32:02] [02CreateWiki] 07The-Voidwalker opened pull request 03#427: RequestWiki use zero instead of null if values missing - 13https://github.com/miraheze/CreateWiki/pull/427 [20:32:48] [02miraheze/CreateWiki] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/6cb253240ea3...b7851c91bcda [20:32:51] [02miraheze/CreateWiki] 07The-Voidwalker 03b7851c9 - Update SpecialRequestWiki.php [20:32:54] [02CreateWiki] 07The-Voidwalker synchronize pull request 03#427: RequestWiki use zero instead of null if values missing - 13https://github.com/miraheze/CreateWiki/pull/427 [20:34:45] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.16, 3.60, 3.52 [20:36:42] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.73, 2.95, 3.30 [20:44:58] miraheze/CreateWiki - The-Voidwalker the build passed. [20:45:32] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.45, 3.75, 3.55 [20:49:21] [02CreateWiki] 07paladox closed pull request 03#427: RequestWiki use zero instead of null if values missing - 13https://github.com/miraheze/CreateWiki/pull/427 [20:49:22] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/26fa48cb2d77...a92b25316fc4 [20:49:25] [02miraheze/CreateWiki] 07The-Voidwalker 03a92b253 - RequestWiki use zero instead of null if values missing (#427) [20:49:26] [02miraheze/CreateWiki] 07paladox deleted branch 03The-Voidwalker-patch-1 [20:49:26] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.64, 3.22, 3.39 [20:49:27] [02CreateWiki] 07paladox deleted branch 03The-Voidwalker-patch-1 - 13https://github.com/miraheze/CreateWiki [20:53:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.80, 4.25, 3.71 [20:59:50] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 1 backends are down. mw132 [21:00:39] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 1 backends are down. mw132 [21:01:12] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 1 backends are down. mw132 [21:01:20] miraheze/CreateWiki - paladox the build passed. [21:02:03] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 1 backends are down. mw132 [21:03:12] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 15 backends are healthy [21:03:50] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 15 backends are healthy [21:04:03] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 15 backends are healthy [21:04:39] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 15 backends are healthy [21:08:16] PROBLEM - mw141 Puppet on mw141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown) [21:09:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/c0ec63fd5f31...9cfb6e356f02 [21:09:16] [02miraheze/puppet] 07paladox 039cfb6e3 - php: increase max_requests to 10k [21:09:50] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 1 backends are down. mw141 [21:10:15] RECOVERY - mw141 Puppet on mw141 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:11:50] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 15 backends are healthy [21:12:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/9cfb6e356f02...9bc091c07ec8 [21:12:03] [02miraheze/puppet] 07paladox 039bc091c - jobrunner: require network service [21:12:53] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.47, 3.21, 3.87 [21:24:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.81, 3.72, 3.66 [21:26:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.72, 3.88, 3.74 [21:32:22] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.75, 4.62, 4.07 [21:37:58] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [21:47:58] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.37, 3.26, 3.82 [21:49:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.81, 4.06, 4.09 [21:51:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.68, 3.73, 3.95 [21:53:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.04, 4.19, 4.12 [21:55:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.71, 3.74, 3.96 [22:07:47] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [22:07:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.03, 2.77, 3.36 [22:13:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.18, 3.93, 3.67 [22:15:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.66, 3.55, 3.57 [22:21:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.93, 3.03, 3.32 [22:33:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.20, 3.75, 3.59 [22:39:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.08, 3.93, 3.68 [22:40:58] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [22:45:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.74, 3.93, 3.81 [22:47:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.56, 4.31, 3.97 [22:49:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.46, 3.74, 3.81 [23:03:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.16, 3.49, 3.57 [23:07:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.09, 3.42, 3.54 [23:09:24] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [23:09:51] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.96, 4.11, 3.76 [23:10:57] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [23:29:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.27, 3.48, 4.00 [23:32:36] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.85, 3.18, 2.68 [23:34:35] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.35, 3.22, 2.76 [23:39:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.13, 2.73, 3.35 [23:48:48] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.96, 4.18, 3.61 [23:50:45] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.70, 3.48, 3.42 [23:52:41] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.09, 3.31, 3.36