[00:00:00] PROBLEM - projectsekai.miraheze.org - reverse DNS on sslhost is UNKNOWN: PROBLEM - projectsekai.miraheze.org - reverse DNS on sslhost is UNKNOWN: [00:00:01] PROBLEM - nexus.wiki - reverse DNS on sslhost is UNKNOWN: [00:00:01] PROBLEM - persist.wiki - reverse DNS on sslhost is UNKNOWN: [00:00:02] PROBLEM - crocwiki.com - reverse DNS on sslhost is UNKNOWN: [00:00:04] PROBLEM - wiki.miraheze.org - reverse DNS on sslhost is UNKNOWN: [00:00:05] PROBLEM - rare.miraheze.org - reverse DNS on sslhost is UNKNOWN: PROBLEM - wiki.minkyu.kim - reverse DNS on sslhost is UNKNOWN: [00:04:02] PROBLEM - savagepedia.wiki - reverse DNS on sslhost is UNKNOWN: PROBLEM - index.pdcommunity.ir - reverse DNS on sslhost is UNKNOWN: [00:04:02] PROBLEM - perpustaxaan.wiki - reverse DNS on sslhost is UNKNOWN: PROBLEM - antiguabarbudacalypso.com - reverse DNS on sslhost is UNKNOWN: [00:04:02] PROBLEM - grayravens.com - reverse DNS on sslhost is UNKNOWN: [00:04:02] PROBLEM - thepolicyhub.org.uk - reverse DNS on sslhost is UNKNOWN: [00:04:02] PROBLEM - wiki.otir.nl - reverse DNS on sslhost is UNKNOWN: [00:04:02] PROBLEM - wiki.site97.fr - reverse DNS on sslhost is UNKNOWN: [00:04:02] PROBLEM - wiki.mikrodev.com - reverse DNS on sslhost is UNKNOWN: [00:04:03] PROBLEM - www.rothwell-leeds.co.uk - reverse DNS on sslhost is UNKNOWN: [00:29:12] RECOVERY - legacygt.wiki - reverse DNS on sslhost is OK: SSL OK - legacygt.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [00:29:27] PROBLEM - www.electrowiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.electrowiki.org could not be found [00:29:37] PROBLEM - o.kaoyu666.cn - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for o.kaoyu666.cn could not be found [00:29:42] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.24, 2.32, 2.75 [00:29:43] RECOVERY - tl.awiki.org - reverse DNS on sslhost is OK: SSL OK - tl.awiki.org reverse DNS resolves to cp23.miraheze.org - CNAME OK [00:29:59] PROBLEM - wiki.miraheze.org - reverse DNS on sslhost is UNKNOWN: [00:29:59] PROBLEM - wiki.minkyu.kim - reverse DNS on sslhost is UNKNOWN: [00:29:59] PROBLEM - crocwiki.com - reverse DNS on sslhost is UNKNOWN: [00:30:14] PROBLEM - wiki.litek.top - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['python.dnspod.net.', 'dry.dnspod.net.'], 'CNAME': 'kahmiz.miraheze.org.'} [00:30:15] RECOVERY - crocwiki.com - reverse DNS on sslhost is OK: SSL OK - crocwiki.com reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [00:30:19] RECOVERY - wiki.umbranet.mandelbrotgames.com - reverse DNS on sslhost is OK: SSL OK - wiki.umbranet.mandelbrotgames.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [00:30:35] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.68, 5.92, 6.12 [00:30:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.58, 9.26, 10.67 [00:30:41] RECOVERY - wiki.denby.tech - reverse DNS on sslhost is OK: SSL OK - wiki.denby.tech reverse DNS resolves to cp23.miraheze.org - CNAME OK [00:30:55] RECOVERY - wiki.teessidehackspace.org.uk - reverse DNS on sslhost is OK: SSL OK - wiki.teessidehackspace.org.uk reverse DNS resolves to cp23.miraheze.org - CNAME OK [00:30:55] RECOVERY - pt.polandballwiki.com - reverse DNS on sslhost is OK: SSL OK - pt.polandballwiki.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [00:31:00] RECOVERY - wiki.minkyu.kim - reverse DNS on sslhost is OK: SSL OK - wiki.minkyu.kim reverse DNS resolves to cp22.miraheze.org - CNAME OK [00:31:25] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.40, 9.77, 10.38 [00:31:25] PROBLEM - nexus.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for nexus.wiki could not be found [00:31:25] RECOVERY - rct.wiki - reverse DNS on sslhost is OK: SSL OK - rct.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [00:31:26] RECOVERY - wiki.miraheze.org - reverse DNS on sslhost is OK: SSL OK - wiki.miraheze.org reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [00:31:26] RECOVERY - obeymewiki.com - reverse DNS on sslhost is OK: SSL OK - obeymewiki.com reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [00:32:22] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:32:24] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 14595 MB (10% inode=99%); [00:32:31] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.29, 10.56, 10.97 [00:35:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.78, 10.93, 10.63 [00:36:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.57, 10.80, 11.06 [00:37:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.89, 11.12, 10.75 [00:38:13] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.29, 11.86, 11.40 [00:38:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.09, 7.17, 6.56 [00:41:10] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 19.72, 14.26, 11.98 [00:42:13] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.50, 7.91, 7.04 [00:45:22] [02mediawiki] 07AgentIsai commented on pull request 03#15266: T10794: Add Extension:OOJSPlus - 13https://github.com/miraheze/mediawiki/pull/15266#issuecomment-1566335078 [00:45:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.52, 11.84, 11.66 [00:46:55] PROBLEM - mon141 Current Load on mon141 is WARNING: WARNING - load average: 0.19, 0.85, 3.83 [00:47:44] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.99, 13.17, 12.16 [00:48:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.14, 7.81, 7.28 [00:48:55] RECOVERY - mon141 Current Load on mon141 is OK: OK - load average: 0.10, 0.60, 3.38 [00:51:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.27, 6.70, 5.60 [00:52:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.14, 4.57, 3.78 [00:53:33] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.84, 6.42, 5.64 [00:53:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.39, 11.71, 11.87 [00:53:54] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.35, 7.79, 7.51 [00:55:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.17, 11.93, 11.93 [00:55:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.54, 8.40, 7.78 [00:57:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.69, 11.96, 11.96 [00:57:48] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.47, 7.81, 7.65 [00:57:51] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 31 seconds ago with 0 failures [00:58:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.61, 3.37, 3.64 [00:59:48] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.33, 8.10, 7.78 [01:00:12] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.08, 2.64, 3.34 [01:01:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.81, 12.37, 12.11 [01:01:45] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.74, 7.28, 7.52 [01:02:55] PROBLEM - mon141 Current Load on mon141 is CRITICAL: CRITICAL - load average: 2.56, 5.36, 4.03 [01:04:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.75, 3.93, 3.78 [01:04:55] PROBLEM - mon141 Current Load on mon141 is WARNING: WARNING - load average: 0.41, 3.63, 3.55 [01:06:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.03, 4.04, 3.84 [01:06:55] RECOVERY - mon141 Current Load on mon141 is OK: OK - load average: 0.32, 2.53, 3.15 [01:08:06] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.47, 3.48, 3.66 [01:09:33] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.07, 7.11, 7.20 [01:10:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.52, 2.82, 3.40 [01:13:17] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [01:15:23] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.28, 7.69, 7.45 [01:19:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.83, 7.68, 7.45 [01:22:06] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.14, 7.30, 6.32 [01:22:56] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.51, 3.87, 3.08 [01:24:03] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.42, 6.96, 6.32 [01:24:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.26, 3.18, 2.92 [01:26:00] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.28, 6.51, 6.23 [01:32:58] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [01:37:33] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.08, 4.36, 3.50 [01:38:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.04, 7.63, 7.95 [01:41:17] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:41:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.61, 3.44, 3.34 [01:42:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.59, 7.57, 7.81 [01:43:27] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.58, 3.16, 3.25 [01:43:43] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.61, 3.88, 3.30 [01:45:42] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.51, 3.76, 3.33 [01:47:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.18, 4.87, 3.92 [01:51:17] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.27, 3.92, 3.74 [01:52:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.36, 6.75, 7.71 [01:53:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.08, 3.87, 3.73 [01:53:38] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.45, 3.16, 3.28 [01:55:13] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.26, 3.46, 3.58 [01:56:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 13.86, 8.85, 8.20 [01:57:12] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.26, 3.64, 3.62 [01:59:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.53, 3.54, 3.58 [02:00:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.55, 7.49, 7.85 [02:02:18] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [02:03:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.23, 2.65, 3.25 [02:07:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.16, 3.46, 3.47 [02:09:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.04, 3.04, 3.32 [02:12:51] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.58, 5.93, 6.70 [02:17:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.31, 10.82, 11.79 [02:18:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.72, 10.97, 11.85 [02:20:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.17, 11.74, 12.01 [02:22:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.54, 11.25, 11.80 [02:25:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.14, 3.98, 3.42 [02:27:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.67, 3.34, 3.25 [02:27:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.68, 11.16, 11.32 [02:28:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.89, 11.88, 11.83 [02:31:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.09, 11.08, 11.35 [02:33:38] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [02:34:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.16, 11.71, 11.94 [02:39:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.22, 3.80, 3.44 [02:41:10] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.48, 4.86, 3.84 [02:43:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.31, 11.08, 11.09 [02:45:10] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.48, 3.61, 3.56 [02:45:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.48, 10.43, 10.85 [02:47:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.71, 11.76, 11.23 [02:48:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.99, 10.96, 11.04 [02:49:10] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.42, 3.11, 3.36 [02:50:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.92, 10.57, 10.89 [02:51:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.10, 10.61, 10.96 [02:52:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.13, 11.00, 10.97 [02:54:55] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.14, 7.48, 6.82 [02:55:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.22, 11.59, 11.22 [02:55:57] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.zulaclub.net. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [02:57:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.73, 10.84, 11.00 [02:58:04] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.69, 4.48, 3.76 [02:58:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.89, 6.87, 6.73 [03:00:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.05, 4.00, 3.67 [03:00:51] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.24, 6.11, 6.45 [03:01:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.52, 11.16, 11.04 [03:02:00] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.12, 4.11, 3.73 [03:03:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.65, 3.47, 3.54 [03:04:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.62, 4.19, 3.36 [03:04:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.06, 11.45, 11.54 [03:05:56] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.91, 2.89, 3.32 [03:06:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.54, 11.77, 11.64 [03:08:11] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 3.18, 3.17 [03:08:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.63, 10.86, 11.32 [03:09:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.76, 11.90, 11.56 [03:10:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.33, 11.20, 11.37 [03:12:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.62, 11.86, 11.64 [03:18:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.77, 11.34, 11.40 [03:20:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.65, 7.03, 6.72 [03:22:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.46, 7.77, 7.00 [03:22:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.70, 10.82, 11.20 [03:24:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.60, 3.19, 2.91 [03:26:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.18, 4.12, 3.29 [03:26:51] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.92, 6.54, 6.69 [03:32:19] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [03:33:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.25, 10.66, 10.68 [03:36:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.34, 7.50, 7.01 [03:40:19] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.05, 3.70, 3.89 [03:40:51] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.67, 6.54, 6.72 [03:40:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.25, 11.77, 11.02 [03:41:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 11.47, 11.22 [03:42:17] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.03, 3.81, 3.90 [03:42:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.96, 11.68, 11.08 [03:44:15] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.03, 3.39, 3.72 [03:47:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.74, 11.57, 11.22 [03:48:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.44, 10.89, 10.84 [03:50:09] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.70, 2.68, 3.33 [03:50:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.00, 10.83, 10.82 [03:51:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.98, 10.79, 11.02 [03:53:10] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [03:55:16] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1137733161 secs [03:56:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.99, 10.87, 10.71 [03:58:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.41, 10.57, 10.62 [04:03:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.43, 11.73, 11.16 [04:03:38] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [04:05:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.74, 11.61, 11.21 [04:06:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.12, 11.47, 10.95 [04:08:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.03, 11.09, 10.89 [04:10:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.47, 11.59, 11.07 [04:12:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.62, 11.60, 11.14 [04:20:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.46, 9.18, 10.14 [04:23:36] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.69, 9.29, 10.00 [04:25:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.55, 4.69, 3.34 [04:27:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.99, 3.84, 3.19 [04:29:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.34, 2.96, 2.94 [04:32:58] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [04:35:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.13, 10.74, 10.29 [04:37:36] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.04, 10.17, 10.14 [04:40:57] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.57, 11.54, 10.24 [04:42:01] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.82, 4.70, 2.41 [04:42:11] [02mw-config] 07AgentIsai closed pull request 03#5237: T10859: Add Echo parameters to ManageWiki - 13https://github.com/miraheze/mw-config/pull/5237 [04:42:14] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/85579d45d2f8...a91692b147e0 [04:42:16] [02miraheze/mw-config] 07brandon-wm 03a91692b - T10859: Add Echo parameters to ManageWiki (#5237) [04:43:16] miraheze/mw-config - AgentIsai the build passed. [04:44:00] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.97, 5.11, 2.86 [04:44:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.68, 11.97, 10.80 [04:45:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.69, 10.84, 10.35 [04:51:05] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.09881836176 secs [04:52:10] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=thelovettbrotherswiki --no-updates --username-prefix=wikia:the-series-ts-online /home/agent/ImportDump/thelovettbrotherswiki-20230522215340.xml (START) [04:52:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:52:32] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=thelovettbrotherswiki --no-updates --username-prefix=wikia:the-series-ts-online /home/agent/ImportDump/thelovettbrotherswiki-20230522215340.xml (END - exit=0) [04:52:33] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=thelovettbrotherswiki (START) [04:52:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:52:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:53:46] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=thelovettbrotherswiki (END - exit=0) [04:53:47] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=thelovettbrotherswiki --active --update (END - exit=0) [04:53:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:53:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:56:59] !log [@test131] starting deploy of {'config': True} to all [04:57:00] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [04:57:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:57:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:00:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.76, 9.53, 10.15 [05:01:36] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.04, 9.43, 10.06 [05:05:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.79, 10.01, 10.24 [05:07:36] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.12, 9.92, 10.16 [05:10:59] !log [@mwtask141] starting deploy of {'config': True} to all [05:11:06] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [05:11:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:11:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:20:59] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.39, 7.01, 6.58 [05:22:56] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.00, 6.36, 6.41 [06:11:16] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.12, 3.09, 2.27 [06:13:16] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.32, 3.06, 2.36 [06:17:59] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.83, 10.03, 9.18 [06:20:24] [02WikiDiscover] 07Reception123 closed pull request 03#100: Fix CI - 13https://github.com/miraheze/WikiDiscover/pull/100 [06:20:27] [02miraheze/WikiDiscover] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/0cb5612cc357...e22ac51883ad [06:20:28] [02miraheze/WikiDiscover] 07Universal-Omega 03e22ac51 - Fix CI (#100) [06:21:53] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.32, 9.37, 9.15 [06:24:14] miraheze/WikiDiscover - Reception123 the build passed. [06:29:16] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.28, 3.54, 2.93 [06:31:16] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.88, 3.28, 2.91 [06:35:23] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.43, 5.04, 2.62 [06:35:36] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.39, 10.28, 9.22 [06:37:23] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.14, 4.18, 2.60 [06:41:36] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.04, 9.91, 9.48 [06:48:08] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [06:52:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.33, 6.77, 6.29 [06:54:23] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.29, 5.88, 6.02 [06:58:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.27, 9.55, 9.03 [07:01:54] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.84, 8.30, 8.64 [07:02:56] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1579592228 secs [07:04:56] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.08729282022 secs [07:16:53] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [07:21:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.24, 7.48, 6.62 [07:23:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.97, 6.58, 6.38 [07:52:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.99, 6.95, 6.41 [07:54:51] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.86, 6.48, 6.29 [07:59:52] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2f492802697b...d3a8750abf1a [07:59:54] [02miraheze/ssl] 07Reception123 03d3a8750 - add www redirect for glitchcity.wiki [08:02:57] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/4e332bd012b5...be2cdbb12ff2 [08:02:59] [02miraheze/dns] 07Reception123 03be2cdbb - Add DNS zone for pyramidgames.wiki [08:05:02] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/d3a8750abf1a...2a35c552c778 [08:05:05] [02miraheze/ssl] 07MirahezeSSLBot 032a35c55 - Bot: Add SSL cert for pyramidgames.wiki [08:08:51] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2a35c552c778...bcd60e0898c1 [08:08:53] [02miraheze/ssl] 07Reception123 03bcd60e0 - add WWW pyramidgames.wiki redirect [08:19:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.51, 7.10, 6.40 [08:21:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.33, 6.74, 6.36 [08:32:56] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.41, 6.56, 6.27 [08:34:51] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.51, 6.22, 6.18 [08:37:31] PROBLEM - db121 Backups SQL on db121 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864121 seconds old and 44336409 bytes [08:42:31] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.93, 7.31, 6.64 [08:42:53] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset -0.1096353829 secs [08:44:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.79, 6.66, 6.47 [08:46:50] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset -0.0981887579 secs [08:48:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.72, 6.87, 6.62 [08:50:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.18, 8.68, 7.34 [08:52:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.83, 7.67, 7.13 [08:53:40] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1374117434 secs [08:57:50] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.74, 5.97, 6.57 [09:18:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.74, 6.54, 6.42 [09:21:14] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08794856071 secs [09:22:00] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.69, 6.28, 6.36 [09:31:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.81, 6.46, 6.37 [09:33:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.59, 5.73, 6.11 [09:37:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.02, 6.38, 6.29 [09:39:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.92, 6.29, 6.27 [09:45:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.59, 7.28, 6.79 [09:47:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.60, 6.73, 6.65 [10:13:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 8.00, 7.07, 6.42 [10:15:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.59, 7.44, 6.62 [10:16:02] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.48, 3.40, 2.22 [10:17:30] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.69, 10.39, 9.29 [10:18:01] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.81, 2.73, 2.11 [10:19:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.16, 10.92, 9.61 [10:19:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.74, 7.14, 6.68 [10:21:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.90, 11.52, 10.01 [10:21:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.89, 6.47, 6.50 [10:29:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.16, 10.74, 9.78 [10:29:29] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.42, 9.89, 9.87 [10:32:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.56, 11.46, 10.28 [10:33:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.20, 10.22, 10.07 [10:34:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.09, 11.29, 10.35 [10:35:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.64, 11.44, 10.55 [10:37:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.29, 10.74, 10.41 [10:41:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.11, 7.40, 6.83 [10:41:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.33, 11.57, 10.71 [10:44:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.58, 10.86, 10.41 [10:45:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.87, 11.30, 10.81 [10:46:18] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.83, 10.90, 10.47 [10:47:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.26, 6.19, 6.48 [10:47:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.07, 11.64, 10.97 [10:49:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.67, 11.44, 11.00 [10:51:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.17, 7.01, 6.76 [10:51:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.61, 12.22, 11.34 [10:52:19] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.22, 9.71, 10.14 [10:53:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.22, 7.68, 7.02 [10:55:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.95, 7.18, 6.94 [10:56:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.69, 11.14, 10.63 [10:57:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.91, 6.44, 6.70 [10:58:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.36, 11.17, 10.71 [10:59:29] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.41, 11.52, 11.59 [11:01:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.10, 6.85, 6.82 [11:03:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.04, 6.55, 6.71 [11:04:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 19.58, 13.83, 11.70 [11:05:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.89, 12.10, 11.69 [11:10:06] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/c08666a3adaf...6b5a3edd0bcc [11:10:09] [02miraheze/CreateWiki] 07translatewiki 036b5a3ed - Localisation updates from https://translatewiki.net. [11:10:12] [02miraheze/ImportDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/ImportDump/compare/888005704197...37f9f6ed8df4 [11:10:15] [02miraheze/ImportDump] 07translatewiki 0337f9f6e - Localisation updates from https://translatewiki.net. [11:10:16] [02miraheze/PDFEmbed] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/PDFEmbed/compare/c39557a61e22...f9956a3f6806 [11:10:19] [02miraheze/PDFEmbed] 07translatewiki 03f9956a3 - Localisation updates from https://translatewiki.net. [11:10:22] [02miraheze/ManageWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±7] 13https://github.com/miraheze/ManageWiki/compare/b866b3a7c135...3b9a3f9ffa33 [11:10:23] [02miraheze/ManageWiki] 07translatewiki 033b9a3f9 - Localisation updates from https://translatewiki.net. [11:10:26] [02miraheze/WikiDiscover] 07translatewiki pushed 031 commit to 03master [+0/-1/±5] 13https://github.com/miraheze/WikiDiscover/compare/e22ac51883ad...86205332292c [11:10:28] [02miraheze/WikiDiscover] 07translatewiki 038620533 - Localisation updates from https://translatewiki.net. [11:10:29] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/MirahezeMagic/compare/d428e3a51972...f6f43ee21dba [11:10:31] [02miraheze/MirahezeMagic] 07translatewiki 03f6f43ee - Localisation updates from https://translatewiki.net. [11:18:13] miraheze/ManageWiki - translatewiki the build passed. [11:18:28] miraheze/PDFEmbed - translatewiki the build passed. [11:19:07] miraheze/CreateWiki - translatewiki the build passed. [11:20:15] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.72, 7.12, 6.70 [11:20:19] miraheze/WikiDiscover - translatewiki the build passed. [11:20:41] miraheze/ImportDump - translatewiki the build passed. [11:22:10] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.54, 6.57, 6.55 [11:26:01] miraheze/MirahezeMagic - translatewiki the build passed. [11:42:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.32, 8.17, 7.08 [11:46:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.08, 7.33, 6.96 [11:51:53] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.91, 7.97, 7.28 [11:53:48] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.27, 7.59, 7.22 [12:05:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.28, 8.50, 7.56 [12:09:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.26, 7.42, 7.39 [12:12:24] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.30, 5.61, 2.72 [12:16:24] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.84, 5.46, 3.42 [12:19:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.26, 6.97, 7.04 [12:21:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.09, 7.12, 7.09 [12:21:48] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.08, 3.52, 2.78 [12:23:48] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.32, 3.51, 2.88 [12:25:48] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.96, 3.27, 2.86 [12:29:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.57, 6.47, 6.72 [12:35:48] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.91, 3.68, 3.20 [12:38:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.18, 7.39, 6.98 [12:40:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.06, 7.17, 6.94 [12:43:48] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.68, 3.16, 3.17 [12:43:55] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.16, 7.38, 7.03 [12:45:31] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2413164079 secs [12:55:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.06, 7.63, 7.62 [12:57:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.94, 8.76, 8.02 [12:57:48] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.45, 3.46, 3.14 [12:59:48] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.91, 3.32, 3.13 [13:01:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.76, 7.83, 7.83 [13:03:31] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.02124020457 secs [13:03:49] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.78, 3.91, 3.42 [13:05:48] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.95, 3.86, 3.46 [13:06:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.75, 4.49, 3.46 [13:08:14] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.65, 3.46, 3.20 [13:09:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.31, 7.38, 7.37 [13:10:12] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.28, 2.72, 2.96 [13:11:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.68, 6.89, 7.18 [13:13:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.28, 7.91, 7.48 [13:13:48] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.18, 3.16, 3.33 [13:25:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.42, 7.78, 7.93 [13:33:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.29, 8.34, 8.10 [13:39:58] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [13:40:04] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:41:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.52, 7.30, 7.82 [13:46:24] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.11, 5.89, 3.23 [13:47:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.98, 8.33, 7.98 [13:48:24] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.38, 6.35, 3.73 [13:50:24] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.80, 4.48, 3.35 [13:53:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.14, 7.58, 7.82 [14:04:24] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.96, 6.02, 4.11 [14:08:24] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.34, 5.58, 4.52 [14:09:16] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:09:49] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:14:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.62, 7.71, 7.42 [14:15:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.44, 7.15, 7.26 [14:17:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.58, 7.85, 7.49 [14:23:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.97, 7.83, 7.71 [14:25:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.22, 8.26, 7.87 [14:37:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.11, 7.56, 7.84 [14:43:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.75, 8.68, 8.10 [14:47:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.20, 7.81, 7.87 [14:49:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.65, 8.12, 7.97 [15:01:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.74, 7.65, 7.95 [15:08:24] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.40, 7.59, 4.45 [15:12:24] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 4.40, 7.50, 5.26 [15:13:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.83, 7.32, 7.44 [15:14:24] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.34, 5.18, 4.67 [15:15:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.01, 7.14, 7.36 [15:19:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.15, 7.74, 7.54 [15:27:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.97, 7.96, 7.87 [15:31:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.37, 7.93, 7.86 [15:32:01] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [15:37:08] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [15:37:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.60, 7.81, 7.85 [15:43:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.69, 8.22, 7.96 [15:45:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.68, 7.35, 7.67 [16:05:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.55, 7.01, 6.99 [16:06:25] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [16:07:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.30, 7.07, 7.01 [16:15:28] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.51, 2.71, 1.77 [16:17:28] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.75, 1.91, 1.58 [16:23:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.63, 3.54, 2.37 [16:25:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.00, 2.86, 2.27 [16:30:24] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.39, 6.06, 3.35 [16:32:24] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.34, 4.22, 3.00 [16:37:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.71, 6.29, 6.69 [16:41:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.41, 8.30, 7.35 [16:43:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.33, 7.67, 7.23 [16:45:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.42, 7.98, 7.40 [16:49:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.62, 7.92, 7.50 [16:51:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.90, 8.04, 7.61 [16:55:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.01, 7.15, 7.34 [17:05:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.20, 7.01, 7.08 [17:07:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [17:09:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.70, 7.60, 7.33 [17:18:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.54, 3.29, 2.68 [17:20:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.23, 3.21, 2.71 [17:23:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.24, 3.67, 2.88 [17:25:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.75, 3.07, 2.76 [17:27:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.87, 8.20, 7.53 [17:29:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.28, 7.82, 7.50 [17:33:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.02, 7.01, 7.19 [17:35:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.52, 7.11, 7.20 [17:41:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.09, 8.23, 7.59 [17:42:10] PROBLEM - mirawww.glitchcity.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mirawww.glitchcity.wiki could not be found [17:43:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.57, 7.92, 7.55 [17:45:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.23, 8.29, 7.70 [17:48:40] PROBLEM - wiki.ff6worldscollide.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ff6worldscollide.com' expires in 15 day(s) (Wed 14 Jun 2023 17:22:53 GMT +0000). [17:53:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.94, 7.33, 7.69 [17:54:24] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.31, 5.18, 2.84 [17:54:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/bcd60e0898c1...eea5f36e8291 [17:54:43] [02miraheze/ssl] 07MirahezeSSLBot 03eea5f36 - Bot: Update SSL cert for wiki.ff6worldscollide.com [17:56:24] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.76, 6.24, 3.52 [17:58:24] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.74, 4.67, 3.26 [17:59:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.07, 7.09, 7.38 [18:05:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.74, 8.00, 7.76 [18:09:19] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.80, 3.73, 2.92 [18:11:17] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.52, 3.17, 2.81 [18:11:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.56, 7.67, 7.57 [18:13:31] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1130580306 secs [18:17:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.93, 7.41, 7.54 [18:19:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.23, 7.55, 7.56 [18:23:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.14, 7.33, 7.45 [18:31:31] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09716546535 secs [18:37:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.13, 5.95, 6.68 [18:38:33] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.78, 3.27, 2.87 [18:44:16] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.04, 3.28, 3.02 [18:46:40] RECOVERY - wiki.ff6worldscollide.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.ff6worldscollide.com' will expire on Sun 27 Aug 2023 16:54:23 GMT +0000. [18:51:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.54, 7.65, 7.05 [18:53:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.09, 6.62, 6.74 [18:59:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.40, 6.75, 6.81 [19:00:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.62, 3.48, 3.10 [19:02:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.08, 4.44, 3.47 [19:03:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.25, 6.24, 6.61 [19:06:06] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [19:07:29] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.70, 3.51, 3.16 [19:08:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.20, 3.77, 3.51 [19:09:24] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.38, 3.83, 3.31 [19:10:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.10, 4.53, 3.78 [19:11:18] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.86, 3.79, 3.36 [19:12:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.34, 3.99, 3.68 [19:13:12] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.32, 3.98, 3.48 [19:14:24] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.69, 6.92, 4.23 [19:15:07] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.27, 3.80, 3.48 [19:15:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.17, 6.96, 6.67 [19:16:24] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.04, 5.59, 4.09 [19:17:01] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.37, 3.35, 3.35 [19:17:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.98, 6.64, 6.59 [19:18:12] PROBLEM - wikipedia.yogfront.ooo - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wikipedia.yogfront.ooo All nameservers failed to answer the query. [19:18:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.17, 3.10, 3.40 [19:24:30] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [19:28:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.54, 3.23, 3.15 [19:28:56] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.42, 2.86, 1.81 [19:30:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.94, 3.30, 3.20 [19:30:56] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.56, 2.66, 1.86 [19:35:24] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:38:17] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:40:20] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 6.715 second response time [19:40:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.75, 6.85, 6.64 [19:42:20] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 1 backends are down. mw122 [19:42:53] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.31, 7.34, 6.84 [19:43:01] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:43:18] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:44:20] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [19:44:48] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.36, 6.94, 6.75 [19:46:43] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.34, 6.71, 6.69 [19:47:03] RECOVERY - wikipedia.yogfront.ooo - reverse DNS on sslhost is OK: SSL OK - wikipedia.yogfront.ooo reverse DNS resolves to cp23.miraheze.org - CNAME OK [19:48:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.51, 4.52, 3.36 [19:50:33] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.72, 7.85, 7.20 [19:52:28] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.51, 7.83, 7.25 [19:53:37] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 9.810 second response time [19:53:54] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.44, 3.13, 2.74 [19:54:30] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [19:55:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.27, 2.81, 2.67 [19:56:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.19, 7.76, 7.35 [19:58:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.61, 3.72, 3.57 [20:00:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.06, 8.42, 7.61 [20:00:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.81, 4.24, 3.76 [20:01:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.10, 3.72, 3.01 [20:03:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.54, 3.21, 2.91 [20:07:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.00, 7.91, 7.79 [20:08:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.18, 3.31, 3.64 [20:10:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.85, 2.77, 3.40 [20:11:36] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.92, 8.52, 8.02 [20:13:31] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.72, 7.84, 7.83 [20:14:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.82, 3.43, 3.51 [20:15:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.51, 8.15, 7.92 [20:16:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.93, 3.18, 3.40 [20:17:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.56, 7.87, 7.85 [20:21:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.36, 8.60, 8.18 [20:25:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.22, 7.80, 7.95 [20:27:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.70, 7.96, 8.01 [20:29:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.40, 7.22, 7.71 [20:30:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.68, 3.78, 3.40 [20:34:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.71, 3.69, 3.42 [20:35:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 13.65, 9.30, 8.29 [20:38:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.51, 3.43, 3.39 [20:39:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.39, 7.69, 7.86 [20:40:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.59, 2.69, 3.12 [20:42:30] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [20:43:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.29, 8.17, 7.97 [20:45:54] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.18, 3.71, 3.02 [20:46:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.89, 4.39, 3.58 [20:47:55] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.15, 3.34, 2.99 [20:55:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.60, 7.23, 7.80 [20:57:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.15, 7.75, 7.92 [20:58:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.57, 3.60, 3.93 [21:09:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.67, 7.51, 7.97 [21:10:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.27, 2.64, 3.28 [21:11:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.42, 8.16, 8.17 [21:12:15] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [21:13:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.79, 7.31, 7.86 [21:23:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.75, 7.44, 7.48 [21:23:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.37, 2.84, 2.31 [21:25:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.50, 7.32, 7.45 [21:25:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.18, 2.93, 2.41 [21:28:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.85, 3.74, 3.34 [21:30:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.55, 3.19, 3.18 [21:31:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.58, 8.36, 7.83 [21:33:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.90, 7.86, 7.71 [21:35:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.52, 8.59, 8.00 [21:38:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.23, 4.27, 3.54 [21:40:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.73, 3.22, 3.24 [21:41:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.33, 7.61, 7.81 [21:42:00] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [21:45:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.95, 8.22, 7.95 [21:47:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.11, 7.71, 7.79 [21:48:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.48, 3.45, 3.15 [21:50:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.02, 2.80, 2.94 [21:51:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.22, 7.98, 7.84 [21:53:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.28, 7.21, 7.57 [21:55:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.08, 7.42, 7.59 [21:56:24] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.87, 6.39, 3.30 [21:57:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.63, 7.22, 7.50 [21:57:42] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.77, 4.07, 3.52 [21:58:24] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.23, 5.62, 3.42 [21:59:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.78, 3.72, 3.45 [22:01:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.41, 7.65, 7.57 [22:01:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.54, 4.14, 3.61 [22:03:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.26, 6.94, 7.31 [22:05:35] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.47, 3.59, 3.51 [22:07:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.41, 8.45, 7.75 [22:07:33] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.55, 2.92, 3.28 [22:09:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.90, 7.31, 7.44 [22:13:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.94, 8.24, 7.72 [22:13:45] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:17:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.42, 7.39, 7.50 [22:19:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.60, 8.22, 7.79 [22:21:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.54, 7.89, 7.74 [22:29:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.61, 8.08, 7.79 [22:31:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.06, 7.30, 7.54 [22:34:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.66, 3.43, 2.91 [22:36:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.73, 3.93, 3.15 [22:38:05] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.37, 3.72, 3.17 [22:39:53] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1314301193 secs [22:40:04] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.44, 3.30, 3.08 [22:43:25] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.95, 5.67, 6.64 [22:49:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.16, 6.99, 6.83 [22:51:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.37, 7.00, 6.87 [22:53:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.65, 7.22, 6.94 [22:55:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.60, 7.37, 7.04 [22:59:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.01, 7.43, 7.11 [23:01:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.80, 6.84, 6.93 [23:01:53] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.08047834039 secs [23:03:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.44, 7.64, 7.22 [23:05:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.07, 7.03, 7.05 [23:06:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.30, 3.54, 3.05 [23:07:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.26, 7.48, 7.20 [23:08:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.59, 3.10, 2.94 [23:09:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.85, 6.82, 6.99 [23:13:14] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [23:15:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.60, 7.27, 7.07 [23:17:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.78, 7.41, 7.14 [23:19:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.37, 7.71, 7.28 [23:20:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.91, 4.79, 3.79 [23:21:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.41, 7.45, 7.25 [23:24:46] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.01, 3.55, 3.49 [23:25:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.77, 8.27, 7.57 [23:26:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.50, 3.21, 3.37 [23:27:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.18, 7.72, 7.44 [23:27:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.36, 6.11, 4.21 [23:29:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 14.77, 10.19, 8.35 [23:35:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.56, 7.87, 7.86 [23:37:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.58, 8.86, 8.24 [23:39:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.88, 7.74, 7.91 [23:39:54] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.37, 3.04, 3.81 [23:47:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.00, 8.30, 7.93 [23:47:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.52, 3.69, 3.29 [23:47:54] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.88, 2.80, 3.34 [23:49:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.33, 7.37, 7.62 [23:49:35] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.19, 3.16, 3.15 [23:53:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.23, 8.00, 7.82 [23:55:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.28, 7.74, 7.75 [23:55:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.34, 4.74, 3.77 [23:57:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.34, 7.96, 7.82 [23:59:25] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.41, 3.91, 3.65 [23:59:54] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.26, 3.45, 3.34