[00:00:29] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.29, 7.05, 6.41 [00:00:29] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.44, 6.86, 6.17 [00:00:50] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [00:00:55] PROBLEM - mw143 HTTPS on mw143 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [00:02:13] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:02:29] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.68, 6.53, 6.14 [00:02:49] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.606 second response time [00:02:51] PROBLEM - mw143 HTTPS on mw143 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.517 second response time [00:04:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.47, 7.52, 6.76 [00:04:41] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 13.51, 8.81, 4.27 [00:06:11] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [00:06:22] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [00:07:35] PROBLEM - os131 Current Load on os131 is CRITICAL: LOAD CRITICAL - total load average: 5.95, 3.50, 1.91 [00:08:00] PROBLEM - mw133 HTTPS on mw133 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [00:08:06] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10002 milliseconds with 0 bytes received [00:08:08] PROBLEM - mw134 HTTPS on mw134 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Connection timed out after 10000 milliseconds [00:08:14] PROBLEM - cp24 HTTPS on cp24 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 7.515 second response time [00:08:35] PROBLEM - mw132 HTTPS on mw132 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10001 milliseconds with 0 bytes received [00:08:47] PROBLEM - mw132 Current Load on mw132 is CRITICAL: LOAD CRITICAL - total load average: 12.64, 9.83, 7.45 [00:09:52] PROBLEM - ns1 NTP time on ns1 is CRITICAL: NTP CRITICAL: Offset 0.5001779497 secs [00:09:56] PROBLEM - mw133 HTTPS on mw133 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.676 second response time [00:10:02] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.587 second response time [00:10:05] PROBLEM - wiki.litek.top - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.litek.top could not be found [00:10:06] PROBLEM - mw134 HTTPS on mw134 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.595 second response time [00:10:30] PROBLEM - mw132 HTTPS on mw132 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.707 second response time [00:10:34] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.57, 6.58, 6.64 [00:10:47] RECOVERY - mw132 Current Load on mw132 is OK: LOAD OK - total load average: 7.99, 8.72, 7.30 [00:11:15] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 10.25, 10.43, 8.43 [00:11:34] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 3.29, 3.70, 2.39 [00:13:15] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 9.47, 10.06, 8.53 [00:14:37] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.19, 7.39, 6.95 [00:14:41] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 2.57, 7.61, 6.74 [00:15:35] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 2.57, 3.33, 2.54 [00:16:21] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.94, 7.15, 7.79 [00:16:41] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.18, 6.59, 6.47 [00:18:40] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.74, 7.54, 7.16 [00:21:34] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.83, 7.02, 6.42 [00:22:21] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.37, 7.88, 7.81 [00:24:21] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.73, 7.58, 7.72 [00:25:33] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.22, 6.68, 6.42 [00:26:06] PROBLEM - mw141 HTTPS on mw141 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10005 milliseconds with 0 bytes received [00:26:43] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.54, 6.23, 6.69 [00:28:02] PROBLEM - mw141 HTTPS on mw141 is WARNING: HTTP WARNING: HTTP/2 404 - 285 bytes in 0.515 second response time [00:28:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.72, 7.35, 7.95 [00:30:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.16, 7.49, 7.90 [00:32:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.85, 7.23, 7.76 [00:33:35] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [00:34:43] PROBLEM - os131 Current Load on os131 is CRITICAL: LOAD CRITICAL - total load average: 6.08, 4.25, 3.26 [00:35:02] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: LOAD CRITICAL - total load average: 4.82, 3.45, 2.90 [00:35:15] PROBLEM - mw134 Current Load on mw134 is WARNING: LOAD WARNING - total load average: 10.27, 9.50, 8.70 [00:36:21] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.28, 7.49, 7.52 [00:37:15] RECOVERY - mw134 Current Load on mw134 is OK: LOAD OK - total load average: 9.41, 9.76, 8.91 [00:38:21] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.38, 7.22, 7.40 [00:41:02] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.37, 3.83, 3.33 [00:41:11] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.80, 3.66, 2.92 [00:42:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.51, 8.32, 7.96 [00:42:50] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 3.29, 3.84, 3.58 [00:43:10] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.58, 3.26, 2.87 [00:44:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.77, 7.59, 7.73 [00:45:02] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 1.66, 3.04, 3.16 [00:47:11] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.87, 3.62, 3.10 [00:48:51] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 2.89, 3.16, 3.35 [00:49:11] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.95, 3.33, 3.05 [00:50:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.37, 7.93, 7.72 [00:51:27] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.92, 6.30, 6.11 [00:53:10] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.69, 3.56, 3.20 [00:53:26] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.66, 5.72, 5.92 [00:54:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.03, 7.85, 7.79 [00:55:10] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 3.18, 3.34, 3.17 [00:56:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.98, 8.39, 8.00 [00:56:50] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: cURL returned 28 - Operation timed out after 10003 milliseconds with 0 bytes received [00:58:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.22, 7.78, 7.81 [00:58:46] PROBLEM - mw143 Current Load on mw143 is WARNING: LOAD WARNING - total load average: 10.81, 8.41, 6.37 [00:58:49] PROBLEM - cp35 HTTPS on cp35 is WARNING: HTTP WARNING: HTTP/2 404 - 3458 bytes in 0.717 second response time [00:58:57] PROBLEM - os141 PowerDNS Recursor on os141 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:59:08] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.22, 4.00, 3.49 [01:00:45] RECOVERY - mw143 Current Load on mw143 is OK: LOAD OK - total load average: 4.57, 6.80, 6.02 [01:01:05] RECOVERY - os141 PowerDNS Recursor on os141 is OK: DNS OK: 7.711 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [01:01:06] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.67, 3.78, 3.46 [01:01:35] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:04:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.26, 7.67, 7.72 [01:04:13] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [01:05:11] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.25, 3.88, 3.56 [01:06:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.02, 7.11, 7.51 [01:07:10] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 2.67, 3.56, 3.49 [01:08:21] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 3.68, 5.70, 6.65 [01:09:10] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.04, 3.65, 3.52 [01:11:10] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.63, 3.58, 3.51 [01:13:09] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.53, 3.25, 3.40 [01:18:35] PROBLEM - mon181 Puppet on mon181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [01:20:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.88, 7.90, 7.48 [01:21:36] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03SpecialPage [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/2e55bedf10fc [01:21:38] [02miraheze/mw-config] 07Universal-Omega 032e55bed - Use SpecialPage instead of global $wgServer [01:21:40] [02mw-config] 07Universal-Omega created branch 03SpecialPage - 13https://github.com/miraheze/mw-config [01:21:42] [02mw-config] 07Universal-Omega opened pull request 03#5435: Use SpecialPage instead of global $wgServer - 13https://github.com/miraheze/mw-config/pull/5435 [01:22:00] [02mw-config] 07Universal-Omega commented on pull request 03#5435: Use SpecialPage instead of global $wgServer - 13https://github.com/miraheze/mw-config/pull/5435#issuecomment-1890233562 [01:22:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.86, 7.63, 7.42 [01:22:18] [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03SpecialPage [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/2e55bedf10fc...b8ab7f5dd449 [01:22:19] [02miraheze/mw-config] 07github-actions 03b8ab7f5 - CI: lint code to MediaWiki standards [01:22:20] [02mw-config] 07github-actions[bot] synchronize pull request 03#5435: Use SpecialPage instead of global $wgServer - 13https://github.com/miraheze/mw-config/pull/5435 [01:22:50] miraheze/mw-config - Universal-Omega the build passed. [01:27:32] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [01:30:48] [02ManageWiki] 07Universal-Omega closed pull request 03#440: Add GENDER to logentries to hint to translators that GENDER is usable - 13https://github.com/miraheze/ManageWiki/pull/440 [01:30:49] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/b2124177227b...e0e05f17f53b [01:30:51] [02miraheze/ManageWiki] 07amire80 03e0e05f1 - Add GENDER to logentries to hint to translators that GENDER is usable (#440) [01:31:33] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [01:36:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.46, 6.33, 6.71 [01:36:09] miraheze/ManageWiki - Universal-Omega the build passed. [01:40:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.79, 7.40, 7.09 [01:46:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.20, 6.26, 6.73 [01:46:35] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 3 seconds ago with 0 failures [01:50:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.17, 7.77, 7.23 [01:52:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.43, 7.40, 7.17 [01:56:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.23, 6.84, 6.40 [01:58:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.16, 7.58, 7.31 [01:58:26] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.60, 7.26, 6.59 [02:00:23] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.06, 6.87, 6.54 [02:02:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.67, 7.44, 7.35 [02:03:42] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [02:04:21] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.26, 6.76, 6.59 [02:08:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.05, 7.43, 7.35 [02:10:22] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 11.54, 7.86, 6.96 [02:12:21] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.54, 6.99, 6.76 [02:14:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.45, 7.47, 7.44 [02:14:21] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.85, 6.30, 6.54 [02:14:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.31, 6.30, 6.11 [02:16:31] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.68, 6.08, 6.05 [02:28:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.35, 7.23, 7.08 [02:29:10] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.05, 6.93, 6.59 [02:30:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.47, 6.93, 6.99 [02:31:07] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.17, 6.52, 6.47 [02:32:13] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [02:38:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.63, 6.31, 6.68 [02:42:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.89, 7.11, 6.92 [02:43:27] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [02:46:43] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.37, 7.32, 6.48 [02:48:44] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.77, 7.12, 6.52 [02:50:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.64, 7.86, 7.24 [02:50:44] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.46, 7.08, 6.69 [02:50:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.39, 7.65, 6.79 [02:52:41] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.07, 6.56, 6.56 [02:52:46] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 4.79, 6.69, 6.56 [02:54:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.55, 7.46, 7.28 [02:55:35] RECOVERY - deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [02:56:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.19, 8.17, 7.55 [02:58:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.29, 7.28, 7.29 [03:02:22] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [03:04:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.61, 8.56, 7.70 [03:04:13] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [03:09:22] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.62, 7.06, 6.66 [03:11:19] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.76, 6.71, 6.60 [03:11:27] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:15:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.59, 6.46, 6.06 [03:16:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.82, 7.79, 7.73 [03:18:02] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.14, 6.40, 6.10 [03:20:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.00, 8.18, 7.87 [03:22:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.89, 7.70, 7.73 [03:22:07] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.15, 7.19, 6.87 [03:24:04] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.92, 6.77, 6.76 [03:27:35] PROBLEM - deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [03:30:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.10, 7.32, 7.34 [03:31:43] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.404 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [03:32:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.79, 7.27, 7.31 [03:32:13] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:36:49] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.26, 7.15, 6.83 [03:40:25] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 11.03, 10.33, 7.55 [03:40:31] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 5.76, 3.94, 2.20 [03:40:44] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.12, 6.29, 6.56 [03:42:25] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 7.55, 9.42, 7.56 [03:46:30] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 1.10, 3.25, 2.63 [03:48:35] PROBLEM - mon181 Puppet on mon181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [03:53:12] [02miraheze/mediawiki-repos] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mediawiki-repos/compare/2155a3803a25...673c71fa237f [03:53:13] [02miraheze/mediawiki-repos] 07Universal-Omega 03673c71f - Add CirrusSearch and Elastica [03:56:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.63, 8.35, 7.53 [03:58:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.25, 7.95, 7.49 [04:01:04] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [04:03:14] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.24, 7.94, 6.95 [04:04:13] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [04:05:11] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.95, 7.59, 6.92 [04:07:08] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.13, 6.60, 6.63 [04:14:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.04, 7.49, 7.33 [04:16:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.27, 7.35, 7.29 [04:16:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.64, 6.62, 5.96 [04:16:35] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 15 seconds ago with 0 failures [04:18:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.33, 6.39, 5.95 [04:30:25] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [04:30:42] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.11, 6.59, 6.26 [04:32:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.65, 7.40, 7.18 [04:32:39] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.59, 6.65, 6.33 [04:34:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.74, 7.14, 7.11 [04:36:36] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.54, 7.57, 6.89 [04:40:30] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.02, 6.79, 6.71 [04:44:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.04, 6.49, 6.80 [04:46:46] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.07, 6.38, 5.71 [04:48:47] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.70, 6.00, 5.64 [04:52:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.74, 7.19, 6.96 [04:58:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.52, 7.34, 7.06 [04:59:44] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [05:01:07] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.89, 7.35, 6.81 [05:02:08] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.11, 7.89, 7.41 [05:02:13] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [05:03:35] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [05:07:00] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.48, 6.30, 6.61 [05:14:51] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.14, 7.44, 6.85 [05:16:00] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.98, 6.67, 6.07 [05:18:02] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.64, 6.55, 6.10 [05:18:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.60, 8.29, 7.44 [05:18:45] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.78, 7.15, 6.86 [05:20:42] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.19, 6.73, 6.73 [05:22:53] PROBLEM - wiki.tmyt105.leyhp.com - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query leyhp.com. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:24:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.36, 7.61, 7.46 [05:25:35] RECOVERY - deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [05:29:35] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 16 seconds ago with 0 failures [05:34:13] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [05:52:35] RECOVERY - wiki.tmyt105.leyhp.com - reverse DNS on sslhost is OK: SSL OK - wiki.tmyt105.leyhp.com reverse DNS resolves to cp35.miraheze.org - CNAME OK [05:56:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.56, 6.36, 6.77 [05:57:35] PROBLEM - deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [05:58:25] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [06:02:13] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:04:52] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.26, 6.70, 6.73 [06:06:47] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.10, 6.47, 6.64 [06:18:22] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.19, 6.73, 6.31 [06:20:21] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.15, 6.55, 6.30 [06:22:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.83, 8.27, 7.31 [06:24:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.02, 7.84, 7.27 [06:27:45] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [06:33:35] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [06:34:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.13, 6.28, 6.78 [06:34:13] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.91, 6.93, 6.70 [06:36:10] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.59, 6.77, 6.66 [07:05:34] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/importDump.php --wiki=sketchianmultiversewiki --no-updates --username-prefix=wikia:sketchian-multiverse /home/reception/ImportDump/sketchianmultiversewiki-20240113060555.xml (START) [07:05:35] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/importDump.php --wiki=sketchianmultiversewiki --no-updates --username-prefix=wikia:sketchian-multiverse /home/reception/ImportDump/sketchianmultiversewiki-20240113060555.xml (END - exit=256) [07:05:36] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/rebuildall.php --wiki=sketchianmultiversewiki (START) [07:05:37] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/rebuildall.php --wiki=sketchianmultiversewiki (END - exit=0) [07:05:38] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/initSiteStats.php --wiki=sketchianmultiversewiki --active --update (END - exit=0) [07:05:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:05:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:05:46] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/importDump.php --wiki=riskuniversaliswiki --no-updates --username-prefix=wikia:ru3 /home/reception/ImportDump/riskuniversaliswiki-20240112034048.xml (START) [07:05:47] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/importDump.php --wiki=riskuniversaliswiki --no-updates --username-prefix=wikia:ru3 /home/reception/ImportDump/riskuniversaliswiki-20240112034048.xml (END - exit=256) [07:05:48] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/rebuildall.php --wiki=riskuniversaliswiki (START) [07:05:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:05:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:06:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:06:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:06:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:06:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:12:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.06, 6.78, 6.23 [07:12:50] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/rebuildall.php --wiki=riskuniversaliswiki (END - exit=0) [07:12:51] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/1.40/maintenance/run.php /srv/mediawiki/1.40/maintenance/initSiteStats.php --wiki=riskuniversaliswiki --active --update (END - exit=0) [07:12:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:13:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:16:03] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.74, 6.58, 5.77 [07:16:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.67, 6.34, 6.19 [07:18:04] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.42, 6.37, 5.78 [07:22:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.69, 7.01, 6.53 [07:24:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.06, 6.73, 6.49 [07:26:25] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [07:36:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.52, 6.93, 6.75 [07:38:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.66, 6.74, 6.69 [07:42:08] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.54, 7.57, 7.03 [07:44:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.67, 7.17, 6.95 [07:46:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.83, 6.55, 6.74 [07:47:21] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.33, 6.98, 6.23 [07:49:22] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.48, 6.43, 6.12 [07:50:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.34, 7.41, 6.99 [07:52:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.54, 7.37, 7.03 [08:00:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.81, 6.51, 6.78 [08:01:35] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [08:04:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.45, 7.07, 6.98 [08:04:13] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [08:10:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.20, 5.94, 6.58 [08:18:35] PROBLEM - mon181 Puppet on mon181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [08:18:37] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.46, 7.32, 6.59 [08:20:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.94, 7.76, 7.23 [08:22:39] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.44, 6.63, 6.46 [08:26:20] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [08:28:37] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.95, 7.92, 7.42 [08:29:18] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [08:30:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.94, 8.00, 7.51 [08:31:35] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [08:32:13] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [08:34:47] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.17, 6.87, 6.54 [08:35:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 6.84, 6.80, 6.47 [08:36:44] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.85, 6.55, 6.46 [08:37:50] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.78, 6.31, 6.33 [08:42:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.49, 7.76, 7.38 [08:44:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.35, 7.27, 7.25 [08:46:35] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 14 seconds ago with 0 failures [08:56:21] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.402 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [08:58:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.30, 7.46, 7.19 [08:59:12] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [09:01:35] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [09:04:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.57, 7.51, 7.35 [09:04:13] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [09:16:10] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.16, 6.59, 6.04 [09:18:11] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.74, 6.64, 6.13 [09:18:35] PROBLEM - mon181 Puppet on mon181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [09:24:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.67, 6.30, 6.72 [09:25:35] RECOVERY - deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [09:26:20] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [09:27:08] I'll teach 10people to earn $50k or more within a week from the crypto market but you'll pay me 10% of your profit when you receive it. Note only interested people should apply, drop a message let's get started by asking (HOW) via telegram username 👉@della_sweeney1 [09:32:58] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.50, 7.38, 7.06 [09:47:25] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.48, 6.78, 6.02 [09:49:26] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.61, 6.26, 5.92 [09:50:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.54, 7.58, 7.09 [09:52:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.28, 7.03, 6.95 [09:56:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.19, 6.29, 6.69 [09:57:35] PROBLEM - deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [09:59:05] RECOVERY - www.deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [10:02:13] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:16:35] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 37 seconds ago with 0 failures [10:19:47] !log DELETED and DROPPED https://phabricator.miraheze.org/P496 [10:19:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:20:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.04, 7.25, 6.85 [10:22:17] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.10, 7.09, 6.83 [10:26:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.71, 6.44, 6.64 [10:26:10] RECOVERY - deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [10:26:21] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [10:41:26] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.25, 7.30, 6.57 [10:42:23] PROBLEM - mw182 MediaWiki Rendering on mw182 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:43:23] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.21, 6.89, 6.51 [10:45:20] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.30, 6.25, 6.31 [10:45:58] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.56, 6.29, 5.74 [10:47:59] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 4.60, 5.66, 5.58 [10:48:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.12, 7.73, 7.03 [10:50:41] RECOVERY - mw182 MediaWiki Rendering on mw182 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 8.665 second response time [10:52:12] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.73, 7.57, 7.16 [10:56:20] PROBLEM - txt-dex.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - txt-dex.com All nameservers failed to answer the query. [10:57:35] PROBLEM - deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [11:01:04] PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [11:02:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.09, 7.26, 7.09 [11:03:35] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [11:04:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.39, 6.79, 6.93 [11:08:11] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.32, 6.47, 5.76 [11:10:12] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.68, 6.02, 5.67 [11:12:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.97, 7.91, 7.35 [11:13:43] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.87, 6.89, 6.54 [11:14:13] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.79, 6.63, 5.95 [11:16:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.68, 7.94, 7.55 [11:17:37] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.95, 6.51, 6.48 [11:18:16] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.71, 6.43, 6.05 [11:28:25] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.41, 7.57, 6.80 [11:30:22] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.70, 7.37, 6.80 [11:31:35] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:34:13] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [11:34:21] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.83, 7.72, 7.04 [11:36:21] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.05, 6.95, 6.83 [11:36:24] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.98, 6.67, 5.91 [11:38:24] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.11, 6.49, 5.95 [11:42:21] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.66, 6.39, 6.67 [11:48:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.44, 7.44, 7.05 [11:48:35] PROBLEM - mon181 Puppet on mon181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [11:52:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.78, 7.54, 7.19 [11:56:08] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.96, 7.92, 7.40 [11:58:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.06, 7.70, 7.39 [12:00:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.28, 7.85, 7.48 [12:01:10] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.35, 7.15, 6.67 [12:01:35] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [12:02:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.82, 7.98, 7.59 [12:02:13] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:04:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.96, 8.74, 7.91 [12:05:04] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.95, 7.10, 6.79 [12:07:01] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.05, 6.80, 6.73 [12:08:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.08, 7.90, 7.75 [12:12:55] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.86, 6.47, 6.52 [12:14:52] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.64, 6.31, 6.44 [12:16:35] RECOVERY - mon181 Puppet on mon181 is OK: OK: Puppet is currently enabled, last run 28 seconds ago with 0 failures [12:16:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 8.40, 6.89, 6.26 [12:18:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.33, 6.82, 6.31 [12:20:51] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.23, 6.58, 6.28 [12:22:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.01, 7.56, 7.52 [12:23:19] PROBLEM - wiki.tmyt105.leyhp.com - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query leyhp.com. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:24:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.27, 7.58, 7.53 [12:26:21] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: LifetimeTimeout: The resolution lifetime expired after 5.405 seconds: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out. [12:29:05] RECOVERY - www.deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [12:29:34] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.23, 6.62, 6.44 [12:30:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.10, 7.11, 7.22 [12:31:35] RECOVERY - db181 Puppet on db181 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [12:33:28] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.76, 6.69, 6.52 [12:34:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.65, 7.49, 7.34 [12:34:13] PROBLEM - db182 Puppet on db182 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [12:45:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.75, 6.32, 5.97 [12:47:04] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 5.89, 6.28, 6.01 [12:50:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.12, 7.04, 7.04 [12:52:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.87, 7.26, 7.14 [12:53:00] RECOVERY - wiki.tmyt105.leyhp.com - reverse DNS on sslhost is OK: SSL OK - wiki.tmyt105.leyhp.com reverse DNS resolves to cp35.miraheze.org - CNAME OK [12:55:32] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [12:55:35] RECOVERY - deadprem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'deadprem.wiki' will expire on Wed 31 Jan 2024 12:16:06 PM GMT +0000. [12:56:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.20, 7.42, 7.20 [12:58:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.50, 7.43, 7.23 [12:59:52] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.006853014231 secs [13:01:04] PROBLEM - www.deadprem.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address www.deadprem.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [13:02:13] RECOVERY - db182 Puppet on db182 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:03:35] PROBLEM - db181 Puppet on db181 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/apt/keyrings/mariadb_release_signing_key.pgp] [13:06:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.46, 7.89, 7.41 [13:07:13] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.28, 6.25, 5.67 [13:08:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.07, 7.65, 7.40 [13:09:13] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 5.69, 5.94, 5.62 [13:16:07]