[00:02:42] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.75, 3.50, 3.19 [00:02:58] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 21.96, 12.27, 5.57 [00:04:42] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.25, 3.36, 3.17 [00:08:41] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.40, 3.64, 3.30 [00:11:16] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 217.174.247.33/cpweb, 2a00:da00:1800:326::1/cpweb [00:11:30] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 217.174.247.33/cpweb, 2a00:da00:1800:326::1/cpweb [00:12:21] PROBLEM - cp22 SSH on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:12:40] PROBLEM - cp22 HTTPS on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:13:00] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 46.98, 28.55, 12.83 [00:13:16] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:13:30] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:13:59] PROBLEM - cp22 Puppet on cp22 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:14:27] PROBLEM - cp22 PowerDNS Recursor on cp22 is CRITICAL: CRITICAL - Plugin timed out while executing system call [00:14:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.66, 3.66, 3.51 [00:14:53] PROBLEM - cp22 HTTP 4xx/5xx ERROR Rate on cp22 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:14:57] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:15:00] PROBLEM - cp22 conntrack_table_size on cp22 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:15:25] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.83, 3.35, 2.88 [00:16:41] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.80, 3.03, 3.30 [00:17:16] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 217.174.247.33/cpweb, 2a00:da00:1800:326::1/cpweb [00:17:22] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.40, 3.31, 2.92 [00:17:30] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 217.174.247.33/cpweb, 2a00:da00:1800:326::1/cpweb [00:18:52] RECOVERY - cp22 HTTPS on cp22 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3422 bytes in 6.367 second response time [00:19:16] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:19:17] RECOVERY - cp22 Puppet on cp22 is OK: OK: Puppet is currently enabled, last run 31 minutes ago with 0 failures [00:19:30] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:20:06] RECOVERY - cp22 HTTP 4xx/5xx ERROR Rate on cp22 is OK: OK - NGINX Error Rate is 4% [00:20:06] RECOVERY - cp22 conntrack_table_size on cp22 is OK: OK: nf_conntrack is 1 % full [00:20:09] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [00:20:43] RECOVERY - cp22 SSH on cp22 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [00:20:43] RECOVERY - cp22 PowerDNS Recursor on cp22 is OK: DNS OK: 4.732 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [00:26:55] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.06, 2.08, 3.96 [00:28:57] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 5.87, 3.41, 4.21 [00:36:40] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.31, 5.84, 4.14 [00:36:48] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.14, 3.38, 2.79 [00:37:40] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.15, 3.55, 3.34 [00:37:43] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.35, 4.49, 3.74 [00:38:43] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.80, 3.38, 2.85 [00:39:37] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.26, 3.76, 3.43 [00:40:37] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.02, 2.93, 2.75 [00:40:55] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.72, 2.21, 3.59 [00:41:32] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.99, 3.48, 3.37 [00:41:37] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.44, 3.49, 3.51 [00:42:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.15, 3.95, 3.89 [00:42:55] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.64, 1.76, 3.26 [00:43:11] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is CRITICAL: CRITICAL - load average: 8.04, 10.04, 4.71 [00:45:10] RECOVERY - swiftproxy131 Current Load on swiftproxy131 is OK: OK - load average: 1.25, 6.80, 4.17 [00:45:31] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.22, 4.29, 3.82 [00:47:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.65, 3.27, 3.35 [00:48:40] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.86, 5.52, 4.34 [00:51:14] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.39, 3.85, 3.61 [00:52:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.50, 3.22, 3.66 [00:53:10] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.56, 4.09, 3.72 [00:54:50] !log ban req.http.Host == miraheze.org && req.url ~ "^/$" [00:54:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:55:06] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.60, 3.52, 3.56 [00:55:17] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.45, 3.53, 3.80 [00:55:34] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e6c9013385f2...31f0d7de730b [00:55:34] [url] Comparing e6c9013385f2...31f0d7de730b · miraheze/puppet · GitHub | github.com [00:55:35] [02miraheze/puppet] 07Universal-Omega 0331f0d7d - Use 302 redirects or rewrite rather than 301 redirects [00:56:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.63, 2.67, 3.36 [01:01:40] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.18, 1.67, 3.79 [01:02:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.19, 3.36, 3.44 [01:04:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.61, 3.31, 3.40 [01:05:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.78, 2.97, 3.39 [01:05:34] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03add-sitemap [+1/-0/±0] 13https://github.com/miraheze/landing/commit/c3b59eb72b24 [01:05:35] [02miraheze/landing] 07Universal-Omega 03c3b59eb - Add sitemap.xml [01:05:38] [02landing] 07Universal-Omega created branch 03add-sitemap - 13https://github.com/miraheze/landing [01:05:38] [url] Page not found · GitHub · GitHub | github.com [01:05:39] [02landing] 07Universal-Omega opened pull request 03#94: Add sitemap.xml - 13https://github.com/miraheze/landing/pull/94 [01:05:39] [url] Page not found · GitHub · GitHub | github.com [01:05:40] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.42, 0.99, 3.03 [01:06:31] miraheze/landing - Universal-Omega the build passed. [01:06:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.17, 6.56, 4.76 [01:06:50] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.27, 3.02, 3.29 [01:09:33] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03add-hreflang [+0/-0/±1] 13https://github.com/miraheze/landing/commit/feaa47047ba2 [01:09:35] [02miraheze/landing] 07Universal-Omega 03feaa470 - Add alternate hreflang tags [01:09:37] [02landing] 07Universal-Omega created branch 03add-hreflang - 13https://github.com/miraheze/landing [01:09:38] [url] Page not found · GitHub · GitHub | github.com [01:09:39] [02landing] 07Universal-Omega opened pull request 03#95: Add alternate hreflang tags - 13https://github.com/miraheze/landing/pull/95 [01:09:40] [url] Page not found · GitHub · GitHub | github.com [01:10:30] [02landing] 07Universal-Omega closed pull request 03#95: Add alternate hreflang tags - 13https://github.com/miraheze/landing/pull/95 [01:10:31] [url] Page not found · GitHub · GitHub | github.com [01:10:31] miraheze/landing - Universal-Omega the build passed. [01:10:32] [02miraheze/landing] 07Universal-Omega deleted branch 03add-hreflang [01:10:35] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/6987a1c3999f...01e9ad3e4e64 [01:10:36] [url] Comparing 6987a1c3999f...01e9ad3e4e64 · miraheze/landing · GitHub | github.com [01:10:38] [02miraheze/landing] 07Universal-Omega 0301e9ad3 - Add alternate hreflang tags (#95) [01:10:41] [02landing] 07Universal-Omega deleted branch 03add-hreflang - 13https://github.com/miraheze/landing [01:10:42] ... [01:11:26] miraheze/landing - Universal-Omega the build passed. [01:12:44] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/01e9ad3e4e64...c2647234bd63 [01:12:44] [url] Comparing 01e9ad3e4e64...c2647234bd63 · miraheze/landing · GitHub | github.com [01:12:47] [02miraheze/landing] 07Universal-Omega 03c264723 - Add tabs [01:13:41] miraheze/landing - Universal-Omega the build passed. [01:14:11] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/c2647234bd63...58520da8e6c9 [01:14:11] [url] Comparing c2647234bd63...58520da8e6c9 · miraheze/landing · GitHub | github.com [01:14:14] [02miraheze/landing] 07Universal-Omega 0358520da - Move order [01:15:00] miraheze/landing - Universal-Omega the build passed. [01:15:58] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/58520da8e6c9...1f71959f7734 [01:15:58] [url] Comparing 58520da8e6c9...1f71959f7734 · miraheze/landing · GitHub | github.com [01:16:01] [02miraheze/landing] 07Universal-Omega 031f71959 - Don't add nl-informal hreflang tag [01:16:56] miraheze/landing - Universal-Omega the build passed. [01:18:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.30, 2.77, 3.87 [01:21:46] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 8.50, 4.99, 3.41 [01:22:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.74, 3.46, 3.33 [01:22:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.83, 3.51, 3.42 [01:24:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 7.40, 5.07, 3.94 [01:24:40] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.36, 4.65, 4.16 [01:24:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 7.18, 4.70, 3.85 [01:28:14] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/31f0d7de730b...dcf71e578146 [01:28:15] [url] Comparing 31f0d7de730b...dcf71e578146 · miraheze/puppet · GitHub | github.com [01:28:16] [02miraheze/puppet] 07Universal-Omega 03dcf71e5 - Use 302 redirects instead of rewrites [01:28:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.10, 3.67, 3.88 [01:29:54] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[Landing Sync] [01:33:53] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:34:40] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.38, 4.41, 4.04 [01:38:40] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.42, 3.66, 3.84 [01:40:56] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/dcf71e578146...1d392a508e34 [01:40:56] [url] Comparing dcf71e578146...1d392a508e34 · miraheze/puppet · GitHub | github.com [01:40:58] [02miraheze/puppet] 07Universal-Omega 031d392a5 - Revert "Use 302 redirects instead of rewrites" [01:46:40] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.94, 2.40, 3.23 [01:48:24] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.02, 3.24, 3.96 [01:48:55] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.67, 2.44, 1.66 [01:50:55] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.91, 1.76, 1.50 [01:54:07] [02landing] 07Universal-Omega synchronize pull request 03#94: Add sitemap.xml - 13https://github.com/miraheze/landing/pull/94 [01:54:07] [url] Page not found · GitHub · GitHub | github.com [01:54:08] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03add-sitemap [+0/-0/±1] 13https://github.com/miraheze/landing/compare/c3b59eb72b24...913037ec1dc7 [01:54:08] [url] Comparing c3b59eb72b24...913037ec1dc7 · miraheze/landing · GitHub | github.com [01:54:09] [02miraheze/landing] 07Universal-Omega 03913037e - Update sitemap.xml [01:55:03] miraheze/landing - Universal-Omega the build passed. [01:55:15] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03add-sitemap [+1/-0/±0] 13https://github.com/miraheze/landing/compare/913037ec1dc7...1439a100b737 [01:55:16] [url] Comparing 913037ec1dc7...1439a100b737 · miraheze/landing · GitHub | github.com [01:55:16] [02miraheze/landing] 07Universal-Omega 031439a10 - Create sitemap_donate.xml [01:55:19] [02landing] 07Universal-Omega synchronize pull request 03#94: Add sitemap.xml - 13https://github.com/miraheze/landing/pull/94 [01:55:20] [url] Page not found · GitHub · GitHub | github.com [01:55:28] [02landing] 07Universal-Omega edited pull request 03#94: Add sitemaps - 13https://github.com/miraheze/landing/pull/94 [01:55:28] [url] Page not found · GitHub · GitHub | github.com [01:56:00] [02landing] 07Universal-Omega closed pull request 03#94: Add sitemaps - 13https://github.com/miraheze/landing/pull/94 [01:56:01] [url] Page not found · GitHub · GitHub | github.com [01:56:03] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+2/-0/±0] 13https://github.com/miraheze/landing/compare/1f71959f7734...c7e14972b8f7 [01:56:04] [url] Comparing 1f71959f7734...c7e14972b8f7 · miraheze/landing · GitHub | github.com [01:56:05] [02miraheze/landing] 07Universal-Omega 03c7e1497 - Add sitemaps (#94) [01:56:07] [02miraheze/landing] 07Universal-Omega deleted branch 03add-sitemap [01:56:08] [02landing] 07Universal-Omega deleted branch 03add-sitemap - 13https://github.com/miraheze/landing [01:56:09] [url] Page not found · GitHub · GitHub | github.com [01:56:15] miraheze/landing - Universal-Omega the build passed. [01:56:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.18, 3.03, 3.89 [01:56:39] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.76, 3.04, 3.02 [01:56:53] miraheze/landing - Universal-Omega the build passed. [01:57:26] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±0] 13https://github.com/miraheze/landing/compare/c7e14972b8f7...4d1e00e8b945 [01:57:26] [url] Comparing c7e14972b8f7...4d1e00e8b945 · miraheze/landing · GitHub | github.com [01:57:28] [02miraheze/landing] 07Universal-Omega 034d1e00e - Remove sitemap_donate.xml for now [01:58:24] miraheze/landing - Universal-Omega the build passed. [01:58:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.67, 2.46, 2.81 [01:59:55] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[Landing Sync] [02:02:24] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.50, 3.40, 3.50 [02:02:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.05, 3.73, 3.29 [02:02:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.69, 3.18, 3.99 [02:04:24] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.22, 3.31, 3.46 [02:05:00] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/landing/compare/4d1e00e8b945...893ef01550a9 [02:05:01] [url] Comparing 4d1e00e8b945...893ef01550a9 · miraheze/landing · GitHub | github.com [02:05:02] [02miraheze/landing] 07Universal-Omega 03893ef01 - Add robots.txt [02:05:58] miraheze/landing - Universal-Omega the build passed. [02:06:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.51, 2.73, 3.32 [02:10:24] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.25, 3.20, 3.36 [02:13:11] !log varnish: ban req.http.Host == miraheze.org && req.url ~ "^/robots.txt$" [02:13:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:14:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.51, 3.90, 3.93 [02:14:50] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.27, 2.63, 3.29 [02:17:16] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/893ef01550a9...70a25eae33a2 [02:17:16] [url] Comparing 893ef01550a9...70a25eae33a2 · miraheze/landing · GitHub | github.com [02:17:17] [02miraheze/landing] 07Universal-Omega 0370a25ea - Add donate.miraheze.org to sitemap [02:17:40] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 5.73, 4.20, 2.62 [02:18:12] miraheze/landing - Universal-Omega the build passed. [02:19:40] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.34, 3.02, 2.38 [02:22:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.47, 2.73, 3.34 [02:26:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.16, 3.30, 3.40 [02:28:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.61, 3.50, 3.48 [02:28:39] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.72, 3.54, 3.26 [02:30:33] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.79, 4.08, 3.49 [02:30:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.52, 4.37, 3.77 [02:32:27] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.85, 3.61, 3.39 [02:34:24] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.24, 3.88, 3.52 [02:34:52] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03www-redirect [+0/-0/±1] 13https://github.com/miraheze/ssl/commit/bc078313aad5 [02:34:53] [02miraheze/ssl] 07Universal-Omega 03bc07831 - Redirect www.miraheze.org to miraheze.org [02:34:56] [02ssl] 07Universal-Omega created branch 03www-redirect - 13https://github.com/miraheze/ssl [02:34:56] [url] Page not found · GitHub · GitHub | github.com [02:34:57] [02ssl] 07Universal-Omega opened pull request 03#612: Redirect www.miraheze.org to miraheze.org - 13https://github.com/miraheze/ssl/pull/612 [02:34:57] [url] Page not found · GitHub · GitHub | github.com [02:36:24] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.47, 3.83, 3.55 [02:38:09] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1d392a508e34...ce3564ac856f [02:38:10] [url] Comparing 1d392a508e34...ce3564ac856f · miraheze/puppet · GitHub | github.com [02:38:10] [02miraheze/puppet] 07Universal-Omega 03ce3564a - Remove www.miraheze.org [02:38:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.76, 3.73, 3.75 [02:38:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.74, 3.54, 3.37 [02:39:08] [02ssl] 07Universal-Omega closed pull request 03#612: Redirect www.miraheze.org to miraheze.org - 13https://github.com/miraheze/ssl/pull/612 [02:39:08] [url] Page not found · GitHub · GitHub | github.com [02:39:10] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/458c357c20e6...890275aecda3 [02:39:10] [url] Comparing 458c357c20e6...890275aecda3 · miraheze/ssl · GitHub | github.com [02:39:11] [02miraheze/ssl] 07Universal-Omega 03890275a - Redirect www.miraheze.org to miraheze.org (#612) [02:39:12] [02miraheze/ssl] 07Universal-Omega deleted branch 03www-redirect [02:39:13] [02ssl] 07Universal-Omega deleted branch 03www-redirect - 13https://github.com/miraheze/ssl [02:39:13] [url] Page not found · GitHub · GitHub | github.com [02:39:54] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [02:40:25] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.94, 3.30, 3.40 [02:40:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.02, 3.84, 3.78 [02:42:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.23, 3.33, 3.60 [02:42:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.71, 3.89, 3.53 [02:44:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.70, 2.75, 3.35 [02:45:27] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/ce3564ac856f...48c61cdbc4e3 [02:45:27] [url] Comparing ce3564ac856f...48c61cdbc4e3 · miraheze/puppet · GitHub | github.com [02:45:29] [02miraheze/puppet] 07Universal-Omega 0348c61cd - Remove www.miraheze.org [02:46:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.96, 3.23, 2.45 [02:48:37] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.62, 2.90, 2.42 [02:50:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.60, 4.39, 3.89 [02:55:03] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.89, 3.91, 3.81 [02:55:57] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.58, 3.87, 3.91 [02:58:51] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.19, 3.98, 3.85 [03:01:44] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.05, 3.39, 3.59 [03:02:40] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.12, 3.54, 3.70 [03:03:01] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.89, 5.50, 3.66 [03:08:53] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.52, 3.73, 3.36 [03:10:48] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.06, 3.11, 3.17 [03:12:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.89, 3.52, 3.91 [03:15:16] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.82, 3.10, 3.96 [03:16:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.54, 2.96, 3.32 [03:16:52] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.11, 4.32, 2.40 [03:18:26] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.65, 3.82, 3.41 [03:18:45] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.31, 2.46, 3.37 [03:20:44] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.48, 3.14, 2.37 [03:21:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.07, 2.26, 3.30 [03:22:14] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.19, 3.61, 3.41 [03:22:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.37, 3.48, 3.42 [03:24:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.57, 3.47, 3.45 [03:26:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.31, 4.08, 3.64 [03:26:38] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.99, 3.08, 3.30 [03:28:00] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.84, 3.55, 3.49 [03:34:19] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/48c61cdbc4e3...0008996ff8d5 [03:34:20] [url] Comparing 48c61cdbc4e3...0008996ff8d5 · miraheze/puppet · GitHub | github.com [03:34:20] [02miraheze/puppet] 07Universal-Omega 030008996 - robots: use same-domain sitemap.xml [03:34:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.07, 3.75, 3.62 [03:36:01] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.69, 3.00, 3.32 [03:36:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.87, 3.46, 3.53 [03:38:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.95, 2.95, 3.33 [03:50:44] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.97, 3.47, 3.30 [03:52:38] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.95, 3.22, 3.22 [03:55:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.50, 9.11, 7.97 [03:57:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.42, 8.82, 8.00 [03:58:21] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.45, 3.53, 3.33 [04:02:10] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.03, 3.57, 3.36 [04:04:05] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.85, 3.32, 3.30 [04:06:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.08, 3.26, 2.86 [04:06:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.53, 3.42, 2.74 [04:08:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.39, 3.33, 2.94 [04:08:37] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.90, 4.19, 3.09 [04:10:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.28, 3.33, 2.90 [04:34:10] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.12, 3.80, 3.42 [04:34:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.23, 4.40, 3.43 [04:36:05] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.97, 3.37, 3.30 [04:36:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.18, 3.55, 3.23 [04:37:50] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.42, 4.42, 3.22 [04:38:31] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.01, 3.03, 3.08 [04:41:41] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.80, 3.60, 3.21 [04:42:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.31, 3.75, 3.34 [04:43:37] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.42, 2.86, 2.98 [04:46:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.63, 3.83, 3.47 [04:50:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.61, 3.15, 3.27 [05:17:20] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.21, 3.87, 3.30 [05:19:14] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.66, 3.45, 3.22 [05:23:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.99, 2.92, 3.07 [05:45:50] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.14, 2.80, 1.69 [05:47:50] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.43, 2.22, 1.61 [05:58:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.68, 3.88, 2.92 [06:00:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.87, 3.58, 2.94 [06:01:11] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 7.97, 4.78, 3.69 [06:02:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.54, 4.01, 3.17 [06:02:39] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.07, 3.79, 3.16 [06:04:33] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.86, 3.61, 3.18 [06:06:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.74, 3.95, 3.40 [06:08:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 3.92, 4.40, 3.65 [06:08:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.39, 3.18, 3.12 [06:10:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.38, 3.84, 3.55 [06:10:43] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.99, 3.64, 3.69 [06:12:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.98, 3.25, 3.37 [06:12:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1328839362 secs [06:20:14] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 7.75, 4.18, 3.72 [06:22:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.45, 4.11, 3.47 [06:22:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08067375422 secs [06:23:08] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.34, 4.74, 3.69 [06:24:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.35, 3.97, 3.75 [06:24:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.80, 3.72, 3.42 [06:24:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.41, 3.26, 2.25 [06:26:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 3.35, 4.01, 3.80 [06:26:49] PROBLEM - swiftobject113 Disk Space on swiftobject113 is WARNING: DISK WARNING - free space: / 58448 MB (10% inode=86%); [06:26:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.51, 3.91, 3.61 [06:28:00] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.65, 3.73, 3.71 [06:28:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.24, 3.82, 3.55 [06:28:50] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.52, 4.17, 3.74 [06:28:57] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 13.26, 13.53, 6.56 [06:30:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.44, 3.59, 3.50 [06:30:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.12, 3.47, 3.53 [06:34:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.22, 3.43, 3.53 [06:34:05] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.12, 3.60, 3.48 [06:34:31] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.08, 3.37, 3.17 [06:36:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.92, 3.55, 3.56 [06:38:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.89, 3.58, 3.53 [06:38:16] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.26 ms [06:38:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.86, 3.00, 3.34 [06:38:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.72, 4.79, 3.27 [06:38:37] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 0.59, 2.39, 3.73 [06:39:05] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.12 ms [06:39:17] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 121.38 ms [06:40:01] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.28, 2.90, 3.30 [06:40:33] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.46, 1.75, 3.33 [06:42:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.19, 2.96, 3.30 [06:42:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.36, 3.57, 3.18 [06:44:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.03, 2.77, 2.94 [06:53:13] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 106.67 ms [06:53:16] RECOVERY - ping6 on cp32 is OK: PING OK - Packet loss = 0%, RTA = 105.32 ms [06:54:35] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 106.05 ms [06:55:09] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.95, 3.61, 2.77 [06:57:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.28, 3.21, 2.73 [07:01:46] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1153724492 secs [07:03:46] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.01922732592 secs [07:06:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1299480498 secs [07:17:53] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.69, 6.01, 3.19 [07:21:50] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.63, 3.22, 2.69 [07:27:54] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.57, 3.25, 2.93 [07:28:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09982615709 secs [07:29:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.24, 3.73, 3.13 [07:31:42] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.97, 3.36, 3.06 [07:32:22] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.56, 4.16, 3.36 [07:34:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.01, 3.79, 3.32 [07:34:54] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.54, 3.76, 2.59 [07:36:11] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.42, 3.32, 3.20 [07:40:41] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.85, 3.27, 2.82 [08:05:02] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.50, 3.34, 3.01 [08:05:06] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.163110733 secs [08:06:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.67, 4.51, 3.11 [08:06:57] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.76, 3.11, 2.96 [08:08:54] PROBLEM - swiftobject112 Disk Space on swiftobject112 is WARNING: DISK WARNING - free space: / 58529 MB (10% inode=86%); [08:10:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.32, 3.13, 2.88 [08:12:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.96, 3.46, 3.12 [08:12:45] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.74, 2.85, 2.80 [08:14:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.49, 2.75, 2.89 [08:29:12] PROBLEM - ping6 on ns1 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.36 ms [08:29:17] PROBLEM - ping6 on cp32 is WARNING: PING WARNING - Packet loss = 0%, RTA = 121.35 ms [08:29:30] PROBLEM - ping6 on cp33 is WARNING: PING WARNING - Packet loss = 0%, RTA = 122.27 ms [08:30:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.91, 3.82, 3.33 [08:34:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.73, 3.37, 3.28 [08:35:06] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.05362004042 secs [08:36:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.14, 3.44, 2.54 [08:38:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.04, 3.02, 2.49 [08:45:16] RECOVERY - ping6 on cp32 is OK: PING OK - Packet loss = 0%, RTA = 106.30 ms [08:45:21] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 106.14 ms [08:45:50] RECOVERY - ping6 on cp33 is OK: PING OK - Packet loss = 0%, RTA = 106.10 ms [09:00:32] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.44, 3.51, 2.25 [09:02:32] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.37, 3.04, 2.23 [09:07:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.15, 3.29, 2.45 [09:08:57] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.20, 3.02, 2.47 [09:23:19] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.24, 3.49, 3.12 [09:25:14] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.68, 3.18, 3.04 [09:30:38] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.43, 3.03, 2.76 [09:30:57] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.60, 3.83, 3.36 [09:32:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.14, 2.70, 2.67 [09:34:45] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.36, 3.21, 3.22 [09:37:44] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.87, 5.06, 3.62 [09:38:34] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.70, 3.63, 3.39 [09:40:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.55, 4.68, 3.80 [09:42:01] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 13.15, 10.77, 7.26 [09:42:06] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.67, 4.86, 3.61 [09:44:00] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 5.62, 8.78, 6.96 [09:57:24] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.11, 3.11, 3.85 [10:03:18] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.05, 3.28, 3.69 [10:05:16] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.55, 3.36, 3.67 [10:06:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.56, 3.32, 3.94 [10:07:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.35, 3.56, 2.75 [10:08:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.77, 2.77, 3.99 [10:09:47] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.42, 2.82, 2.57 [10:11:10] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.41, 2.87, 3.33 [10:17:44] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.96, 3.49, 2.37 [10:19:42] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.85, 2.44, 2.12 [10:20:01] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.40, 2.88, 3.31 [10:20:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.49, 2.80, 3.38 [10:29:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.20, 3.67, 3.01 [10:33:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.09, 2.65, 2.77 [10:36:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.03, 2.88, 2.05 [10:38:43] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.54, 2.73, 2.09 [10:46:00] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.12, 4.00, 3.34 [10:48:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.98, 3.47, 3.23 [10:50:01] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.52, 3.12, 3.13 [11:06:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.50, 4.34, 2.79 [11:08:06] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.50, 3.46, 3.00 [11:08:27] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.38, 4.06, 3.43 [11:08:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.05, 4.98, 3.91 [11:10:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.90, 3.31, 3.01 [11:10:22] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.48, 3.48, 3.29 [11:12:16] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.40, 3.14, 3.19 [11:12:32] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.49, 3.82, 3.34 [11:14:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.78, 2.78, 3.02 [11:16:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.69, 3.78, 3.75 [11:18:00] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.68, 3.88, 3.51 [11:22:01] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.60, 3.09, 3.26 [11:24:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.30, 3.91, 3.70 [11:26:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.01, 3.45, 3.56 [11:32:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.74, 2.76, 3.26 [11:36:58] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.84, 3.50, 2.92 [11:38:54] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.06, 3.16, 2.87 [11:40:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.51, 3.62, 3.42 [11:44:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.67, 3.81, 3.54 [11:46:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.38, 3.26, 3.37 [11:52:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.05, 3.63, 3.48 [11:54:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.82, 3.27, 3.36 [11:56:26] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.43, 3.20, 2.43 [11:58:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.01, 2.78, 2.36 [12:12:06] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.22, 3.50, 3.14 [12:14:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.94, 3.72, 3.27 [12:14:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.56, 3.66, 3.32 [12:15:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.26, 3.50, 3.10 [12:16:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.61, 4.38, 3.53 [12:16:39] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.12, 4.26, 3.56 [12:20:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.68, 3.92, 3.57 [12:20:46] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.21, 3.87, 3.47 [12:24:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.70, 3.61, 3.53 [12:24:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.10, 4.08, 3.67 [12:26:30] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.34, 4.53, 3.79 [12:28:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.09, 3.05, 3.33 [12:28:24] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.27, 3.88, 3.63 [12:30:18] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.62, 4.23, 3.79 [12:31:03] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.29, 9.23, 7.86 [12:32:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.95, 3.75, 3.77 [12:33:02] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.39, 8.75, 7.85 [12:34:07] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.13, 3.94, 3.78 [12:36:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.22, 4.03, 3.83 [12:36:58] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 3.59, 4.02, 3.71 [12:38:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.13, 3.74, 3.75 [12:38:56] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.85, 3.89, 3.69 [12:39:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.66, 3.40, 2.65 [12:40:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.20, 4.00, 3.84 [12:41:22] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.29, 3.13, 2.65 [12:42:52] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.33, 3.72, 3.64 [12:43:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.59, 9.20, 8.22 [12:44:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.86, 4.27, 3.93 [12:44:50] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.37, 3.81, 3.70 [12:45:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.92, 8.00, 7.91 [12:48:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.24, 3.48, 3.71 [12:48:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.57, 3.97, 4.00 [12:50:44] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 7.12, 4.73, 4.03 [12:54:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.36, 3.54, 3.62 [12:56:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.35, 3.14, 3.47 [12:56:38] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.78, 3.57, 3.75 [12:58:01] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.16, 2.82, 3.31 [12:58:36] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.45, 3.98, 3.86 [13:00:34] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.28, 3.49, 3.68 [13:02:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.00, 2.96, 3.39 [13:04:30] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.03, 4.29, 3.91 [13:06:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.25, 3.40, 3.52 [13:06:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.86, 5.63, 3.41 [13:08:25] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.79, 3.59, 3.72 [13:10:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.89, 4.46, 3.89 [13:10:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.98, 3.13, 2.89 [13:12:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.69, 4.61, 3.86 [13:13:06] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.3489822149 secs [13:13:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.04, 10.58, 8.92 [13:15:27] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.89, 9.51, 8.71 [13:16:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.37, 3.90, 3.75 [13:16:17] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.14, 2.86, 3.38 [13:16:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.66, 3.90, 3.87 [13:20:11] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.53, 3.33, 3.44 [13:24:01] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.21, 2.94, 3.34 [13:24:07] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.96, 3.17, 3.35 [13:24:53] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.48, 2.69, 2.09 [13:26:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.22, 2.60, 2.14 [13:28:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.67, 3.66, 3.52 [13:28:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.12, 3.71, 3.66 [13:30:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.62, 3.62, 3.63 [13:32:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.87, 4.14, 3.82 [13:32:58] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 3.87, 4.12, 3.69 [13:34:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.15, 3.95, 3.80 [13:35:45] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/890275aecda3...cdb993ae32b0 [13:35:47] [02miraheze/ssl] 07Reception123 03cdb993a - add bankerpedia.com cert [13:35:50] [url] Comparing 890275aecda3...cdb993ae32b0 · miraheze/ssl · GitHub | github.com [13:36:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.29, 3.24, 2.43 [13:36:56] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/cdb993ae32b0...a422748e77cf [13:36:57] miraheze/ssl - Reception123 the build has errored. [13:36:58] [02miraheze/ssl] 07Reception123 03a422748 - Update certs.yaml [13:37:06] [url] Comparing cdb993ae32b0...a422748e77cf · miraheze/ssl · GitHub | github.com [13:38:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.54, 3.64, 3.73 [13:38:32] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.29, 2.93, 2.42 [13:38:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.85, 4.21, 2.86 [13:38:52] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 4.00, 3.98, 3.82 [13:40:38] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.06, 3.78, 2.86 [13:41:06] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.02293363214 secs [13:41:10] PROBLEM - puppet141 Current Load on puppet141 is CRITICAL: CRITICAL - load average: 4.82, 3.07, 1.98 [13:43:10] RECOVERY - puppet141 Current Load on puppet141 is OK: OK - load average: 1.96, 2.67, 1.97 [13:44:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.64, 4.74, 4.09 [13:44:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.31, 5.32, 4.30 [13:44:34] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.32, 3.38, 2.91 [13:44:46] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 3.41, 4.01, 3.85 [13:46:43] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.83, 3.66, 3.74 [13:48:42] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.23, 4.16, 3.90 [13:50:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.00, 3.91, 3.95 [13:52:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.01, 4.02, 3.98 [13:52:31] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.75, 3.79, 3.98 [13:54:52] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.44, 3.35, 3.66 [13:55:20] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.59, 3.50, 3.76 [13:56:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.84, 9.83, 9.19 [13:56:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.29, 3.90, 3.13 [13:58:46] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.74, 9.37, 9.09 [13:58:53] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.76, 3.39, 3.03 [13:59:09] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.88, 3.29, 2.35 [14:00:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.33, 3.72, 3.82 [14:01:03] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.38, 2.64, 2.23 [14:01:19] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.05, 2.94, 3.40 [14:01:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.67, 2.76, 2.27 [14:02:41] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.47, 2.89, 3.30 [14:02:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.72, 3.36, 3.67 [14:03:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.17, 3.10, 2.44 [14:04:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.35, 4.05, 3.88 [14:05:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.26, 11.79, 9.77 [14:05:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.95, 3.00, 2.48 [14:06:32] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.94, 3.41, 3.41 [14:07:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.11, 11.32, 9.83 [14:08:29] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 9.32, 5.75, 4.27 [14:08:58] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=milanwiki --no-updates --username-prefix=mh:licno /home/reception/ImportDump/milanwiki-20221108140721.xml (START) [14:09:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:09:06] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=milanwiki --no-updates --username-prefix=mh:licno /home/reception/ImportDump/milanwiki-20221108140721.xml (END - exit=0) [14:09:07] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=milanwiki (START) [14:09:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=milanwiki (END - exit=0) [14:09:09] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=milanwiki --active --update (END - exit=0) [14:09:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:09:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:09:17] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.32, 4.78, 3.98 [14:09:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:09:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:10:27] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.20, 10.58, 9.84 [14:12:23] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.53, 3.83, 3.80 [14:12:25] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.99, 9.76, 9.61 [14:13:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.91, 9.67, 9.60 [14:14:20] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.03, 4.05, 3.89 [14:16:17] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.76, 3.53, 3.71 [14:17:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.54, 12.14, 10.52 [14:19:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.32, 3.90, 3.88 [14:19:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.86, 11.79, 10.62 [14:20:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.76, 3.41, 3.95 [14:21:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.77, 4.35, 4.03 [14:22:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.77, 3.87, 4.05 [14:24:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.64, 12.54, 10.81 [14:26:02] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.68, 3.39, 3.48 [14:26:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.62, 11.79, 10.74 [14:26:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.59, 4.97, 3.32 [14:27:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.31, 9.55, 10.18 [14:27:59] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.21, 2.95, 3.32 [14:31:50] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.83, 3.46, 3.44 [14:32:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.32, 3.89, 3.39 [14:33:47] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.51, 4.35, 3.77 [14:34:22] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.18, 9.41, 10.04 [14:34:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.41, 4.16, 3.52 [14:35:24] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.83, 3.88, 2.93 [14:37:41] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.05, 3.90, 3.73 [14:39:20] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.68, 3.77, 3.16 [14:40:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.34, 3.65, 3.63 [14:41:18] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.89, 3.03, 2.95 [14:45:29] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.37, 3.89, 3.66 [14:46:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.35, 2.64, 3.22 [14:47:26] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.75, 3.90, 3.70 [14:49:23] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.87, 4.44, 3.89 [14:51:20] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.43, 3.97, 3.78 [14:53:13] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 12.00, 11.00, 10.35 [14:55:50] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 15.80, 12.63, 8.66 [14:57:08] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.86, 10.15, 10.14 [14:57:48] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 7.57, 10.57, 8.37 [14:57:54] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.15, 11.95, 10.12 [14:59:07] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.14, 3.70, 3.59 [14:59:46] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 6.21, 8.88, 8.00 [14:59:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.20, 11.26, 10.09 [15:01:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.59, 10.47, 10.26 [15:03:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.58, 3.68, 3.67 [15:03:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.51, 11.96, 10.54 [15:04:56] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.11, 9.73, 10.04 [15:05:08] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.75, 3.45, 3.92 [15:05:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.37, 11.69, 10.61 [15:07:08] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.14, 3.80, 4.00 [15:07:52] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.80, 5.38, 4.00 [15:09:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 18.23, 12.85, 11.18 [15:11:07] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.87, 3.70, 3.95 [15:11:56] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 9.64, 11.28, 8.42 [15:13:02] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.32, 10.74, 8.62 [15:13:07] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.76, 4.17, 4.09 [15:13:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.24, 11.83, 11.25 [15:13:31] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 8.32, 10.29, 8.65 [15:13:56] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 7.01, 9.76, 8.21 [15:14:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.25, 11.44, 10.47 [15:15:03] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 6.86, 9.25, 8.32 [15:15:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.39, 3.61, 3.56 [15:15:29] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 7.04, 9.15, 8.42 [15:15:34] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.15, 3.90, 3.86 [15:17:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.32, 4.34, 4.01 [15:18:37] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.37, 12.42, 10.98 [15:19:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.37, 3.45, 3.49 [15:19:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.84, 11.14, 10.83 [15:21:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.77, 3.11, 3.35 [15:21:07] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.65, 3.69, 3.91 [15:21:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.63, 3.61, 3.79 [15:23:06] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.15, 3.70, 3.88 [15:23:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.75, 11.88, 11.24 [15:23:45] PROBLEM - www.lab612.at - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query www.lab612.at. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:25:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.42, 3.85, 3.59 [15:26:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.52, 3.26, 2.48 [15:27:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.06, 2.61, 3.28 [15:28:26] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.21, 11.86, 11.81 [15:28:32] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.66, 2.64, 2.34 [15:29:46] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.2873908281 secs [15:33:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.20, 11.26, 10.98 [15:34:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.43, 12.83, 12.02 [15:38:43] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 18.34, 9.33, 5.65 [15:39:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.34, 3.80, 3.88 [15:41:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.61, 11.92, 11.69 [15:42:55] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1830067337 secs [15:43:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.52, 11.81, 11.66 [15:45:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.04, 3.76, 3.79 [15:45:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.97, 11.18, 11.42 [15:46:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.21, 10.81, 11.72 [15:47:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.36, 3.67, 3.77 [15:49:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.08, 11.03, 11.23 [15:50:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.58, 13.15, 12.35 [15:52:29] RECOVERY - www.lab612.at - reverse DNS on sslhost is OK: SSL OK - www.lab612.at reverse DNS resolves to cp23.miraheze.org - CNAME OK [15:52:50] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.57, 3.65, 3.12 [15:53:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.73, 2.99, 3.40 [15:55:46] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.01864847541 secs [15:58:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.93, 2.29, 3.76 [15:58:43] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.08, 3.94, 3.38 [16:00:41] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.12, 3.56, 3.30 [16:01:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.19, 3.43, 3.36 [16:02:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.31, 3.20, 3.78 [16:02:54] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.05600211024 secs [16:03:28] PROBLEM - cp22 HTTP 4xx/5xx ERROR Rate on cp22 is CRITICAL: CRITICAL - NGINX Error Rate is 72% [16:04:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.46, 3.38, 3.78 [16:04:37] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.44, 3.18, 3.22 [16:05:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.63, 3.82, 3.54 [16:05:28] RECOVERY - cp22 HTTP 4xx/5xx ERROR Rate on cp22 is OK: OK - NGINX Error Rate is 39% [16:06:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 15.54, 6.91, 4.96 [16:07:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.39, 3.27, 3.37 [16:11:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.60, 10.77, 11.72 [16:12:41] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/70a25eae33a2...aee7b74b1c64 [16:12:42] [url] Comparing 70a25eae33a2...aee7b74b1c64 · miraheze/landing · GitHub | github.com [16:12:42] [02miraheze/landing] 07Universal-Omega 03aee7b74 - Move title to near-top [16:13:39] miraheze/landing - Universal-Omega the build passed. [16:18:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.57, 3.37, 3.99 [16:18:47] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03uselang [+0/-0/±1] 13https://github.com/miraheze/landing/commit/c60454b56f0c [16:18:50] [02miraheze/landing] 07Universal-Omega 03c60454b - Use uselang instead of just lang [16:18:51] [02landing] 07Universal-Omega created branch 03uselang - 13https://github.com/miraheze/landing [16:18:52] [url] Page not found · GitHub · GitHub | github.com [16:18:54] [02landing] 07Universal-Omega opened pull request 03#96: Use uselang instead of just lang - 13https://github.com/miraheze/landing/pull/96 [16:18:55] [url] Page not found · GitHub · GitHub | github.com [16:19:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.80, 11.41, 11.43 [16:19:54] miraheze/landing - Universal-Omega the build passed. [16:21:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.98, 4.09, 3.56 [16:23:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.87, 3.94, 3.57 [16:24:18] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03mediawiki-landing-uselang [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/58e23354fbf0 [16:24:19] [02miraheze/puppet] 07Universal-Omega 0358e2335 - mediawiki-landing: use uselang instead of just lang [16:24:21] [02puppet] 07Universal-Omega created branch 03mediawiki-landing-uselang - 13https://github.com/miraheze/puppet [16:24:23] [url] Page not found · GitHub · GitHub | github.com [16:24:23] [02puppet] 07Universal-Omega opened pull request 03#2988: mediawiki-landing: use uselang instead of just lang - 13https://github.com/miraheze/puppet/pull/2988 [16:24:26] [url] Page not found · GitHub · GitHub | github.com [16:27:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.03, 4.05, 3.69 [16:28:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.73, 3.72, 3.71 [16:29:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.43, 3.77, 3.62 [16:29:30] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[Landing Sync] [16:30:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.24, 3.04, 3.47 [16:31:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.98, 4.43, 3.89 [16:31:03] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.58, 3.68, 3.29 [16:32:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.29, 2.44, 3.20 [16:33:01] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.29, 3.16, 3.14 [16:33:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.21, 3.95, 3.78 [16:35:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.54, 4.82, 4.13 [16:38:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.36, 3.92, 3.65 [16:39:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.89, 3.92, 3.90 [16:40:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.55, 4.81, 4.00 [16:42:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.89, 3.90, 3.75 [16:42:28] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03mediawiki-landing-donate-redirect [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/46e23389b076 [16:42:29] [02miraheze/puppet] 07Universal-Omega 0346e2338 - mediawiki-landing: include redirecting donate.php [16:42:31] [02puppet] 07Universal-Omega created branch 03mediawiki-landing-donate-redirect - 13https://github.com/miraheze/puppet [16:42:33] [url] Page not found · GitHub · GitHub | github.com [16:42:33] [02puppet] 07Universal-Omega opened pull request 03#2989: mediawiki-landing: include redirecting donate.php - 13https://github.com/miraheze/puppet/pull/2989 [16:42:34] ... [16:43:06] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:44:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.14, 4.58, 4.06 [16:45:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.50, 3.93, 3.90 [16:46:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.27, 3.87, 3.85 [16:47:23] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 9.486 second response time [16:48:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.60, 4.25, 3.97 [16:48:43] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.61, 3.58, 3.26 [16:52:39] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.00, 3.33, 3.23 [16:54:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.61, 3.65, 3.84 [16:56:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [16:57:26] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [16:58:36] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.34, 3.70, 2.72 [17:00:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.04, 2.65, 2.45 [17:02:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.78, 7.62, 4.41 [17:04:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.07, 5.24, 4.27 [17:05:16] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 10.39, 9.78, 7.95 [17:05:24] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 3.87, 4.02, 2.85 [17:07:16] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 7.43, 9.01, 7.89 [17:07:24] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.35, 2.98, 2.61 [17:12:29] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.83, 3.35, 3.70 [17:13:46] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.120828867 secs [17:14:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.84, 3.87, 3.80 [17:16:29] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.12, 3.10, 3.52 [17:18:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.06, 4.86, 4.05 [17:22:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.25, 3.43, 3.65 [17:24:28] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.01, 3.56, 3.66 [17:25:46] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.07393810153 secs [17:26:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.82, 3.26, 3.54 [17:28:28] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.54, 2.59, 3.25 [17:29:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.64, 3.53, 3.26 [17:31:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [17:31:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.49, 3.88, 3.42 [17:35:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.28, 3.73, 3.48 [17:37:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.09, 3.43, 3.95 [17:37:13] PROBLEM - swiftobject115 Current Load on swiftobject115 is WARNING: WARNING - load average: 0.25, 1.56, 3.65 [17:39:13] RECOVERY - swiftobject115 Current Load on swiftobject115 is OK: OK - load average: 0.10, 1.08, 3.22 [17:39:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.14, 3.72, 3.53 [17:41:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.91, 3.93, 3.64 [17:42:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.04, 2.70, 3.82 [17:43:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.40, 4.41, 4.16 [17:47:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.10, 3.77, 3.96 [17:47:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.33, 3.22, 3.38 [17:48:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.45, 2.45, 3.31 [17:49:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.07, 4.21, 4.09 [17:53:46] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset -0.1161721051 secs [17:59:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.52, 3.43, 3.36 [18:00:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.65, 3.58, 3.09 [18:00:33] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [18:01:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.39, 3.17, 3.28 [18:01:46] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.09778365493 secs [18:02:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.44, 3.12, 2.98 [18:08:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 18.46, 8.08, 4.82 [18:16:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.11, 3.42, 3.83 [18:18:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.25, 4.45, 4.14 [18:22:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.14, 3.44, 3.80 [18:26:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.78, 2.52, 3.34 [18:29:13] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.51, 4.20, 3.56 [18:33:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.26, 3.00, 3.98 [18:33:08] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.05, 3.76, 3.53 [18:35:14] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.33, 4.29, 3.74 [18:37:04] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.87, 3.14, 3.35 [18:41:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.09, 3.38, 3.68 [18:42:03] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:43:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.43, 3.43, 3.67 [18:44:05] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.394 second response time [18:45:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.61, 3.71, 3.73 [18:47:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.02, 3.32, 3.57 [18:48:49] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.75, 3.65, 3.39 [18:50:47] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.52, 3.16, 3.24 [18:51:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.97, 3.05, 3.40 [18:54:28] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.41, 3.42, 4.00 [18:59:46] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.2131263316 secs [19:00:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.27, 1.92, 3.13 [19:02:38] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.97, 3.60, 3.98 [19:04:42] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.67, 3.64, 3.45 [19:06:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.78, 3.42, 3.87 [19:07:46] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.04176408052 secs [19:08:36] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.29, 3.23, 3.36 [19:08:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.77, 3.90, 3.99 [19:10:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.68, 3.91, 3.95 [19:10:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.80, 3.81, 3.94 [19:11:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.91, 10.74, 11.95 [19:12:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.32, 3.75, 3.90 [19:13:26] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.15, 11.15, 11.94 [19:14:19] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.39, 3.44, 3.06 [19:14:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.41, 4.89, 4.29 [19:16:17] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.39, 3.35, 3.07 [19:17:17] PROBLEM - swiftobject113 Disk Space on swiftobject113 is CRITICAL: DISK CRITICAL - free space: / 31958 MB (5% inode=85%); [19:18:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.79, 3.72, 3.95 [19:19:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.97, 10.90, 11.64 [19:20:33] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [19:25:23] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.32, 7.25, 4.65 [19:27:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.81, 12.38, 11.91 [19:29:14] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.05, 3.03, 2.17 [19:29:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.84, 10.78, 11.37 [19:30:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.16, 4.59, 4.09 [19:31:08] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.93, 2.53, 2.08 [19:32:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.05, 3.80, 3.63 [19:33:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.37, 3.98, 3.42 [19:33:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.62, 3.58, 3.89 [19:33:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.36, 11.37, 11.41 [19:33:54] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.69, 3.03, 2.89 [19:34:33] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.94, 3.53, 3.55 [19:35:34] !log removing swiftobject115 and migrating gluster122 to cloud11 using proxmox copy tool [19:35:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:35:52] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.35, 3.39, 3.03 [19:36:24] PROBLEM - swiftobject115 Puppet on swiftobject115 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:36:25] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.92, 4.20, 3.31 [19:36:32] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.23, 3.01, 3.35 [19:37:13] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.16, 2.18, 3.23 [19:37:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.49, 10.34, 11.09 [19:37:50] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.50, 2.98, 2.92 [19:38:09] PROBLEM - swiftobject115 SSH on swiftobject115 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:38:12] PROBLEM - swiftobject115 Swift Object Service on swiftobject115 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:38:36] PROBLEM - cloud11 Puppet on cloud11 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 19 minutes ago with 0 failures [19:38:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.72, 3.88, 4.00 [19:39:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.26, 3.90, 3.66 [19:39:12] PROBLEM - swiftobject115 NTP time on swiftobject115 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:39:36] PROBLEM - ping6 on swiftobject115 is CRITICAL: PING CRITICAL - Packet loss = 100% [19:39:52] PROBLEM - Host swiftobject115 is DOWN: PING CRITICAL - Packet loss = 100% [19:40:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.17, 3.57, 3.25 [19:40:49] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.74, 4.84, 4.34 [19:41:45] PROBLEM - puppet141 Current Load on puppet141 is WARNING: WARNING - load average: 3.61, 2.80, 1.87 [19:42:15] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 18.16, 14.72, 9.82 [19:42:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.78, 9.51, 11.72 [19:42:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.57, 4.38, 3.61 [19:42:31] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.39, 3.64, 3.52 [19:42:52] PROBLEM - swiftobject111 Disk Space on swiftobject111 is WARNING: DISK WARNING - free space: / 58485 MB (10% inode=85%); [19:43:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.07, 4.04, 3.74 [19:43:16] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 9.19, 10.57, 8.46 [19:43:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.63, 8.81, 10.17 [19:43:26] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1273768246 secs [19:43:45] RECOVERY - puppet141 Current Load on puppet141 is OK: OK - load average: 2.17, 2.65, 1.93 [19:44:09] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:44:13] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 8.04, 11.92, 9.36 [19:44:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.23, 10.42, 11.75 [19:44:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.75, 3.30, 3.30 [19:44:31] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.84, 3.64, 3.54 [19:45:16] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 4.59, 8.66, 8.04 [19:46:11] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 6.46, 9.73, 8.84 [19:46:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.78, 10.78, 11.72 [19:46:50] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [19:48:30] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.62, 3.13, 3.34 [19:49:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.90, 10.37, 10.50 [19:49:49] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [19:50:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.64, 11.43, 11.72 [19:51:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.11, 10.96, 10.70 [19:52:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.23, 11.52, 11.73 [19:54:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.44, 12.09, 11.93 [19:55:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.84, 11.39, 10.98 [19:55:26] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.07736730576 secs [19:57:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.50, 12.05, 11.27 [19:58:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.20, 11.93, 11.96 [19:59:11] PROBLEM - vise.dayid.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - vise.dayid.org All nameservers failed to answer the query. [19:59:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.96, 11.55, 11.20 [19:59:28] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.38, 3.44, 3.34 [20:01:28] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.74, 3.26, 3.28 [20:06:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.66, 3.77, 3.98 [20:07:53] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.06, 4.94, 3.93 [20:09:48] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.76, 3.78, 3.62 [20:11:44] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.60, 3.02, 3.36 [20:12:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.46, 3.91, 3.92 [20:13:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.60, 9.12, 10.06 [20:14:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.71, 3.88, 3.91 [20:15:24] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.20, 3.71, 2.55 [20:15:25] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.96, 3.67, 3.30 [20:17:25] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.97, 3.57, 3.29 [20:17:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.53, 4.18, 3.71 [20:18:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.88, 5.07, 3.08 [20:19:24] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.86, 3.92, 2.94 [20:19:25] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.23, 3.15, 3.17 [20:20:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.49, 10.99, 10.94 [20:21:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.36, 3.48, 3.90 [20:21:22] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.79, 3.69, 3.63 [20:21:24] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.82, 2.81, 2.65 [20:21:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.64, 11.08, 10.54 [20:22:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.90, 11.21, 11.03 [20:23:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.29, 3.65, 3.90 [20:25:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.47, 3.45, 3.79 [20:25:13] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.19, 3.04, 3.36 [20:25:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.32, 10.64, 10.40 [20:26:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.04, 11.26, 11.05 [20:26:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.67, 4.13, 3.81 [20:27:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.44, 10.21, 10.27 [20:28:28] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.32, 3.71, 3.56 [20:28:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.38, 3.68, 3.68 [20:29:03] RECOVERY - vise.dayid.org - reverse DNS on sslhost is OK: SSL OK - vise.dayid.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [20:29:05] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.37, 12.81, 7.67 [20:29:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.75, 4.94, 4.04 [20:30:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.36, 10.71, 10.95 [20:30:28] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.24, 2.84, 3.25 [20:31:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.22, 9.02, 9.82 [20:32:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.41, 3.77, 3.68 [20:32:57] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.59, 3.81, 3.76 [20:34:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.52, 3.73, 3.68 [20:35:05] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.43, 7.57, 6.94 [20:35:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.35, 10.40, 10.27 [20:36:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.69, 3.97, 3.76 [20:36:48] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.28, 5.58, 4.36 [20:37:05] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 10.60, 8.79, 7.44 [20:37:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.86, 10.10, 10.19 [20:39:05] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 5.78, 7.43, 7.10 [20:42:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.13, 3.88, 3.82 [20:43:05] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.54, 8.23, 7.53 [20:44:21] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.63, 3.18, 3.06 [20:46:20] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.17, 3.51, 3.20 [20:46:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.77, 4.11, 3.91 [20:47:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.86, 3.90, 3.66 [20:48:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.77, 11.54, 10.98 [20:50:20] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.84, 3.89, 3.44 [20:50:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.85, 3.27, 3.79 [20:51:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.27, 3.71, 3.67 [20:51:05] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.70, 6.96, 7.59 [20:51:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.66, 10.88, 10.35 [20:52:19] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.56, 3.90, 3.48 [20:52:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.14, 3.64, 3.77 [20:53:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.82, 11.17, 10.52 [20:54:19] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.36, 3.66, 3.44 [20:54:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.90, 2.15, 3.22 [20:55:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.39, 3.51, 3.56 [20:55:05] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.90, 5.24, 6.73 [20:57:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.80, 3.60, 3.59 [20:57:06] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 8.49, 7.72, 5.82 [20:58:19] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.25, 3.28, 3.33 [20:58:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.57, 11.66, 11.49 [20:58:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.16, 3.70, 3.76 [20:59:06] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.92, 6.23, 5.51 [21:00:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.14, 3.53, 3.69 [21:02:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.19, 3.79, 3.76 [21:03:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.25, 3.66, 3.59 [21:04:06] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [21:04:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.33, 11.30, 11.19 [21:04:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.46, 3.72, 3.74 [21:05:17] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.25, 3.77, 3.56 [21:05:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.18, 11.43, 10.79 [21:06:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.76, 10.35, 10.86 [21:07:05] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:08:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.65, 4.22, 3.93 [21:08:55] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1073782742 secs [21:09:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.78, 10.83, 10.69 [21:10:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.36, 10.54, 10.71 [21:13:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.08, 3.79, 3.88 [21:14:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.11, 11.76, 11.29 [21:14:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.59, 3.95, 3.97 [21:15:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.16, 4.32, 4.04 [21:15:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.91, 3.96, 3.65 [21:15:50] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.62, 3.55, 2.65 [21:16:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.70, 13.10, 11.83 [21:16:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.04, 4.00, 3.98 [21:17:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.85, 3.73, 3.86 [21:17:05] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 11.78, 11.06, 7.99 [21:17:15] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.17, 3.69, 3.58 [21:17:44] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.22, 2.69, 2.44 [21:18:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.08, 3.58, 3.82 [21:18:58] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/commit/5d7dcd2845d1 [21:19:00] [02miraheze/landing] 07Universal-Omega 035d7dcd2 - i18n: update link and line break format [21:19:02] [02landing] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/landing [21:19:03] [url] Page not found · GitHub · GitHub | github.com [21:19:04] [02landing] 07Universal-Omega opened pull request 03#97: i18n: update link and line break format - 13https://github.com/miraheze/landing/pull/97 [21:19:05] ... [21:19:27] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 951 bytes in 0.129 second response time [21:19:38] PROBLEM - db121 MariaDB on db121 is CRITICAL: Can't connect to MySQL server on 'db121.miraheze.org' (115) [21:19:54] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 6.81, 4.51, 3.36 [21:20:06] miraheze/landing - Universal-Omega the build passed. [21:20:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.80, 10.66, 11.21 [21:21:11] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/5d7dcd2845d1...27444839fc4f [21:21:11] [url] Comparing 5d7dcd2845d1...27444839fc4f · miraheze/landing · GitHub | github.com [21:21:13] [02miraheze/landing] 07Universal-Omega 032744483 - Update sv.json [21:21:16] [02landing] 07Universal-Omega synchronize pull request 03#97: i18n: update link and line break format - 13https://github.com/miraheze/landing/pull/97 [21:21:16] ... [21:21:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.43, 8.60, 9.75 [21:22:16] miraheze/landing - Universal-Omega the build passed. [21:22:28] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/27444839fc4f...62fb5567cf31 [21:22:28] [url] Comparing 27444839fc4f...62fb5567cf31 · miraheze/landing · GitHub | github.com [21:22:29] [02miraheze/landing] 07Universal-Omega 0362fb556 - Update sk.json [21:22:32] [02landing] 07Universal-Omega synchronize pull request 03#97: i18n: update link and line break format - 13https://github.com/miraheze/landing/pull/97 [21:22:32] [url] Page not found · GitHub · GitHub | github.com [21:23:05] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.42, 6.86, 7.11 [21:23:14] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.03, 2.92, 3.28 [21:23:19] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/62fb5567cf31...7203fa251c1b [21:23:19] [url] Comparing 62fb5567cf31...7203fa251c1b · miraheze/landing · GitHub | github.com [21:23:20] [02miraheze/landing] 07Universal-Omega 037203fa2 - Update el.json [21:23:23] [02landing] 07Universal-Omega synchronize pull request 03#97: i18n: update link and line break format - 13https://github.com/miraheze/landing/pull/97 [21:23:23] [url] Page not found · GitHub · GitHub | github.com [21:23:29] miraheze/landing - Universal-Omega the build passed. [21:24:17] miraheze/landing - Universal-Omega the build passed. [21:24:18] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/7203fa251c1b...913b267b437a [21:24:18] [url] Comparing 7203fa251c1b...913b267b437a · miraheze/landing · GitHub | github.com [21:24:19] [02miraheze/landing] 07Universal-Omega 03913b267 - Update ia.json [21:24:21] [02landing] 07Universal-Omega synchronize pull request 03#97: i18n: update link and line break format - 13https://github.com/miraheze/landing/pull/97 [21:24:21] [url] Page not found · GitHub · GitHub | github.com [21:24:22] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.69, 7.77, 9.93 [21:24:41] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [21:24:48] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.77, 2.59, 3.33 [21:24:55] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08945155144 secs [21:25:02] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.76, 10.06, 7.36 [21:25:18] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/913b267b437a...2caba1480f64 [21:25:19] [url] Comparing 913b267b437a...2caba1480f64 · miraheze/landing · GitHub | github.com [21:25:20] [02miraheze/landing] 07Universal-Omega 032caba14 - Update id.json [21:25:22] miraheze/landing - Universal-Omega the build passed. [21:25:22] [02landing] 07Universal-Omega synchronize pull request 03#97: i18n: update link and line break format - 13https://github.com/miraheze/landing/pull/97 [21:25:23] [url] Page not found · GitHub · GitHub | github.com [21:26:20] miraheze/landing - Universal-Omega the build passed. [21:26:29] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.81, 3.53, 2.95 [21:26:48] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/2caba1480f64...4f9fdb19f844 [21:26:49] [url] Comparing 2caba1480f64...4f9fdb19f844 · miraheze/landing · GitHub | github.com [21:26:51] [02miraheze/landing] 07Universal-Omega 034f9fdb1 - Update bn.json [21:26:52] [02landing] 07Universal-Omega synchronize pull request 03#97: i18n: update link and line break format - 13https://github.com/miraheze/landing/pull/97 [21:26:53] [url] Page not found · GitHub · GitHub | github.com [21:27:02] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 2.52, 7.30, 6.68 [21:27:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.96, 3.00, 3.38 [21:27:05] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 5.89, 6.26, 6.78 [21:27:39] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:27:57] miraheze/landing - Universal-Omega the build passed. [21:28:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.86, 3.30, 2.93 [21:30:31] [02landing] 07Universal-Omega closed pull request 03#97: i18n: update link and line break format - 13https://github.com/miraheze/landing/pull/97 [21:30:31] [url] Page not found · GitHub · GitHub | github.com [21:30:32] [02miraheze/landing] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [21:30:33] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±7] 13https://github.com/miraheze/landing/compare/aee7b74b1c64...699ff1b0b1db [21:30:33] [url] Comparing aee7b74b1c64...699ff1b0b1db · miraheze/landing · GitHub | github.com [21:30:34] [02miraheze/landing] 07Universal-Omega 03699ff1b - i18n: update link and line break format (#97) [21:30:35] [02landing] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/landing [21:30:35] [url] Page not found · GitHub · GitHub | github.com [21:30:58] [02landing] 07Universal-Omega closed pull request 03#96: Use uselang instead of just lang - 13https://github.com/miraheze/landing/pull/96 [21:30:58] ... [21:31:00] [02miraheze/landing] 07Universal-Omega deleted branch 03uselang [21:31:01] [02landing] 07Universal-Omega deleted branch 03uselang - 13https://github.com/miraheze/landing [21:31:02] [url] Page not found · GitHub · GitHub | github.com [21:31:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.07, 3.75, 3.58 [21:31:05] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 37.93, 18.29, 11.04 [21:31:06] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.21, 7.47, 6.27 [21:31:22] [02puppet] 07Universal-Omega closed pull request 03#2988: mediawiki-landing: use uselang instead of just lang - 13https://github.com/miraheze/puppet/pull/2988 [21:31:22] ... [21:31:24] [02miraheze/puppet] 07Universal-Omega deleted branch 03mediawiki-landing-uselang [21:31:26] [02puppet] 07Universal-Omega deleted branch 03mediawiki-landing-uselang - 13https://github.com/miraheze/puppet [21:31:26] [url] Page not found · GitHub · GitHub | github.com [21:31:27] miraheze/landing - Universal-Omega the build passed. [21:33:03] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.52, 3.22, 3.40 [21:33:06] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 5.20, 6.72, 6.15 [21:34:34] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:34:36] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:34:43] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:34:54] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5936 bytes in 0.015 second response time [21:35:05] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5936 bytes in 0.010 second response time [21:35:09] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:35:37] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.06, 3.60, 3.90 [21:36:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.15, 5.26, 3.69 [21:36:33] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.955 second response time [21:36:40] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 2.378 second response time [21:36:44] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 9.386 second response time [21:36:53] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.260 second response time [21:37:03] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.339 second response time [21:37:04] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.277 second response time [21:37:33] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 2 backends are down. mw122 mw131 [21:37:35] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.88, 4.32, 4.14 [21:37:35] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 1 backends are down. mw142 [21:38:21] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 1 backends are down. mw121 [21:38:50] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 2 backends are down. mw121 mw131 [21:39:35] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [21:40:21] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [21:40:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.10, 3.66, 3.40 [21:40:50] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [21:41:33] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [21:42:25] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.68, 2.88, 3.14 [21:43:26] PROBLEM - mwtask141 Puppet on mwtask141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[Landing Sync] [21:43:54] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.16, 3.44, 3.36 [21:45:05] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 1.87, 5.80, 7.77 [21:45:36] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.75, 3.29, 2.88 [21:45:51] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.83, 3.29, 3.32 [21:46:12] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.58, 3.37, 2.93 [21:47:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.89, 3.02, 2.82 [21:48:12] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.63, 3.09, 2.88 [21:49:05] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 1.10, 3.06, 6.18 [21:51:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.24, 3.78, 3.98 [21:53:07] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/0008996ff8d5...3318db137836 [21:53:07] [url] Comparing 0008996ff8d5...3318db137836 · miraheze/puppet · GitHub | github.com [21:53:08] [02miraheze/puppet] 07Universal-Omega 033318db1 - mediawiki-landing: use permanent (301) redirect for lang [21:53:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 5.59, 4.44, 4.20 [21:54:07] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [21:57:05] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [21:58:36] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.29, 3.72, 2.04 [21:59:29] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[Landing Sync] [22:00:37] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.80, 3.56, 2.19 [22:02:36] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.06, 3.83, 2.46 [22:04:36] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.75, 3.24, 2.42 [22:11:24] PROBLEM - swiftobject112 Disk Space on swiftobject112 is CRITICAL: DISK CRITICAL - free space: / 31910 MB (5% inode=85%); [22:11:24] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [22:15:07] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.69, 3.69, 3.13 [22:15:30] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.87, 3.64, 3.23 [22:17:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.03, 3.86, 3.36 [22:17:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.91, 3.35, 3.94 [22:18:42] The sdiywiki is down with a message to come here [22:18:57] (Cannot access the database: Cannot access the database: Connection refused (db121) (db121)) [22:19:18] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.77, 3.44, 3.26 [22:19:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.13, 3.46, 3.89 [22:23:05] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.85, 3.63, 3.39 [22:23:06] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.71, 3.27, 3.24 [22:25:05] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.99, 3.24, 3.29 [22:27:26] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 23 seconds ago with 0 failures [22:35:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.51, 3.80, 3.98 [22:36:41] !log restart mysql on db121 [22:36:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:28] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.849 second response time [22:37:34] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.16, 3.83, 3.96 [22:37:38] RECOVERY - db121 MariaDB on db121 is OK: Uptime: 92 Threads: 20 Questions: 34113 Slow queries: 2879 Opens: 2275 Open tables: 2269 Queries per second avg: 370.793 [22:39:34] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.93, 3.65, 3.87 [22:39:58] !log SET GLOBAL read_only=0; on db121 [22:39:58] !log db121 outage started at 21:19 UTC and lasted until 22:39 UTC [22:40:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:34] robkam: fixed [22:40:40] it's back, thanks [22:40:48] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 7.99, 4.82, 3.83 [22:40:59] !log [universalomega@mwtask141] starting deploy of {'pull': 'landing', 'landing': True} to all [22:41:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:08] !log [universalomega@mwtask141] finished deploy of {'pull': 'landing', 'landing': True} to all - SUCCESS in 9s [22:41:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.42, 8.79, 7.01 [22:42:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.47, 8.80, 6.84 [22:43:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 3.96, 4.26, 3.45 [22:43:29] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.45, 3.77, 3.47 [22:43:48] [02puppet] 07Universal-Omega closed pull request 03#2989: mediawiki-landing: include redirecting donate.php - 13https://github.com/miraheze/puppet/pull/2989 [22:43:48] [url] Page not found · GitHub · GitHub | github.com [22:43:49] [02miraheze/puppet] 07Universal-Omega deleted branch 03mediawiki-landing-donate-redirect [22:43:50] [02puppet] 07Universal-Omega deleted branch 03mediawiki-landing-donate-redirect - 13https://github.com/miraheze/puppet [22:43:50] [url] Page not found · GitHub · GitHub | github.com [22:43:51] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/3318db137836...a8617b8d84b0 [22:43:51] [url] Comparing 3318db137836...a8617b8d84b0 · miraheze/puppet · GitHub | github.com [22:43:52] [02miraheze/puppet] 07Universal-Omega 03a8617b8 - mediawiki-landing: include redirecting donate.php (#2989) [22:44:22] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.07, 8.63, 7.00 [22:45:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.11, 3.83, 3.39 [22:47:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 7.14, 5.33, 4.01 [22:47:23] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.37, 4.20, 3.68 [22:47:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.65, 12.20, 8.94 [22:47:46] [02puppet] 07Universal-Omega synchronize pull request 03#2986: varnish: Switch twitter feed to @MirahezeStatus for 503 error page - 13https://github.com/miraheze/puppet/pull/2986 [22:47:46] [url] Page not found · GitHub · GitHub | github.com [22:47:49] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/371b6b39a918...eefd8c10d144 [22:47:49] [url] Comparing 371b6b39a918...eefd8c10d144 · miraheze/puppet · GitHub | github.com [22:47:52] [02miraheze/puppet] 07Universal-Omega 03eefd8c1 - Update default.vcl [22:48:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.05, 9.95, 7.90 [22:48:43] [02puppet] 07Universal-Omega closed pull request 03#2986: varnish: Switch twitter feed to @MirahezeStatus for 503 error page - 13https://github.com/miraheze/puppet/pull/2986 [22:48:43] [url] Page not found · GitHub · GitHub | github.com [22:48:46] [02miraheze/puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [22:48:47] [02puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [22:48:48] ... [22:48:51] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a8617b8d84b0...1086af102d54 [22:48:51] [url] Comparing a8617b8d84b0...1086af102d54 · miraheze/puppet · GitHub | github.com [22:48:51] [02miraheze/puppet] 07Universal-Omega 031086af1 - varnish: Switch twitter feed to @MirahezeStatus for 503 error page (#2986) [22:49:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.55, 11.57, 9.12 [22:49:34] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.46, 2.80, 3.29 [22:50:23] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.63, 9.59, 8.01 [22:57:08] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.30, 3.79, 3.88 [22:59:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.06, 11.72, 10.22 [23:01:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.13, 3.84, 3.99 [23:01:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.78, 10.66, 10.01 [23:01:32] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.42, 2.97, 2.25 [23:02:17] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.70, 2.45, 1.83 [23:02:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.89, 4.92, 3.68 [23:03:25] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.37, 10.98, 10.18 [23:03:31] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.59, 3.71, 2.62 [23:04:11] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.79, 2.26, 1.84 [23:05:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.46, 10.76, 10.23 [23:05:30] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.02, 2.94, 2.46 [23:05:52] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.96, 4.56, 3.37 [23:07:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.21, 3.92, 3.95 [23:07:25] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.43, 9.49, 9.84 [23:09:02] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.11, 3.90, 3.96 [23:09:49] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.30, 3.51, 3.21 [23:11:13] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.88, 11.27, 9.66 [23:11:47] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.97, 2.63, 2.92 [23:13:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.35, 10.73, 9.66 [23:16:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.90, 3.40, 3.89 [23:17:06] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.36, 8.85, 9.17 [23:19:01] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.44, 4.15, 3.86 [23:21:00] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.30, 3.72, 3.74 [23:21:32] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03mediawiki-rewrite-paths [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/65fb35a9693b...8319638f6677 [23:21:32] [url] Comparing 65fb35a9693b...8319638f6677 · miraheze/puppet · GitHub | github.com [23:21:33] [02miraheze/puppet] 07Universal-Omega 038319638 - Use 301 redirect rather than 302 [23:21:35] [02puppet] 07Universal-Omega synchronize pull request 03#2942: mediawiki: rewrite ^/page to ^/wiki/page - 13https://github.com/miraheze/puppet/pull/2942 [23:21:36] [url] Page not found · GitHub · GitHub | github.com [23:25:00] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.28, 3.43, 3.56 [23:25:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.35, 3.23, 3.39 [23:26:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.80, 10.10, 9.57 [23:26:59] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.98, 3.43, 3.56 [23:28:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.51, 9.77, 9.54 [23:30:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.99, 3.75, 3.66 [23:31:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.68, 3.80, 3.57 [23:32:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.25, 3.32, 3.50 [23:34:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.13, 3.99, 3.70 [23:34:58] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.64, 4.18, 3.84 [23:40:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.73, 3.66, 3.72 [23:41:07] PROBLEM - cloud11 SMART on cloud11 is WARNING: WARNING: [cciss,6] - No health status line found, Self-test log contains errors --- [cciss,0] - Device is clean --- [cciss,1] - Device is clean --- [cciss,2] - Device is clean --- [cciss,3] - Device is clean --- [cciss,4] - Device is clean --- [cciss,5] - Device is clean| [23:42:57] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 1.87, 3.65, 3.88 [23:43:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 1.90, 3.34, 3.72 [23:44:05] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [23:44:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.00, 4.07, 3.84 [23:44:57] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.43, 4.10, 3.99 [23:46:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.47, 3.56, 3.69 [23:46:26] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.65, 10.52, 9.62 [23:47:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.13, 3.37, 3.60 [23:47:59] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.12, 10.78, 9.84 [23:48:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.96, 10.69, 9.83 [23:48:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.23, 2.75, 3.38 [23:48:56] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.53, 3.81, 3.96 [23:49:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.19, 3.28, 3.55 [23:49:53] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.99, 10.65, 9.89 [23:50:56] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.00, 4.62, 4.26 [23:53:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.24, 3.79, 3.70 [23:53:43] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.36, 9.14, 9.47 [23:54:22] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.24, 9.46, 9.64 [23:55:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.17, 3.46, 3.59 [23:57:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.06, 3.90, 3.72 [23:58:54] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.27, 3.34, 3.82 [23:59:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.23, 3.72, 3.69