[00:00:53] RECOVERY - test131 Disk Space on test131 is OK: DISK OK - free space: / 2172 MB (11% inode=67%); [00:05:56] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/38a9ca6e0159...07b4d7d56ebf [00:05:56] [url] Comparing 38a9ca6e0159...07b4d7d56ebf · miraheze/puppet · GitHub | github.com [00:05:57] [02miraheze/puppet] 07Universal-Omega 0307b4d7d - prometheus: use `?safemode=1` for blackbox exporter [00:07:39] RECOVERY - cp31 Disk Space on cp31 is OK: DISK OK - free space: / 10369 MB (26% inode=96%); [00:07:54] RECOVERY - cp30 Disk Space on cp30 is OK: DISK OK - free space: / 9764 MB (25% inode=96%); [00:29:51] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.29, 3.98, 5.69 [00:35:34] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.97, 3.54, 5.00 [00:47:59] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/517d7e5e64d3 [00:48:00] [02miraheze/puppet] 07Universal-Omega 03517d7e5 - reduce PHP-FPM childs to 16 on mw121 and mw122 [00:48:02] [02puppet] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [00:48:02] [url] Page not found · GitHub · GitHub | github.com [00:48:03] [02puppet] 07Universal-Omega opened pull request 03#2844: reduce PHP-FPM childs to 16 on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2844 [00:48:04] [url] Page not found · GitHub · GitHub | github.com [00:48:08] [02puppet] 07Universal-Omega edited pull request 03#2844: Reduce PHP-FPM childs to 16 on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2844 [00:48:09] [url] Page not found · GitHub · GitHub | github.com [00:48:47] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/517d7e5e64d3...e47e177601d2 [00:48:47] [url] Comparing 517d7e5e64d3...e47e177601d2 · miraheze/puppet · GitHub | github.com [00:48:48] [02miraheze/puppet] 07Universal-Omega 03e47e177 - Update mw122.yaml [00:48:50] [02puppet] 07Universal-Omega synchronize pull request 03#2844: Reduce PHP-FPM childs to 16 on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2844 [00:48:50] [url] Page not found · GitHub · GitHub | github.com [00:51:04] [02puppet] 07Universal-Omega closed pull request 03#2844: Reduce PHP-FPM childs to 16 on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2844 [00:51:05] [url] Page not found · GitHub · GitHub | github.com [00:51:06] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/07b4d7d56ebf...f3deeac46f9d [00:51:06] [url] Comparing 07b4d7d56ebf...f3deeac46f9d · miraheze/puppet · GitHub | github.com [00:51:07] [02miraheze/puppet] 07Universal-Omega 03f3deeac - Reduce PHP-FPM childs to 16 on mw121 and mw122 (#2844) [00:51:09] [02puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [00:51:09] ... [00:51:10] [02miraheze/puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [01:01:13] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 10.95, 6.68, 5.21 [01:03:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.16, 5.43, 4.92 [01:05:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.48, 4.31, 4.57 [01:12:27] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.49, 9.46, 7.66 [01:14:26] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.34, 9.35, 7.84 [01:16:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.77, 3.08, 3.95 [01:24:13] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 3.84, 3.86 [01:32:00] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.89, 6.85, 5.05 [01:33:54] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.16, 5.93, 4.90 [01:35:48] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.25, 4.61, 4.54 [02:03:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.07, 11.21, 9.25 [02:05:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.34, 11.48, 9.60 [02:09:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.14, 3.22, 3.93 [02:11:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.38, 4.72, 4.37 [02:13:04] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.86, 10.18, 9.73 [02:13:05] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.09, 11.84, 10.15 [02:15:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.78, 11.05, 10.07 [02:19:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.92, 9.68, 9.76 [02:20:03] PROBLEM - cp30 APT on cp30 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:20:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.35, 5.44, 4.37 [02:22:00] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 22.05, 15.32, 11.78 [02:22:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 4.09, 4.54, 4.14 [02:22:27] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:22:35] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:22:39] PROBLEM - cloud12 Current Load on cloud12 is CRITICAL: CRITICAL - load average: 98.97, 57.84, 34.24 [02:22:41] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:23:11] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 27.96, 16.79, 12.36 [02:24:11] RECOVERY - cp30 APT on cp30 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [02:24:19] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:24:24] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:24:30] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:25:31] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 2 backends are down. mw121 mw122 [02:26:29] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.252 second response time [02:26:41] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 3.169 second response time [02:26:44] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.233 second response time [02:28:19] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw122 [02:29:31] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [02:30:19] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [02:30:44] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:31:01] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:31:03] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:32:27] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.245 second response time [02:32:39] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.313 second response time [02:32:40] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.270 second response time [02:34:08] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:34:17] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw121 [02:34:50] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 16.29, 14.51, 9.65 [02:34:59] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 15.32, 14.77, 10.75 [02:35:32] PROBLEM - cp30 Varnish Backends on cp30 is CRITICAL: 1 backends are down. mw121 [02:36:06] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.724 second response time [02:36:17] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [02:36:44] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 6.98, 11.61, 9.14 [02:36:53] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 1.380 second response time [02:37:11] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 1.182 second response time [02:37:21] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 8.572 second response time [02:37:31] RECOVERY - cp30 Varnish Backends on cp30 is OK: All 14 backends are healthy [02:38:39] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 5.99, 9.74, 8.74 [02:38:49] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 7.13, 10.54, 9.89 [02:40:39] PROBLEM - cloud12 Current Load on cloud12 is WARNING: WARNING - load average: 17.44, 34.29, 47.19 [02:40:44] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 6.14, 9.14, 9.46 [02:44:39] RECOVERY - cloud12 Current Load on cloud12 is OK: OK - load average: 15.51, 24.10, 40.07 [02:45:16] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/c8151436ff98 [02:45:18] [02miraheze/puppet] 07Universal-Omega 03c815143 - Temporarily remove MediaWiki from blackbox [02:45:19] [02puppet] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [02:45:20] [url] Page not found · GitHub · GitHub | github.com [02:45:21] [02puppet] 07Universal-Omega opened pull request 03#2845: Temporarily remove MediaWiki from blackbox - 13https://github.com/miraheze/puppet/pull/2845 [02:45:21] ... [02:46:09] PROBLEM - db131 NTP time on db131 is CRITICAL: NTP CRITICAL: Offset 0.6757103801 secs [02:46:11] [02puppet] 07Universal-Omega closed pull request 03#2845: Temporarily remove MediaWiki from blackbox - 13https://github.com/miraheze/puppet/pull/2845 [02:46:12] [url] Page not found · GitHub · GitHub | github.com [02:46:12] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/f3deeac46f9d...f97c06f0be34 [02:46:13] [url] Comparing f3deeac46f9d...f97c06f0be34 · miraheze/puppet · GitHub | github.com [02:46:14] [02miraheze/puppet] 07Universal-Omega 03f97c06f - Temporarily remove MediaWiki from blackbox (#2845) [02:46:15] [02puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [02:46:16] [url] Page not found · GitHub · GitHub | github.com [02:46:17] [02miraheze/puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [02:46:47] PROBLEM - es131 NTP time on es131 is CRITICAL: NTP CRITICAL: Offset 0.6760575771 secs [02:47:27] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.97, 9.46, 11.57 [02:51:26] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 1.68, 6.12, 9.82 [02:51:45] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:51:51] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 3.26, 7.15, 11.62 [02:51:54] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 4 datacenters are down: 149.56.140.43/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::929a/cpweb, 2607:5300:201:3100::5ebc/cpweb [02:52:07] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 4 datacenters are down: 149.56.140.43/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::929a/cpweb, 2607:5300:201:3100::5ebc/cpweb [02:52:09] PROBLEM - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is CRITICAL: CRITICAL - NGINX Error Rate is 63% [02:52:30] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.85, 8.76, 6.22 [02:52:45] PROBLEM - cp30 APT on cp30 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [02:52:45] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:52:48] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:52:49] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 201 bytes in 0.251 second response time [02:53:23] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:53:42] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.208 second response time [02:53:54] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [02:54:07] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [02:54:08] RECOVERY - cp30 HTTP 4xx/5xx ERROR Rate on cp30 is OK: OK - NGINX Error Rate is 3% [02:54:43] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.773 second response time [02:54:44] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.234 second response time [02:54:45] RECOVERY - cp30 APT on cp30 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [02:54:45] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.266 second response time [02:55:20] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.682 second response time [02:56:18] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.31, 5.54, 5.48 [03:00:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.27, 3.80, 4.78 [03:01:22] RECOVERY - es131 NTP time on es131 is OK: NTP OK: Offset 0.0009682178497 secs [03:07:45] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.34, 8.66, 9.99 [03:11:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.67, 3.13, 3.90 [03:15:28] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.89, 5.88, 4.78 [03:17:24] RECOVERY - db131 NTP time on db131 is OK: NTP OK: Offset 0.0121961832 secs [03:18:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.80, 9.63, 9.10 [03:20:14] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.11, 9.07, 8.97 [03:31:33] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.27, 10.85, 10.16 [03:35:19] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.58, 3.32, 3.90 [03:41:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.88, 9.85, 10.12 [03:43:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.95, 2.54, 3.32 [03:47:13] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.25, 3.61, 3.71 [03:53:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.94, 4.55, 4.07 [04:02:45] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.90, 7.11, 5.43 [04:03:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.01, 10.38, 9.88 [04:04:39] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.29, 5.44, 5.01 [04:05:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.60, 10.47, 10.00 [04:06:33] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.76, 4.59, 4.73 [04:07:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.83, 9.80, 9.29 [04:07:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.19, 9.60, 9.74 [04:08:59] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.57, 9.29, 9.16 [04:09:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.83, 3.21, 3.91 [04:15:01] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.78, 2.37, 3.29 [04:21:57] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.45, 4.18, 3.74 [04:23:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.27, 3.76, 3.64 [04:27:55] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.66, 4.05, 3.80 [04:28:02] PROBLEM - test131 Disk Space on test131 is WARNING: DISK WARNING - free space: / 2083 MB (10% inode=67%); [04:29:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.75, 3.72 [04:30:18] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.52, 5.20, 4.61 [04:32:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.00, 4.46, 4.40 [04:35:51] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.04, 2.95, 3.37 [04:36:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.60, 1.72, 2.00 [04:38:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.36, 1.94, 2.04 [04:40:48] [02mw-config] 07Universal-Omega closed pull request 03#4902: T9750: set `$wgCategoryCollation` to `numeric` for `levyraatiwikiwiki` - 13https://github.com/miraheze/mw-config/pull/4902 [04:40:48] [url] Page not found · GitHub · GitHub | github.com [04:40:49] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [04:40:51] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [04:40:51] [url] Page not found · GitHub · GitHub | github.com [04:40:52] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/e628bdcde8ae...52075a93dc7e [04:40:53] [url] Comparing e628bdcde8ae...52075a93dc7e · miraheze/mw-config · GitHub | github.com [04:40:54] [02miraheze/mw-config] 07Universal-Omega 0352075a9 - T9750: set `$wgCategoryCollation` to `numeric` for `levyraatiwikiwiki` (#4902) [04:41:54] miraheze/mw-config - Universal-Omega the build passed. [04:42:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.72, 1.91, 2.00 [04:42:32] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/0e0233f09d94 [04:42:33] [02miraheze/mw-config] 07Universal-Omega 030e0233f - Add webp to `$wgFileExtensions` by default [04:42:35] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [04:42:35] ... [04:42:41] [02mw-config] 07Universal-Omega opened pull request 03#4903: Add webp to `$wgFileExtensions` by default - 13https://github.com/miraheze/mw-config/pull/4903 [04:42:42] [url] Page not found · GitHub · GitHub | github.com [04:43:31] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0e0233f09d94...eaf4bd30de14 [04:43:31] [url] Comparing 0e0233f09d94...eaf4bd30de14 · miraheze/mw-config · GitHub | github.com [04:43:32] [02miraheze/mw-config] 07Universal-Omega 03eaf4bd3 - Update ManageWikiSettings.php [04:43:34] [02mw-config] 07Universal-Omega synchronize pull request 03#4903: Add webp to `$wgFileExtensions` by default - 13https://github.com/miraheze/mw-config/pull/4903 [04:43:34] [url] Page not found · GitHub · GitHub | github.com [04:43:57] miraheze/mw-config - Universal-Omega the build passed. [04:44:30] [02mw-config] 07Universal-Omega closed pull request 03#4903: Add webp to `$wgFileExtensions` by default - 13https://github.com/miraheze/mw-config/pull/4903 [04:44:31] ... [04:44:32] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/52075a93dc7e...f6328acec66a [04:44:32] [url] Comparing 52075a93dc7e...f6328acec66a · miraheze/mw-config · GitHub | github.com [04:44:33] [02miraheze/mw-config] 07Universal-Omega 03f6328ac - Add webp to `$wgFileExtensions` by default (#4903) [04:44:35] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [04:44:36] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [04:44:37] [url] Page not found · GitHub · GitHub | github.com [04:44:46] miraheze/mw-config - Universal-Omega the build passed. [04:45:31] miraheze/mw-config - Universal-Omega the build passed. [04:45:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.63, 3.49 [04:46:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.31, 1.93, 1.96 [04:49:01] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.43, 10.07, 9.11 [04:51:43] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.80, 2.88, 3.23 [04:52:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.04, 10.30, 9.33 [04:54:41] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.83, 9.30, 9.08 [04:56:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.64, 9.90, 9.55 [04:57:22] !log [@test131] starting deploy of {'config': True} to all [04:57:23] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [04:57:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:57:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:09:30] !log [@mwtask141] starting deploy of {'config': True} to all [05:09:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:09:41] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 11s [05:09:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:17:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.70, 3.48, 2.95 [05:21:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.46, 5.72, 4.00 [05:23:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.56, 4.37, 3.71 [05:23:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.86, 3.41, 3.14 [05:27:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.57, 3.55, 3.24 [05:29:26] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.61, 3.31 [05:31:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.03, 3.15, 3.19 [05:37:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.15, 4.22, 3.61 [05:41:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.48, 3.73, 3.57 [05:45:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 4.31, 3.82 [05:47:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.81, 3.97, 3.77 [05:51:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.43, 2.91, 3.36 [05:57:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.70, 5.84, 4.39 [06:01:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.29, 6.00, 4.60 [06:03:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.58, 5.91, 4.78 [06:05:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.86, 4.55, 4.42 [06:07:08] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.86, 3.22, 3.91 [06:08:20] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.16, 1.56, 1.27 [06:09:07] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 3.62, 3.96 [06:11:06] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.57, 3.23, 3.77 [06:13:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.40, 10.04, 9.00 [06:13:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.09, 9.95, 9.02 [06:15:11] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.01, 9.74, 9.03 [06:15:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.76, 8.92, 8.77 [06:17:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 10.79, 5.11, 4.27 [06:26:02] RECOVERY - test131 Disk Space on test131 is OK: DISK OK - free space: / 2133 MB (11% inode=67%); [06:30:02] PROBLEM - test131 Disk Space on test131 is WARNING: DISK WARNING - free space: / 2063 MB (10% inode=67%); [06:36:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.66, 3.20, 3.90 [06:48:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.31, 3.84, 3.66 [06:50:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.47, 3.54 [06:52:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 9.61, 5.04, 4.06 [06:58:51] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.31, 5.28, 4.45 [07:00:45] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.66, 6.33, 4.96 [07:02:39] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.15, 5.25, 4.73 [07:04:33] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.02, 5.85, 5.02 [07:06:27] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.72, 5.77, 5.11 [07:08:21] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.83, 4.70, 4.78 [07:16:20] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.05, 1.48, 1.89 [07:16:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.78, 3.21, 3.79 [07:20:20] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.00, 1.22, 1.68 [07:22:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.17, 4.03, 3.87 [07:23:34] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.29, 5.55, 4.94 [07:25:10] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query roblox-wiki.tk. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:33:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.58, 5.40, 5.65 [07:37:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.21, 6.05, 5.80 [07:39:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.97, 5.66, 5.69 [07:40:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.87, 1.39, 1.98 [07:41:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.43, 1.61, 1.95 [07:48:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.80, 2.11, 2.01 [07:49:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 4.92, 4.56, 5.02 [07:49:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.52, 1.89, 1.90 [07:50:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.59, 3.43, 3.94 [07:54:20] RECOVERY - roblox-wiki.tk - reverse DNS on sslhost is OK: SSL OK - roblox-wiki.tk reverse DNS resolves to cp30.miraheze.org - NS RECORDS OK [07:58:20] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.02, 1.55, 1.28 [08:00:20] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.38, 1.44, 1.27 [08:01:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.77, 1.57, 1.93 [08:02:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.08, 1.74, 1.99 [08:04:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 3.75, 3.72 [08:06:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.58, 2.35, 2.15 [08:06:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.24, 3.12, 3.49 [08:07:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.12, 1.95, 1.97 [08:08:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.39, 2.43, 3.18 [08:14:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.62, 1.86, 2.00 [08:16:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.09, 2.45, 2.19 [08:39:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.92, 1.47, 1.91 [08:45:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.80, 4.62, 3.23 [08:45:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.51, 1.81, 1.88 [08:47:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.45, 3.64, 3.03 [08:47:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.47, 1.66, 1.82 [08:53:23] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.65, 1.75 [08:55:22] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.40, 1.55, 1.70 [08:55:30] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk [08:59:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.38, 2.09, 1.88 [09:01:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.10, 1.79, 1.80 [09:09:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.05, 2.13, 1.93 [09:10:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.52, 1.76, 1.97 [09:11:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.96, 1.77, 1.82 [09:15:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.62, 1.99, 1.87 [09:17:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.81, 3.61, 3.36 [09:19:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.72, 3.20, 3.23 [09:19:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.97, 1.57, 1.73 [09:20:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.59, 2.00, 1.91 [09:21:23] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.79, 1.93, 1.84 [09:22:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.67, 1.82, 1.85 [09:23:17] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.06, 4.17, 3.61 [09:25:17] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.22, 3.38, 3.39 [09:26:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.83, 2.10, 1.96 [09:29:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.54, 3.62, 3.46 [09:31:13] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.99, 3.13, 3.29 [09:33:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.97, 1.62, 1.95 [09:34:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.33, 1.77, 1.88 [09:35:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.62, 1.91, 2.00 [09:36:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.26, 1.91, 1.92 [09:37:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.51, 1.68, 1.90 [09:38:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.71, 1.87, 1.90 [09:39:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.16, 3.92, 3.56 [09:39:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 1.84, 1.93 [09:43:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.52, 1.86, 1.94 [09:46:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.70, 1.88, 1.82 [09:47:05] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.37, 2.91, 3.28 [09:48:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.70, 1.78, 1.79 [09:50:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 4.47, 2.49, 2.03 [09:51:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.84, 2.48, 2.10 [09:53:02] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.75, 4.43, 3.86 [09:53:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.87, 6.10, 4.69 [09:54:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.49, 1.92, 1.91 [09:55:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.09, 5.74, 4.75 [09:56:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.05, 1.87, 1.88 [09:57:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.53, 4.68, 4.48 [09:58:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.65, 1.70, 1.81 [10:01:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.70, 5.23, 4.81 [10:02:26] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.16, 1.41, 1.67 [10:02:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.03, 3.80, 4.00 [10:03:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.88, 4.10, 4.45 [10:04:57] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.86, 3.89, 4.01 [10:06:56] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.63, 3.10, 3.70 [10:12:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.67, 1.76, 1.68 [10:12:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.26, 3.86, 3.69 [10:14:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.50, 2.03, 1.78 [10:14:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.53, 3.59 [10:18:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.51, 4.10, 3.76 [10:24:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.92, 3.39, 3.63 [10:28:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.52, 3.27, 3.48 [10:30:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.82, 3.74, 3.66 [10:32:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.14, 2.75, 3.30 [10:38:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.89, 1.59, 1.95 [10:40:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.16, 1.73, 1.96 [10:42:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.62, 1.62, 1.88 [10:45:30] [Grafana] !sre RESOLVED: High Job Queue Backlog https://grafana.miraheze.org/d/GtxbP1Xnk [10:46:26] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.11, 1.22, 1.65 [10:50:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.70, 2.19, 1.96 [10:58:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.24, 1.87, 1.98 [11:00:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.78, 1.99, 2.01 [11:01:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.50, 4.90, 3.54 [11:03:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.79, 3.63, 3.24 [11:03:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.39, 1.62, 1.96 [11:05:23] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.18, 2.63, 2.28 [11:08:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.81, 1.68, 1.94 [11:10:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.50, 2.08, 2.06 [11:26:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.11, 1.59, 1.92 [11:28:20] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.82, 1.55, 1.24 [11:30:20] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.63, 1.60, 1.30 [11:30:26] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.21, 1.68 [11:39:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.45, 4.05, 3.21 [11:43:30] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.05, 3.42, 3.18 [11:44:08] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.52, 2.25, 1.88 [11:45:29] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.61, 2.95, 3.05 [11:51:26] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.91, 3.84, 3.34 [11:53:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.27, 3.75, 3.37 [11:55:24] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.86, 4.12, 3.54 [12:01:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.03, 6.36, 4.27 [12:07:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.80, 5.77, 4.69 [12:09:12] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.32, 4.74, 4.43 [12:18:51] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.31, 5.82, 5.03 [12:20:46] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 14.78, 7.81, 5.77 [12:32:10] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.85, 5.91, 5.96 [12:35:58] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.39, 3.38, 4.90 [12:52:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.01, 5.31, 4.61 [12:54:06] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 4.79, 4.96, 4.56 [13:17:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.51, 5.11, 4.81 [13:19:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.51, 5.97, 5.12 [13:20:52] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03update-PageProperties [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/b2c1c4fa3b54 [13:20:54] [02miraheze/mediawiki] 07paladox 03b2c1c4f - Update PageProperties to 1.1.0 [13:20:55] [02mediawiki] 07paladox created branch 03update-PageProperties - 13https://github.com/miraheze/mediawiki [13:20:56] [url] Page not found · GitHub · GitHub | github.com [13:21:23] [02mediawiki] 07paladox deleted branch 03update-PageProperties - 13https://github.com/miraheze/mediawiki [13:21:23] [url] Page not found · GitHub · GitHub | github.com [13:21:24] [02miraheze/mediawiki] 07paladox deleted branch 03update-PageProperties [13:22:23] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03update-PageProperties [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/9b580213b659 [13:22:25] [02miraheze/mediawiki] 07paladox 039b58021 - Update PageProperties to 1.1.0 [13:22:26] [02mediawiki] 07paladox created branch 03update-PageProperties - 13https://github.com/miraheze/mediawiki [13:22:27] ... [13:24:20] [02mediawiki] 07paladox opened pull request 03#9336: Update PageProperties to 1.1.0 - 13https://github.com/miraheze/mediawiki/pull/9336 [13:24:21] [url] Page not found · GitHub · GitHub | github.com [13:25:32] [02mediawiki] 07paladox commented on pull request 03#9336: Update PageProperties to 1.1.0 - 13https://github.com/miraheze/mediawiki/pull/9336#issuecomment-1250282979 [13:25:33] [url] Update PageProperties to 1.1.0 by paladox · Pull Request #9336 · miraheze/mediawiki · GitHub | github.com [13:31:25] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/9e78231001e6 [13:31:27] [02miraheze/mw-config] 07paladox 039e78231 - Support PageProperties 1.1.0 [13:31:28] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [13:31:29] [url] Page not found · GitHub · GitHub | github.com [13:31:30] [02mw-config] 07paladox opened pull request 03#4904: Support PageProperties 1.1.0 - 13https://github.com/miraheze/mw-config/pull/4904 [13:31:30] ... [13:32:39] miraheze/mw-config - paladox the build passed. [13:33:11] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/28e48eb8291f [13:33:12] [02miraheze/puppet] 07paladox 0328e48eb - Support PageProperties 1.1.0 [13:33:14] [02puppet] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/puppet [13:33:14] ... [13:33:15] [02puppet] 07paladox opened pull request 03#2846: Support PageProperties 1.1.0 - 13https://github.com/miraheze/puppet/pull/2846 [13:33:16] [url] Page not found · GitHub · GitHub | github.com [13:33:35] [02puppet] 07paladox synchronize pull request 03#2846: Support PageProperties 1.1.0 - 13https://github.com/miraheze/puppet/pull/2846 [13:33:36] [url] Page not found · GitHub · GitHub | github.com [13:33:37] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/28e48eb8291f...1009a1de9289 [13:33:37] [url] Comparing 28e48eb8291f...1009a1de9289 · miraheze/puppet · GitHub | github.com [13:33:38] [02miraheze/puppet] 07paladox 031009a1d - Update extensionsetup.pp [13:49:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.40, 4.77, 5.83 [13:51:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.28, 5.87, 6.09 [14:01:47] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:03:53] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 9.274 second response time [14:45:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.41, 3.39, 5.68 [14:47:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.54, 4.85, 5.92 [14:58:07] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:58:18] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:58:39] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:59:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.27, 3.70, 2.86 [14:59:20] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:59:52] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [14:59:55] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:04:30] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 2607:5300:201:3100::5ebc/cpweb [15:04:37] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.740 second response time [15:05:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.28, 3.91, 3.29 [15:05:25] PROBLEM - cp31 Stunnel HTTP for mw131 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:05:43] PROBLEM - cp30 Stunnel HTTP for mw141 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:06:02] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 1.084 second response time [15:06:22] PROBLEM - cp31 Stunnel HTTP for mw132 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:06:25] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [15:07:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.06, 4.39, 3.54 [15:07:24] RECOVERY - cp31 Stunnel HTTP for mw131 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.252 second response time [15:08:05] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw131 [15:08:21] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 9.539 second response time [15:08:26] RECOVERY - cp31 Stunnel HTTP for mw132 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 7.304 second response time [15:09:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.47, 3.80, 3.44 [15:09:48] RECOVERY - cp30 Stunnel HTTP for mw141 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.597 second response time [15:10:05] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [15:10:27] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:11:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.31, 4.62, 3.79 [15:12:50] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:13:02] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:16:34] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.654 second response time [15:16:41] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 5.517 second response time [15:16:53] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.241 second response time [15:16:54] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.244 second response time [15:17:04] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.244 second response time [15:18:05] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 0.431 second response time [15:21:19] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:23:17] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 2.327 second response time [15:29:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.43, 3.53, 3.79 [15:31:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.56, 3.73, 3.82 [15:33:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.74, 3.62, 3.76 [15:35:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 3.62, 3.72 [15:37:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.22, 2.97, 3.46 [15:39:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.31, 2.73, 3.31 [15:45:57] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:46:06] [02mediawiki] 07Universal-Omega commented on pull request 03#9336: Update PageProperties to 1.1.0 - 13https://github.com/miraheze/mediawiki/pull/9336#issuecomment-1250334658 [15:46:07] [url] Update PageProperties to 1.1.0 by paladox · Pull Request #9336 · miraheze/mediawiki · GitHub | github.com [15:47:01] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03update-PageProperties [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/9b580213b659...63d93881dc75 [15:47:02] [url] Comparing 9b580213b659...63d93881dc75 · miraheze/mediawiki · GitHub | github.com [15:47:03] [02miraheze/mediawiki] 07paladox 0363d9388 - Update .gitmodules [15:47:04] [02mediawiki] 07paladox synchronize pull request 03#9336: Update PageProperties to 1.1.0 - 13https://github.com/miraheze/mediawiki/pull/9336 [15:47:05] [url] Page not found · GitHub · GitHub | github.com [15:47:09] [02mediawiki] 07paladox commented on pull request 03#9336: Update PageProperties to 1.1.0 - 13https://github.com/miraheze/mediawiki/pull/9336#issuecomment-1250334894 [15:47:11] [url] Update PageProperties to 1.1.0 by paladox · Pull Request #9336 · miraheze/mediawiki · GitHub | github.com [15:47:55] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29520 bytes in 1.156 second response time [15:48:22] paladox: you haven't added to .branches.json [15:49:39] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03update-PageProperties [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/63d93881dc75...c46b57ea1e28 [15:49:40] [url] Comparing 63d93881dc75...c46b57ea1e28 · miraheze/mediawiki · GitHub | github.com [15:49:40] done [15:49:41] [02miraheze/mediawiki] 07paladox 03c46b57e - Update .branches.json [15:49:42] [02mediawiki] 07paladox synchronize pull request 03#9336: Update PageProperties to 1.1.0 - 13https://github.com/miraheze/mediawiki/pull/9336 [15:49:43] [url] Page not found · GitHub · GitHub | github.com [15:59:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.95, 3.94, 3.31 [16:01:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.73, 3.44, 3.20 [16:03:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.14, 2.92, 3.03 [16:10:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.71, 1.64, 2.00 [16:12:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.83, 1.78, 2.01 [16:22:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.64, 1.82, 1.98 [16:24:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.11, 1.81, 1.95 [16:26:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.29, 1.58, 1.85 [16:34:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.28, 1.87, 1.85 [16:36:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.49, 1.74, 1.80 [16:38:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.21, 2.19, 1.97 [16:40:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.68, 1.97, 1.91 [16:40:52] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/updateCollation.php --wiki=levyraatiwikiwiki (END - exit=0) [16:41:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:42:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.40, 2.20, 2.01 [16:43:34] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/Echo/maintenance/removeOrphanedEvents.php --wiki=excellentmusicwiki (END - exit=0) [16:43:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:44:33] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/Echo/maintenance/removeOrphanedEvents.php --wiki=crappygameswiki (END - exit=0) [16:44:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:45:52] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/Echo/maintenance/removeOrphanedEvents.php --wiki=crappygameswiki --force (END - exit=0) [16:46:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.29, 1.99, 1.99 [16:46:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:48:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.04, 1.98, 1.99 [16:54:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.46, 1.88, 1.98 [17:01:22] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:02:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.42, 2.03, 1.99 [17:03:19] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.342 second response time [17:06:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.43, 1.93, 1.97 [17:08:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.50, 2.10, 2.03 [17:10:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.98, 2.00, 2.00 [17:12:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.43, 2.34, 2.13 [17:43:31] PROBLEM - ping6 on cloud11 is CRITICAL: PING CRITICAL - Packet loss = 100% [17:43:46] PROBLEM - cloud11 SSH on cloud11 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:43:55] PROBLEM - cloud11 SMART on cloud11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:44:28] PROBLEM - Host cloud11 is DOWN: PING CRITICAL - Packet loss = 100% [17:48:26] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.81, 1.86, 2.00 [17:50:26] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.32, 2.09, 2.07 [17:52:45] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/f97c06f0be34...8a724385771f [17:52:46] [url] Comparing f97c06f0be34...8a724385771f · miraheze/puppet · GitHub | github.com [17:52:47] [02miraheze/puppet] 07JohnFLewis 038a72438 - T9214: Add lucidcharts [17:53:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.70, 4.26, 5.79 [17:57:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 10.11, 6.39, 6.26 [17:59:12] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.33, 5.41, 5.91 [18:01:12] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 9.67, 6.66, 6.27 [18:03:41] !log add universalomega to sre-infrastructure LDAP group [18:03:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:07:06] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/d92892386512 [18:07:07] [02miraheze/dns] 07paladox 03d928923 - Add cp22 to dns [18:07:09] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [18:07:09] [url] Page not found · GitHub · GitHub | github.com [18:07:10] [02dns] 07paladox opened pull request 03#350: Add cp22 to dns - 13https://github.com/miraheze/dns/pull/350 [18:07:11] [url] Page not found · GitHub · GitHub | github.com [18:07:21] [02dns] 07paladox closed pull request 03#350: Add cp22 to dns - 13https://github.com/miraheze/dns/pull/350 [18:07:21] [url] Page not found · GitHub · GitHub | github.com [18:07:22] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [18:07:22] ... [18:07:24] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [18:07:25] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/0412134f45e5...5af556940f6c [18:07:26] [url] Comparing 0412134f45e5...5af556940f6c · miraheze/dns · GitHub | github.com [18:07:27] [02miraheze/dns] 07paladox 035af5569 - Add cp22 to dns (#350) [18:08:20] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.97, 1.56, 1.27 [18:10:20] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.07, 1.73, 1.37 [18:12:20] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.94, 1.80, 1.44 [18:14:20] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.08, 1.91, 1.53 [18:16:33] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/bef8980603cf [18:16:34] [02miraheze/puppet] 07paladox 03bef8980 - Install cp22 [18:16:36] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://github.com/miraheze/puppet [18:16:36] [url] Page not found · GitHub · GitHub | github.com [18:16:37] [02puppet] 07paladox opened pull request 03#2847: Install cp22 - 13https://github.com/miraheze/puppet/pull/2847 [18:16:38] ... [18:18:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+1/-0/±0] 13https://github.com/miraheze/puppet/compare/bef8980603cf...21e4db6402f5 [18:18:09] [url] Comparing bef8980603cf...21e4db6402f5 · miraheze/puppet · GitHub | github.com [18:18:10] [02miraheze/puppet] 07paladox 0321e4db6 - Create cp22.yaml [18:18:11] [02puppet] 07paladox synchronize pull request 03#2847: Install cp22 - 13https://github.com/miraheze/puppet/pull/2847 [18:18:12] [url] Page not found · GitHub · GitHub | github.com [18:18:51] [02puppet] 07paladox closed pull request 03#2847: Install cp22 - 13https://github.com/miraheze/puppet/pull/2847 [18:18:52] [url] Page not found · GitHub · GitHub | github.com [18:18:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/puppet/compare/8a724385771f...a1924c19ea27 [18:18:53] [url] Comparing 8a724385771f...a1924c19ea27 · miraheze/puppet · GitHub | github.com [18:18:54] [02miraheze/puppet] 07paladox 03a1924c1 - Install cp22 (#2847) [18:18:56] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/puppet [18:18:56] [url] Page not found · GitHub · GitHub | github.com [18:18:57] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [18:25:15] PROBLEM - ping6 on cp22 is CRITICAL: PING CRITICAL - Packet loss = 80%, RTA = 8.05 ms [18:26:07] PROBLEM - cp22 Stunnel HTTP for mail121 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:26:14] PROBLEM - cp22 Stunnel HTTP for test131 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:26:27] PROBLEM - cp22 Stunnel HTTP for reports121 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:26:37] PROBLEM - roblox-wiki.tk - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - roblox-wiki.tk All nameservers failed to answer the query. [18:27:02] PROBLEM - cp22 Stunnel HTTP for phab121 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:27:12] PROBLEM - cp22 Stunnel HTTP for puppet141 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:27:16] RECOVERY - ping6 on cp22 is OK: PING OK - Packet loss = 0%, RTA = 6.95 ms [18:28:26] RECOVERY - cp22 Stunnel HTTP for reports121 on cp22 is OK: HTTP OK: HTTP/1.1 200 OK - 10996 bytes in 0.109 second response time [18:29:45] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/8dc2716c9df9 [18:29:46] [02miraheze/dns] 07paladox 038dc2716 - Use new cp22 for gb and pool [18:29:48] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [18:29:48] [url] Page not found · GitHub · GitHub | github.com [18:29:49] [02dns] 07paladox opened pull request 03#351: Use new cp22 for gb and pool - 13https://github.com/miraheze/dns/pull/351 [18:29:50] ... [18:30:01] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/compare/8dc2716c9df9...6ee109ab907f [18:30:02] [url] Comparing 8dc2716c9df9...6ee109ab907f · miraheze/dns · GitHub | github.com [18:30:03] [02miraheze/dns] 07paladox 036ee109a - Update admin_state [18:30:04] [02dns] 07paladox synchronize pull request 03#351: Use new cp22 for gb and pool - 13https://github.com/miraheze/dns/pull/351 [18:30:05] [url] Page not found · GitHub · GitHub | github.com [18:30:17] RECOVERY - cp22 Stunnel HTTP for test131 on cp22 is OK: HTTP OK: HTTP/1.1 200 OK - 14740 bytes in 0.064 second response time [18:30:56] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/56c21e807946 [18:30:58] [02miraheze/mw-config] 07paladox 0356c21e8 - Add cp22 to wgCdnServers [18:30:59] [02mw-config] 07paladox created branch 03paladox-patch-2 - 13https://github.com/miraheze/mw-config [18:31:00] ... [18:31:01] [02mw-config] 07paladox opened pull request 03#4905: Add cp22 to wgCdnServers - 13https://github.com/miraheze/mw-config/pull/4905 [18:31:01] [url] Page not found · GitHub · GitHub | github.com [18:31:05] [02mw-config] 07paladox closed pull request 03#4905: Add cp22 to wgCdnServers - 13https://github.com/miraheze/mw-config/pull/4905 [18:31:06] [url] Page not found · GitHub · GitHub | github.com [18:31:07] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-2 [18:31:08] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f6328acec66a...22f9a663337b [18:31:09] [url] Comparing f6328acec66a...22f9a663337b · miraheze/mw-config · GitHub | github.com [18:31:10] [02miraheze/mw-config] 07paladox 0322f9a66 - Add cp22 to wgCdnServers (#4905) [18:31:11] [02mw-config] 07paladox deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/mw-config [18:31:12] [url] Page not found · GitHub · GitHub | github.com [18:31:26] [02dns] 07paladox closed pull request 03#351: Use new cp22 for gb and pool - 13https://github.com/miraheze/dns/pull/351 [18:31:26] [url] Page not found · GitHub · GitHub | github.com [18:31:27] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/dns/compare/5af556940f6c...36c8aeb49577 [18:31:28] [url] Comparing 5af556940f6c...36c8aeb49577 · miraheze/dns · GitHub | github.com [18:31:29] [02miraheze/dns] 07paladox 0336c8aeb - Use new cp22 for gb and pool (#351) [18:31:30] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [18:31:31] ... [18:31:32] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [18:31:50] paladox: cdn servers must be merged before pool [18:32:08] miraheze/mw-config - paladox the build passed. [18:32:13] miraheze/mw-config - paladox the build passed. [18:32:41] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [18:32:51] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 10s [18:32:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:32:56] Just use puppet too [18:32:57] !log [paladox@mwtask141] starting deploy of {'config': True} to all [18:33:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:33:14] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 16s [18:33:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:33:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:35:48] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.37, 1.63, 1.95 [18:36:34] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03revert-2794-Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/5ca85e085382 [18:36:35] [url] Page not found · GitHub · GitHub | github.com [18:36:35] PROBLEM - wiki.phgalaxy.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.phgalaxy.eu.org could not be found [18:36:35] [02miraheze/puppet] 07Universal-Omega 035ca85e0 - Revert "icingaweb2: add myself to "Administrators" role (#2794)" [18:36:37] [02puppet] 07Universal-Omega created branch 03revert-2794-Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [18:36:37] ... [18:36:38] PROBLEM - dariawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dariawiki.org could not be found [18:36:38] [02puppet] 07Universal-Omega opened pull request 03#2848: Revert "icingaweb2: add myself to "Administrators" role" - 13https://github.com/miraheze/puppet/pull/2848 [18:36:39] [url] Page not found · GitHub · GitHub | github.com [18:36:53] PROBLEM - www.lgbtqia.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.lgbtqia.wiki could not be found [18:36:57] PROBLEM - history.sdtef.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for history.sdtef.org could not be found [18:36:58] PROBLEM - wiki.cjgh.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.cjgh.xyz could not be found [18:36:58] PROBLEM - vedopedia.witches-empire.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vedopedia.witches-empire.com could not be found [18:36:58] PROBLEM - publictestwiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for publictestwiki.com could not be found [18:37:05] PROBLEM - data.nonbinary.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for data.nonbinary.wiki could not be found [18:37:06] PROBLEM - wiki.mostly.vet - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mostly.vet could not be found [18:37:07] PROBLEM - grayravens.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for grayravens.com could not be found [18:37:08] PROBLEM - miraheze.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.com could not be found [18:37:08] [02puppet] 07Universal-Omega closed pull request 03#2848: Revert "icingaweb2: add myself to "Administrators" role" - 13https://github.com/miraheze/puppet/pull/2848 [18:37:09] [url] Page not found · GitHub · GitHub | github.com [18:37:09] PROBLEM - ao90.pinho.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ao90.pinho.org could not be found [18:37:09] PROBLEM - heavyironmodding.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for heavyironmodding.org could not be found [18:37:10] [02miraheze/puppet] 07Universal-Omega deleted branch 03revert-2794-Universal-Omega-patch-1 [18:37:10] PROBLEM - commons.ballmedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for commons.ballmedia.org could not be found [18:37:11] [02puppet] 07Universal-Omega deleted branch 03revert-2794-Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [18:37:12] ... [18:37:12] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a1924c19ea27...d6a4465ab816 [18:37:13] [url] Comparing a1924c19ea27...d6a4465ab816 · miraheze/puppet · GitHub | github.com [18:37:14] [02miraheze/puppet] 07Universal-Omega 03d6a4465 - Revert "icingaweb2: add myself to "Administrators" role" (#2848) [18:37:17] PROBLEM - www.trollpasta.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.trollpasta.com could not be found [18:37:23] PROBLEM - civwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for civwiki.org could not be found [18:37:24] PROBLEM - solaswiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for solaswiki.org could not be found [18:37:25] PROBLEM - wiki.vinesh.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.vinesh.eu.org could not be found [18:37:28] PROBLEM - vitriol.spoon.army - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vitriol.spoon.army could not be found [18:37:29] PROBLEM - wiki.kachow.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.kachow.org could not be found [18:37:32] PROBLEM - www.christipedia.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.christipedia.nl could not be found [18:37:35] PROBLEM - permanentfuturelab.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for permanentfuturelab.wiki could not be found [18:37:44] PROBLEM - wiki.ciptamedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.ciptamedia.org could not be found [18:37:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.80, 4.19, 3.24 [18:37:48] PROBLEM - miraheze.gq - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.gq could not be found [18:37:49] PROBLEM - grk.repository.archiopedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for grk.repository.archiopedia.org could not be found [18:37:52] PROBLEM - electrowiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for electrowiki.org could not be found [18:38:01] PROBLEM - stablestate.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for stablestate.org could not be found [18:38:02] PROBLEM - nonciclopedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for nonciclopedia.org could not be found [18:38:04] PROBLEM - swests.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for swests.org could not be found [18:38:05] PROBLEM - vise.dayid.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vise.dayid.org could not be found [18:38:05] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:38:06] PROBLEM - wiki.wikimedia.cat - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.wikimedia.cat could not be found [18:38:09] PROBLEM - wiki.horizonsend.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.horizonsend.net could not be found [18:38:12] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:38:14] PROBLEM - www.petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.petrawiki.org could not be found [18:38:16] PROBLEM - wiki.fossbots.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.fossbots.org could not be found [18:38:17] PROBLEM - datawiki.online - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for datawiki.online could not be found [18:38:19] PROBLEM - kunwok.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for kunwok.org could not be found [18:38:19] PROBLEM - tech.teojingyao.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tech.teojingyao.com could not be found [18:38:21] PROBLEM - wiki.villagecollaborative.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.villagecollaborative.net could not be found [18:38:24] PROBLEM - mcwiki.kirbygang.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mcwiki.kirbygang.tk could not be found [18:38:28] PROBLEM - buildabearwiki.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for buildabearwiki.info could not be found [18:38:29] PROBLEM - hi.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hi.gyaanipedia.com could not be found [18:38:29] PROBLEM - wiki.exputra.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.exputra.com could not be found [18:38:30] PROBLEM - dc.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dc.miraheze.org could not be found [18:38:31] PROBLEM - famedata.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for famedata.org could not be found [18:38:32] PROBLEM - smafallfest.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for smafallfest.org could not be found [18:38:34] PROBLEM - es.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for es.gyaanipedia.com could not be found [18:38:36] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:38:37] PROBLEM - cp22 Stunnel HTTP for mw121 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:38:40] PROBLEM - journeytheword.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for journeytheword.wiki could not be found [18:38:44] PROBLEM - wiki.meregos.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.meregos.com could not be found [18:38:52] PROBLEM - gp.ct777.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for gp.ct777.cf could not be found [18:39:01] PROBLEM - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.gesamtschule-nordkirchen.de could not be found [18:39:02] PROBLEM - www.mcpk.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.mcpk.wiki could not be found [18:39:03] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:39:03] PROBLEM - www.zenbuddhism.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.zenbuddhism.info could not be found [18:39:10] PROBLEM - theapplesecretswiki.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for theapplesecretswiki.ml could not be found [18:39:11] PROBLEM - smashbroswiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for smashbroswiki.com could not be found [18:39:17] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:39:32] RECOVERY - cp22 Stunnel HTTP for phab121 on cp22 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.111 second response time [18:39:37] RECOVERY - cp22 Stunnel HTTP for puppet141 on cp22 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 3.097 second response time [18:39:43] PROBLEM - patternarchive.online - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for patternarchive.online could not be found [18:39:44] PROBLEM - test1.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for test1.miraheze.org could not be found [18:39:44] PROBLEM - www.portalsofphereon.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.portalsofphereon.com could not be found [18:39:51] PROBLEM - intp.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for intp.miraheze.org could not be found [18:39:53] PROBLEM - wiki.digitalefitheid.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.digitalefitheid.nl could not be found [18:39:57] PROBLEM - sims.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sims.miraheze.org could not be found [18:39:58] PROBLEM - wiki.beergeeks.co.il - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.beergeeks.co.il could not be found [18:39:59] PROBLEM - pokemon2.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pokemon2.miraheze.org could not be found [18:40:00] PROBLEM - wiki.fatcatfablab.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.fatcatfablab.org could not be found [18:40:03] PROBLEM - repository.archiopedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for repository.archiopedia.org could not be found [18:40:03] PROBLEM - www.famedata.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.famedata.org could not be found [18:40:04] PROBLEM - source.erag.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for source.erag.eu.org could not be found [18:40:06] PROBLEM - zamlung.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for zamlung.tk could not be found [18:40:08] PROBLEM - podpedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for podpedia.org could not be found [18:40:08] PROBLEM - commons.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for commons.gyaanipedia.com could not be found [18:40:09] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nj.cn.eu.org could not be found [18:40:13] PROBLEM - bn.wikiyri.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for bn.wikiyri.org could not be found [18:40:13] PROBLEM - wiki.apico.buzz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.apico.buzz could not be found [18:40:14] PROBLEM - wiki.leapit.no - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.leapit.no could not be found [18:40:16] PROBLEM - en.petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.petrawiki.org could not be found [18:40:16] PROBLEM - mabi.myomi.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mabi.myomi.net could not be found [18:40:18] PROBLEM - wiki.dunmoore.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.dunmoore.net could not be found [18:40:19] PROBLEM - hi.famepedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hi.famepedia.org could not be found [18:40:19] PROBLEM - recaptime.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for recaptime.miraheze.org could not be found [18:40:19] PROBLEM - wiki.globasa.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.globasa.net could not be found [18:40:22] PROBLEM - grk.archiopedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for grk.archiopedia.org could not be found [18:40:30] PROBLEM - infectowiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for infectowiki.com could not be found [18:40:31] PROBLEM - miraheze.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.ml could not be found [18:40:34] PROBLEM - ballmedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ballmedia.org could not be found [18:40:37] RECOVERY - cp22 Stunnel HTTP for mw121 on cp22 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 4.543 second response time [18:40:38] PROBLEM - wiki.warframestat.us - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.warframestat.us could not be found [18:40:39] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 4.951 second response time [18:40:59] PROBLEM - savagepedia.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for savagepedia.wiki could not be found [18:41:02] PROBLEM - squareenixwiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for squareenixwiki.com could not be found [18:41:03] PROBLEM - storytime.jdstroy.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for storytime.jdstroy.cf could not be found [18:41:06] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 7.178 second response time [18:41:06] PROBLEM - slupe.fp64.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for slupe.fp64.org could not be found [18:41:13] PROBLEM - www.electrowiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.electrowiki.org could not be found [18:41:19] PROBLEM - wiki.hylormc.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.hylormc.tk could not be found [18:41:20] PROBLEM - pmwiki.cubestudios.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pmwiki.cubestudios.xyz could not be found [18:41:21] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 4.754 second response time [18:41:22] PROBLEM - tep.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tep.wiki could not be found [18:41:28] PROBLEM - wiki.funkey-project.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.funkey-project.com could not be found [18:41:28] PROBLEM - finalfantasy.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for finalfantasy.miraheze.org could not be found [18:41:29] PROBLEM - bebaskanpengetahuan.id - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for bebaskanpengetahuan.id could not be found [18:41:32] PROBLEM - piwik.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for piwik.miraheze.org could not be found [18:41:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.82, 3.75, 3.28 [18:41:40] PROBLEM - royal-wiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for royal-wiki.org could not be found [18:41:43] PROBLEM - thestarsareright.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for thestarsareright.org could not be found [18:41:46] PROBLEM - hellointernet.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hellointernet.miraheze.org could not be found [18:41:56] PROBLEM - www.ballmedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.ballmedia.org could not be found [18:41:58] PROBLEM - www.permanentfuturelab.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.permanentfuturelab.wiki could not be found [18:41:59] PROBLEM - fc.songcontests.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for fc.songcontests.eu could not be found [18:42:00] PROBLEM - wiki.controlistes.fr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.controlistes.fr could not be found [18:42:01] PROBLEM - wiki.mastodon.kr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mastodon.kr could not be found [18:42:07] PROBLEM - knifepointhorror.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for knifepointhorror.wiki could not be found [18:42:08] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 2.169 second response time [18:42:15] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 0.388 second response time [18:42:19] PROBLEM - wiki.ultravanilla.world - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.ultravanilla.world could not be found [18:42:25] PROBLEM - wikimas.kr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikimas.kr could not be found [18:42:34] PROBLEM - de.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for de.gyaanipedia.com could not be found [18:42:38] PROBLEM - wiki.jeremyboyd.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.jeremyboyd.org could not be found [18:42:42] PROBLEM - elsterclopedie.marithaime.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for elsterclopedie.marithaime.nl could not be found [18:42:43] PROBLEM - nonbinary.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for nonbinary.wiki could not be found [18:42:50] PROBLEM - www.puzzles.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.puzzles.wiki could not be found [18:42:51] PROBLEM - studyabroad.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for studyabroad.wiki could not be found [18:42:54] RECOVERY - cp22 Stunnel HTTP for mail121 on cp22 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.033 second response time [18:43:03] PROBLEM - removededm.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for removededm.ml could not be found [18:43:07] PROBLEM - atnarsia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for atnarsia.com could not be found [18:43:07] PROBLEM - wiki.erisly.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.erisly.com could not be found [18:43:16] PROBLEM - entw.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for entw.ml could not be found [18:43:25] PROBLEM - marinebiodiversitymatrix.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for marinebiodiversitymatrix.org could not be found [18:43:27] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.37, 1.40, 1.70 [18:43:29] PROBLEM - avas.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for avas.wiki could not be found [18:43:29] PROBLEM - animefeet.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for animefeet.miraheze.org could not be found [18:43:53] PROBLEM - drowiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for drowiki.com could not be found [18:44:00] PROBLEM - tot.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tot.wiki could not be found [18:44:01] PROBLEM - wiki.wisrail.de - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.wisrail.de could not be found [18:44:01] PROBLEM - lg.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lg.gyaanipedia.com could not be found [18:44:09] PROBLEM - www.mwcosmos.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.mwcosmos.com could not be found [18:44:10] PROBLEM - polandballwiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for polandballwiki.com could not be found [18:44:12] PROBLEM - wiki.yahyabd.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.yahyabd.xyz could not be found [18:44:12] PROBLEM - it.famepedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for it.famepedia.org could not be found [18:44:14] what's this [18:44:14] PROBLEM - wiki.sanctuary-rts.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.sanctuary-rts.com could not be found [18:44:14] PROBLEM - baharna.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for baharna.org could not be found [18:44:15] oh [18:44:16] PROBLEM - wiki.umbranet.mandelbrotgames.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.umbranet.mandelbrotgames.com could not be found [18:44:18] PROBLEM - allthetropes.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for allthetropes.miraheze.org could not be found [18:44:30] PROBLEM - wiki.pixlies.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.pixlies.net could not be found [18:44:31] PROBLEM - gs.sidem.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for gs.sidem.wiki could not be found [18:44:34] PROBLEM - sega.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sega.miraheze.org could not be found [18:44:35] PROBLEM - az.wikiretet.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for az.wikiretet.ga could not be found [18:44:35] PROBLEM - www.programming.red - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.programming.red could not be found [18:44:38] PROBLEM - webkinzguide.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for webkinzguide.com could not be found [18:44:39] PROBLEM - wiki.worldsofweary.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.worldsofweary.com could not be found [18:44:42] PROBLEM - animatedfeet.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for animatedfeet.miraheze.org could not be found [18:44:43] PROBLEM - beaconspace.unrestrictedlorefare.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for beaconspace.unrestrictedlorefare.com could not be found [18:44:50] PROBLEM - wiki.thunis.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.thunis.eu could not be found [18:44:52] PROBLEM - wikimoma.art - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikimoma.art could not be found [18:45:00] PROBLEM - poserdazfreebies.orain.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for poserdazfreebies.orain.org could not be found [18:45:03] PROBLEM - www.obeymewiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.obeymewiki.com could not be found [18:45:09] PROBLEM - en.wikiyri.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.wikiyri.org could not be found [18:45:10] PROBLEM - pubwiki.lab.co.pl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pubwiki.lab.co.pl could not be found [18:45:26] PROBLEM - www.wikiretet.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.wikiretet.ga could not be found [18:45:29] https://github.com/miraheze/puppet/blob/ece79368c7dcb0ed54d6ac0614e14b1f7b63a4b9/modules/monitoring/templates/ssl.conf.erb#L40 should match it? [18:45:29] [url] puppet/ssl.conf.erb at ece79368c7dcb0ed54d6ac0614e14b1f7b63a4b9 · miraheze/puppet · GitHub | github.com [18:45:33] PROBLEM - txt-dex.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for txt-dex.com could not be found [18:45:33] PROBLEM - www.allthetropes.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.allthetropes.org could not be found [18:45:34] PROBLEM - wiki.bluevertigo.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.bluevertigo.org could not be found [18:45:36] PROBLEM - discordian.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for discordian.wiki could not be found [18:45:36] PROBLEM - apeirology.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for apeirology.com could not be found [18:45:37] PROBLEM - wiki.helsinginpoytaroolipelaajat.fi - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.helsinginpoytaroolipelaajat.fi could not be found [18:45:46] PROBLEM - wiki.dwarvesrp.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.dwarvesrp.com could not be found [18:45:50] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.zymonic.com could not be found [18:45:52] PROBLEM - translate.petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for translate.petrawiki.org could not be found [18:45:54] PROBLEM - portalsofphereon.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for portalsofphereon.com could not be found [18:45:54] PROBLEM - wiki.make717.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.make717.org could not be found [18:45:55] PROBLEM - chakra.moe - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for chakra.moe could not be found [18:45:55] PROBLEM - wiki.cyberfurs.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.cyberfurs.org could not be found [18:46:08] PROBLEM - archive.a2b2.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for archive.a2b2.org could not be found [18:46:08] PROBLEM - eng.archiopedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for eng.archiopedia.org could not be found [18:46:09] PROBLEM - slymods.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for slymods.info could not be found [18:46:10] PROBLEM - wiki.yumeka.icu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.yumeka.icu could not be found [18:46:10] PROBLEM - wiki.hsins.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.hsins.eu could not be found [18:46:12] PROBLEM - microworldwiki.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for microworldwiki.ga could not be found [18:46:13] PROBLEM - wiki.recaptime.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.recaptime.tk could not be found [18:46:15] PROBLEM - wiki.s23.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.s23.org could not be found [18:46:25] PROBLEM - staratlaswiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for staratlaswiki.org could not be found [18:46:27] PROBLEM - www.ambientguitar.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.ambientguitar.org could not be found [18:46:37] PROBLEM - www.scum-wiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.scum-wiki.com could not be found [18:46:39] PROBLEM - hastursnotebook.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hastursnotebook.org could not be found [18:46:42] PROBLEM - wiki.danvs.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.danvs.net could not be found [18:46:59] PROBLEM - encyclopediarobotica.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for encyclopediarobotica.org could not be found [18:47:00] PROBLEM - mystiverse.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mystiverse.wiki could not be found [18:47:08] PROBLEM - test3.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for test3.miraheze.org could not be found [18:47:08] PROBLEM - ffwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ffwiki.org could not be found [18:47:09] PROBLEM - biblestrength.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for biblestrength.net could not be found [18:47:10] PROBLEM - wiki.seamly.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.seamly.net could not be found [18:47:17] PROBLEM - wiki.rtapp.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.rtapp.tk could not be found [18:47:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 4.02, 3.54 [18:47:20] PROBLEM - wiki.minecraftathome.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.minecraftathome.com could not be found [18:47:20] PROBLEM - www.sekaipedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.sekaipedia.org could not be found [18:47:26] PROBLEM - wiki.jkrstudios.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.jkrstudios.org could not be found [18:47:28] PROBLEM - tr.wikiretet.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tr.wikiretet.ga could not be found [18:47:29] PROBLEM - wiki.nowchess.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nowchess.org could not be found [18:47:29] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [18:47:30] PROBLEM - erawikisource.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for erawikisource.miraheze.org could not be found [18:47:31] PROBLEM - www.opendatascot.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.opendatascot.org could not be found [18:47:33] PROBLEM - smashloop.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for smashloop.wiki could not be found [18:47:34] PROBLEM - cyberlaw.ccdcoe.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cyberlaw.ccdcoe.org could not be found [18:47:36] PROBLEM - wiki.conworlds.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.conworlds.org could not be found [18:47:40] PROBLEM - m33ks.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for m33ks.ml could not be found [18:47:50] PROBLEM - abeyancewiki.bumblebee-studios.se - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for abeyancewiki.bumblebee-studios.se could not be found [18:47:54] PROBLEM - mazakwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mazakwiki.org could not be found [18:47:55] PROBLEM - en.famepedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.famepedia.org could not be found [18:47:56] PROBLEM - wikipariksha.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikipariksha.com could not be found [18:47:58] PROBLEM - johanloopmans.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for johanloopmans.nl could not be found [18:48:01] PROBLEM - donkeykong.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for donkeykong.miraheze.org could not be found [18:48:04] PROBLEM - experimyco.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for experimyco.com could not be found [18:48:26] PROBLEM - sparabel.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sparabel.wiki could not be found [18:48:28] PROBLEM - files.petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for files.petrawiki.org could not be found [18:48:30] PROBLEM - wiki.seredrau.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.seredrau.xyz could not be found [18:48:31] PROBLEM - celeste.ink - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for celeste.ink could not be found [18:48:36] PROBLEM - wiki.anglish.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.anglish.info could not be found [18:48:36] PROBLEM - wikipedia.yogfront.ooo - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikipedia.yogfront.ooo could not be found [18:48:39] PROBLEM - www.zetapedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.zetapedia.com could not be found [18:48:41] PROBLEM - wiki.zergmafia.top - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.zergmafia.top could not be found [18:48:43] PROBLEM - wiki.eversd.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.eversd.com could not be found [18:48:43] PROBLEM - persist.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for persist.wiki could not be found [18:48:44] PROBLEM - phgalaxy.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for phgalaxy.eu.org could not be found [18:48:46] PROBLEM - datacrondatabase.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for datacrondatabase.com could not be found [18:48:47] PROBLEM - metroidpedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for metroidpedia.com could not be found [18:48:57] PROBLEM - itora.bunnies1230.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for itora.bunnies1230.com could not be found [18:48:58] PROBLEM - wiki.mcpirevival.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mcpirevival.tk could not be found [18:48:58] PROBLEM - wiki.ravynos.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.ravynos.com could not be found [18:48:59] PROBLEM - dragonquest2.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dragonquest2.miraheze.org could not be found [18:49:05] PROBLEM - croc.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for croc.miraheze.org could not be found [18:49:06] PROBLEM - wiki.slimeapedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.slimeapedia.org could not be found [18:49:08] PROBLEM - adadevelopersacademy.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for adadevelopersacademy.wiki could not be found [18:49:09] PROBLEM - central.ballmedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for central.ballmedia.org could not be found [18:49:12] PROBLEM - landofliberos.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for landofliberos.com could not be found [18:49:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.41, 3.79, 3.51 [18:49:14] PROBLEM - you.r-fit.cc - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for you.r-fit.cc could not be found [18:49:16] PROBLEM - creativecommons.id - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for creativecommons.id could not be found [18:49:16] PROBLEM - archive.stellurgists.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for archive.stellurgists.wiki could not be found [18:49:21] PROBLEM - data.famepedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for data.famepedia.org could not be found [18:49:21] PROBLEM - betaheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for betaheze.org could not be found [18:49:22] PROBLEM - mediawiki.ecfin.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mediawiki.ecfin.eu could not be found [18:49:25] PROBLEM - wiki.lu9.io - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.lu9.io could not be found [18:49:28] PROBLEM - wiki.qadrishattari.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.qadrishattari.xyz could not be found [18:49:30] PROBLEM - commonwealth.0um.io - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for commonwealth.0um.io could not be found [18:49:35] PROBLEM - wiki.evscope.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.evscope.org could not be found [18:49:37] PROBLEM - wikiyri.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikiyri.org could not be found [18:50:00] PROBLEM - wiki.valkyrienskies.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.valkyrienskies.org could not be found [18:50:03] PROBLEM - wiki.yermocapital.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.yermocapital.com could not be found [18:50:05] PROBLEM - wiki.projectdiablo2.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.projectdiablo2.com could not be found [18:50:05] PROBLEM - spcodex.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for spcodex.wiki could not be found [18:50:07] PROBLEM - wiki.creaturathegame.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.creaturathegame.com could not be found [18:50:08] PROBLEM - wiki.astralprojections.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.astralprojections.org could not be found [18:50:14] PROBLEM - sharqedia.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sharqedia.ml could not be found [18:50:15] PROBLEM - n64brew.dev - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for n64brew.dev could not be found [18:50:15] PROBLEM - houkai2.cyou - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for houkai2.cyou could not be found [18:50:17] PROBLEM - liberhood.su - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for liberhood.su could not be found [18:50:17] PROBLEM - wikifencing.ru - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikifencing.ru could not be found [18:50:18] i've fixed the reverse dns for cp22 now [18:50:20] PROBLEM - www.marinebiodiversitymatrix.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.marinebiodiversitymatrix.org could not be found [18:50:22] PROBLEM - ndg.nenawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ndg.nenawiki.org could not be found [18:50:25] PROBLEM - rct.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rct.wiki could not be found [18:50:28] PROBLEM - uncyclopediakr.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for uncyclopediakr.miraheze.org could not be found [18:50:29] PROBLEM - 321nails.crpteam.club - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for 321nails.crpteam.club could not be found [18:50:29] PROBLEM - evil.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for evil.wiki could not be found [18:50:30] PROBLEM - wiki.mxlinuxusers.de - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mxlinuxusers.de could not be found [18:50:31] PROBLEM - pwiki.arkcls.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pwiki.arkcls.com could not be found [18:50:33] PROBLEM - rosettacode.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rosettacode.org could not be found [18:50:37] PROBLEM - electowiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for electowiki.org could not be found [18:50:38] PROBLEM - wiki.elgeis.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.elgeis.com could not be found [18:50:41] PROBLEM - feathercare.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for feathercare.net could not be found [18:50:41] PROBLEM - hoseki.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hoseki.wiki could not be found [18:50:47] PROBLEM - proficientprofit.click - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for proficientprofit.click could not be found [18:50:48] PROBLEM - dkwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dkwiki.org could not be found [18:50:49] PROBLEM - wiki.site97.fr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.site97.fr could not be found [18:50:59] PROBLEM - monarchists.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for monarchists.wiki could not be found [18:51:10] PROBLEM - lab.wikimimo.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lab.wikimimo.com could not be found [18:51:10] PROBLEM - small.polandballwiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for small.polandballwiki.com could not be found [18:51:16] PROBLEM - steamdecklinux.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for steamdecklinux.wiki could not be found [18:51:28] PROBLEM - staff.polandballwiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for staff.polandballwiki.com could not be found [18:51:37] PROBLEM - wiki.rosestulipsandliberty.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.rosestulipsandliberty.com could not be found [18:51:40] PROBLEM - icclopedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for icclopedia.org could not be found [18:51:40] PROBLEM - wiki.minkyu.kim - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.minkyu.kim could not be found [18:51:43] PROBLEM - wiki.climatechange.ai - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.climatechange.ai could not be found [18:51:46] PROBLEM - wiki.nevillepedia.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nevillepedia.eu could not be found [18:51:46] PROBLEM - thenintendowiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for thenintendowiki.org could not be found [18:51:51] PROBLEM - unmade.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for unmade.miraheze.org could not be found [18:51:54] PROBLEM - wiki.cryptoroyale.one - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.cryptoroyale.one could not be found [18:51:59] PROBLEM - wiki.worlduniversityandschool.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.worlduniversityandschool.org could not be found [18:52:00] PROBLEM - wiki.simorgh.me - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.simorgh.me could not be found [18:52:02] PROBLEM - www.winenjoy.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.winenjoy.net could not be found [18:52:03] PROBLEM - with.cpt-ra.bid - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for with.cpt-ra.bid could not be found [18:52:04] PROBLEM - wiki.rebirthofthenight.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.rebirthofthenight.com could not be found [18:52:05] PROBLEM - privacywiki.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for privacywiki.xyz could not be found [18:52:08] PROBLEM - wiki.autocountsoft.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.autocountsoft.com could not be found [18:52:15] PROBLEM - wiki.erag.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.erag.eu.org could not be found [18:52:15] PROBLEM - wiki.scpsharp.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.scpsharp.ga could not be found [18:52:18] PROBLEM - wiki.starship.digital - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.starship.digital could not be found [18:52:18] PROBLEM - wiki.puucraft.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.puucraft.net could not be found [18:52:20] PROBLEM - jakkidverse.pog.gay - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for jakkidverse.pog.gay could not be found [18:52:21] PROBLEM - kiseki.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for kiseki.wiki could not be found [18:52:24] PROBLEM - beta.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for beta.miraheze.org could not be found [18:52:31] PROBLEM - ambientguitar.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ambientguitar.org could not be found [18:52:38] PROBLEM - runzeppelin.ru - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for runzeppelin.ru could not be found [18:52:39] PROBLEM - mwcosmos.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mwcosmos.com could not be found [18:52:43] PROBLEM - dc-multiverse.dcwikis.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for dc-multiverse.dcwikis.com could not be found [18:52:46] PROBLEM - segawiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for segawiki.com could not be found [18:52:49] PROBLEM - taswin.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for taswin.miraheze.org could not be found [18:52:55] !log restart mon141 [18:59:11] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 201 bytes in 4.970 second response time [18:59:13] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:59:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.59, 3.59, 3.55 [18:59:24] PROBLEM - cp22 Stunnel HTTP for mw122 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:01:09] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.17, 1.54, 1.43 [19:01:10] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.244 second response time [19:01:17] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 3.928 second response time [19:01:21] RECOVERY - cp22 Stunnel HTTP for mw122 on cp22 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.024 second response time [19:01:21] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw122 [19:02:00] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 6.495 second response time [19:03:08] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.44, 1.50, 1.43 [19:03:16] RECOVERY - marinebiodiversitymatrix.org - reverse DNS on sslhost is OK: SSL OK - marinebiodiversitymatrix.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:03:16] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 14 backends are healthy [19:03:21] RECOVERY - animefeet.miraheze.org - reverse DNS on sslhost is OK: SSL OK - animefeet.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:05:02] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.53, 1.90, 1.93 [19:05:36] RECOVERY - wiki.phgalaxy.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.phgalaxy.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:05:48] RECOVERY - ao90.pinho.org - reverse DNS on sslhost is OK: SSL OK - ao90.pinho.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:05:50] RECOVERY - data.nonbinary.wiki - reverse DNS on sslhost is OK: SSL OK - data.nonbinary.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:05:50] RECOVERY - commons.ballmedia.org - reverse DNS on sslhost is OK: SSL OK - commons.ballmedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:00] RECOVERY - miraheze.com - reverse DNS on sslhost is OK: SSL OK - miraheze.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:06:04] RECOVERY - wiki.mostly.vet - reverse DNS on sslhost is OK: SSL OK - wiki.mostly.vet reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:07] RECOVERY - permanentfuturelab.wiki - reverse DNS on sslhost is OK: SSL OK - permanentfuturelab.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:06:07] RECOVERY - dariawiki.org - reverse DNS on sslhost is OK: SSL OK - dariawiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:06:08] RECOVERY - www.lgbtqia.wiki - reverse DNS on sslhost is OK: SSL OK - www.lgbtqia.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:08] RECOVERY - history.sdtef.org - reverse DNS on sslhost is OK: SSL OK - history.sdtef.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:08] RECOVERY - wiki.kachow.org - reverse DNS on sslhost is OK: SSL OK - wiki.kachow.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:09] RECOVERY - vedopedia.witches-empire.com - reverse DNS on sslhost is OK: SSL OK - vedopedia.witches-empire.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:20] RECOVERY - heavyironmodding.org - reverse DNS on sslhost is OK: SSL OK - heavyironmodding.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:06:26] RECOVERY - publictestwiki.com - reverse DNS on sslhost is OK: SSL OK - publictestwiki.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:28] RECOVERY - electrowiki.org - reverse DNS on sslhost is OK: SSL OK - electrowiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:06:31] RECOVERY - www.christipedia.nl - reverse DNS on sslhost is OK: SSL OK - www.christipedia.nl reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:06:34] RECOVERY - wiki.vinesh.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.vinesh.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:45] RECOVERY - grayravens.com - reverse DNS on sslhost is OK: SSL OK - grayravens.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:06:46] RECOVERY - solaswiki.org - reverse DNS on sslhost is OK: SSL OK - solaswiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:06:51] RECOVERY - grk.repository.archiopedia.org - reverse DNS on sslhost is OK: SSL OK - grk.repository.archiopedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:51] RECOVERY - nonciclopedia.org - reverse DNS on sslhost is OK: SSL OK - nonciclopedia.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:06:55] RECOVERY - wiki.cjgh.xyz - reverse DNS on sslhost is OK: SSL OK - wiki.cjgh.xyz reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:55] RECOVERY - wiki.villagecollaborative.net - reverse DNS on sslhost is OK: SSL OK - wiki.villagecollaborative.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:59] RECOVERY - vise.dayid.org - reverse DNS on sslhost is OK: SSL OK - vise.dayid.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:06:59] RECOVERY - civwiki.org - reverse DNS on sslhost is OK: SSL OK - civwiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:07:01] RECOVERY - www.petrawiki.org - reverse DNS on sslhost is OK: SSL OK - www.petrawiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:07:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.93, 1.95 [19:07:13] RECOVERY - mcwiki.kirbygang.tk - reverse DNS on sslhost is OK: SSL OK - mcwiki.kirbygang.tk reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:14] RECOVERY - dc.miraheze.org - reverse DNS on sslhost is OK: SSL OK - dc.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:07:14] RECOVERY - wiki.wikimedia.cat - reverse DNS on sslhost is OK: SSL OK - wiki.wikimedia.cat reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:16] RECOVERY - www.trollpasta.com - reverse DNS on sslhost is OK: SSL OK - www.trollpasta.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:07:17] RECOVERY - tech.teojingyao.com - reverse DNS on sslhost is OK: SSL OK - tech.teojingyao.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:18] RECOVERY - wiki.horizonsend.net - reverse DNS on sslhost is OK: SSL OK - wiki.horizonsend.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:27] RECOVERY - vitriol.spoon.army - reverse DNS on sslhost is OK: SSL OK - vitriol.spoon.army reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:29] RECOVERY - miraheze.gq - reverse DNS on sslhost is OK: SSL OK - miraheze.gq reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:07:35] RECOVERY - swests.org - reverse DNS on sslhost is OK: SSL OK - swests.org reverse DNS resolves to cp22.miraheze.org - CNAME FLAT [19:07:35] RECOVERY - wiki.ciptamedia.org - reverse DNS on sslhost is OK: SSL OK - wiki.ciptamedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:37] RECOVERY - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is OK: SSL OK - wiki.gesamtschule-nordkirchen.de reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:41] RECOVERY - wiki.exputra.com - reverse DNS on sslhost is OK: SSL OK - wiki.exputra.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:53] RECOVERY - buildabearwiki.info - reverse DNS on sslhost is OK: SSL OK - buildabearwiki.info reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:07:55] RECOVERY - hi.gyaanipedia.com - reverse DNS on sslhost is OK: SSL OK - hi.gyaanipedia.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:57] RECOVERY - www.mcpk.wiki - reverse DNS on sslhost is OK: SSL OK - www.mcpk.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:08:00] RECOVERY - stablestate.org - reverse DNS on sslhost is OK: SSL OK - stablestate.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:01] RECOVERY - wiki.fossbots.org - reverse DNS on sslhost is OK: SSL OK - wiki.fossbots.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:08:02] RECOVERY - kunwok.org - reverse DNS on sslhost is OK: SSL OK - kunwok.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:03] RECOVERY - wiki.meregos.com - reverse DNS on sslhost is OK: SSL OK - wiki.meregos.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:08:07] RECOVERY - theapplesecretswiki.ml - reverse DNS on sslhost is OK: SSL OK - theapplesecretswiki.ml reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:10] RECOVERY - journeytheword.wiki - reverse DNS on sslhost is OK: SSL OK - journeytheword.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:11] RECOVERY - datawiki.online - reverse DNS on sslhost is OK: SSL OK - datawiki.online reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:15] RECOVERY - smashbroswiki.com - reverse DNS on sslhost is OK: SSL OK - smashbroswiki.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:20] RECOVERY - smafallfest.org - reverse DNS on sslhost is OK: SSL OK - smafallfest.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:26] RECOVERY - www.zenbuddhism.info - reverse DNS on sslhost is OK: SSL OK - www.zenbuddhism.info reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:08:28] RECOVERY - famedata.org - reverse DNS on sslhost is OK: SSL OK - famedata.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:30] RECOVERY - es.gyaanipedia.com - reverse DNS on sslhost is OK: SSL OK - es.gyaanipedia.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:08:36] RECOVERY - gp.ct777.cf - reverse DNS on sslhost is OK: SSL OK - gp.ct777.cf reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:08:44] RECOVERY - zamlung.tk - reverse DNS on sslhost is OK: SSL OK - zamlung.tk reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:50] RECOVERY - pokemon2.miraheze.org - reverse DNS on sslhost is OK: SSL OK - pokemon2.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:50] RECOVERY - repository.archiopedia.org - reverse DNS on sslhost is OK: SSL OK - repository.archiopedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:08:52] RECOVERY - commons.gyaanipedia.com - reverse DNS on sslhost is OK: SSL OK - commons.gyaanipedia.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:08:53] RECOVERY - intp.miraheze.org - reverse DNS on sslhost is OK: SSL OK - intp.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:53] RECOVERY - recaptime.miraheze.org - reverse DNS on sslhost is OK: SSL OK - recaptime.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:54] RECOVERY - bn.wikiyri.org - reverse DNS on sslhost is OK: SSL OK - bn.wikiyri.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:08:58] RECOVERY - www.famedata.org - reverse DNS on sslhost is OK: SSL OK - www.famedata.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:05] RECOVERY - wiki.beergeeks.co.il - reverse DNS on sslhost is OK: SSL OK - wiki.beergeeks.co.il reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:10] RECOVERY - hi.famepedia.org - reverse DNS on sslhost is OK: SSL OK - hi.famepedia.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:18] RECOVERY - wiki.dunmoore.net - reverse DNS on sslhost is OK: SSL OK - wiki.dunmoore.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:19] RECOVERY - wiki.fatcatfablab.org - reverse DNS on sslhost is OK: SSL OK - wiki.fatcatfablab.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:21] RECOVERY - mabi.myomi.net - reverse DNS on sslhost is OK: SSL OK - mabi.myomi.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:22] RECOVERY - podpedia.org - reverse DNS on sslhost is OK: SSL OK - podpedia.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:28] RECOVERY - test1.miraheze.org - reverse DNS on sslhost is OK: SSL OK - test1.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:32] RECOVERY - patternarchive.online - reverse DNS on sslhost is OK: SSL OK - patternarchive.online reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:32] RECOVERY - wiki.warframestat.us - reverse DNS on sslhost is OK: SSL OK - wiki.warframestat.us reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:33] RECOVERY - wiki.globasa.net - reverse DNS on sslhost is OK: SSL OK - wiki.globasa.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:36] RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:37] RECOVERY - miraheze.ml - reverse DNS on sslhost is OK: SSL OK - miraheze.ml reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:38] RECOVERY - en.petrawiki.org - reverse DNS on sslhost is OK: SSL OK - en.petrawiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:38] RECOVERY - wiki.digitalefitheid.nl - reverse DNS on sslhost is OK: SSL OK - wiki.digitalefitheid.nl reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:38] RECOVERY - www.portalsofphereon.com - reverse DNS on sslhost is OK: SSL OK - www.portalsofphereon.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:41] RECOVERY - grk.archiopedia.org - reverse DNS on sslhost is OK: SSL OK - grk.archiopedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:47] RECOVERY - sims.miraheze.org - reverse DNS on sslhost is OK: SSL OK - sims.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:50] RECOVERY - ballmedia.org - reverse DNS on sslhost is OK: SSL OK - ballmedia.org reverse DNS resolves to cp22.miraheze.org - CNAME FLAT [19:09:51] RECOVERY - squareenixwiki.com - reverse DNS on sslhost is OK: SSL OK - squareenixwiki.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:09:56] RECOVERY - wiki.apico.buzz - reverse DNS on sslhost is OK: SSL OK - wiki.apico.buzz reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:58] RECOVERY - source.erag.eu.org - reverse DNS on sslhost is OK: SSL OK - source.erag.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:09:58] RECOVERY - wiki.leapit.no - reverse DNS on sslhost is OK: SSL OK - wiki.leapit.no reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:10:02] RECOVERY - pmwiki.cubestudios.xyz - reverse DNS on sslhost is OK: SSL OK - pmwiki.cubestudios.xyz reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:10:09] RECOVERY - slupe.fp64.org - reverse DNS on sslhost is OK: SSL OK - slupe.fp64.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:10:11] RECOVERY - www.electrowiki.org - reverse DNS on sslhost is OK: SSL OK - www.electrowiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:10:12] RECOVERY - finalfantasy.miraheze.org - reverse DNS on sslhost is OK: SSL OK - finalfantasy.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:10:21] RECOVERY - infectowiki.com - reverse DNS on sslhost is OK: SSL OK - infectowiki.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:10:21] RECOVERY - wiki.hylormc.tk - reverse DNS on sslhost is OK: SSL OK - wiki.hylormc.tk reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:10:23] RECOVERY - thestarsareright.org - reverse DNS on sslhost is OK: SSL OK - thestarsareright.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:10:26] RECOVERY - hellointernet.miraheze.org - reverse DNS on sslhost is OK: SSL OK - hellointernet.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:10:27] RECOVERY - storytime.jdstroy.cf - reverse DNS on sslhost is OK: SSL OK - storytime.jdstroy.cf reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:10:36] RECOVERY - www.ballmedia.org - reverse DNS on sslhost is OK: SSL OK - www.ballmedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:10:40] RECOVERY - bebaskanpengetahuan.id - reverse DNS on sslhost is OK: SSL OK - bebaskanpengetahuan.id reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:10:40] RECOVERY - royal-wiki.org - reverse DNS on sslhost is OK: SSL OK - royal-wiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:10:47] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.00, 1.65, 1.98 [19:10:54] RECOVERY - savagepedia.wiki - reverse DNS on sslhost is OK: SSL OK - savagepedia.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:11:05] RECOVERY - wiki.controlistes.fr - reverse DNS on sslhost is OK: SSL OK - wiki.controlistes.fr reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:11:09] RECOVERY - wikimas.kr - reverse DNS on sslhost is OK: SSL OK - wikimas.kr reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:11:14] RECOVERY - wiki.funkey-project.com - reverse DNS on sslhost is OK: SSL OK - wiki.funkey-project.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:11:14] RECOVERY - tep.wiki - reverse DNS on sslhost is OK: SSL OK - tep.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:11:16] RECOVERY - nonbinary.wiki - reverse DNS on sslhost is OK: SSL OK - nonbinary.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:11:17] RECOVERY - knifepointhorror.wiki - reverse DNS on sslhost is OK: SSL OK - knifepointhorror.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:11:28] RECOVERY - piwik.miraheze.org - reverse DNS on sslhost is OK: SSL OK - piwik.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:11:38] RECOVERY - elsterclopedie.marithaime.nl - reverse DNS on sslhost is OK: SSL OK - elsterclopedie.marithaime.nl reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:11:43] RECOVERY - fc.songcontests.eu - reverse DNS on sslhost is OK: SSL OK - fc.songcontests.eu reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:11:44] RECOVERY - www.permanentfuturelab.wiki - reverse DNS on sslhost is OK: SSL OK - www.permanentfuturelab.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:11:45] RECOVERY - wiki.erisly.com - reverse DNS on sslhost is OK: SSL OK - wiki.erisly.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:11:47] RECOVERY - wiki.ultravanilla.world - reverse DNS on sslhost is OK: SSL OK - wiki.ultravanilla.world reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:11:55] RECOVERY - www.puzzles.wiki - reverse DNS on sslhost is OK: SSL OK - www.puzzles.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:11:56] RECOVERY - wiki.mastodon.kr - reverse DNS on sslhost is OK: SSL OK - wiki.mastodon.kr reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:12:00] RECOVERY - entw.ml - reverse DNS on sslhost is OK: SSL OK - entw.ml reverse DNS resolves to cp22.miraheze.org - CNAME FLAT [19:12:05] RECOVERY - wiki.jeremyboyd.org - reverse DNS on sslhost is OK: SSL OK - wiki.jeremyboyd.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:12:14] RECOVERY - de.gyaanipedia.com - reverse DNS on sslhost is OK: SSL OK - de.gyaanipedia.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:12:23] RECOVERY - avas.wiki - reverse DNS on sslhost is OK: SSL OK - avas.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:12:28] RECOVERY - removededm.ml - reverse DNS on sslhost is OK: SSL OK - removededm.ml reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:12:36] RECOVERY - studyabroad.wiki - reverse DNS on sslhost is OK: SSL OK - studyabroad.wiki reverse DNS resolves to cp22.miraheze.org - CNAME FLAT [19:12:48] RECOVERY - atnarsia.com - reverse DNS on sslhost is OK: SSL OK - atnarsia.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:12:52] RECOVERY - lg.gyaanipedia.com - reverse DNS on sslhost is OK: SSL OK - lg.gyaanipedia.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:12:53] RECOVERY - www.mwcosmos.com - reverse DNS on sslhost is OK: SSL OK - www.mwcosmos.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:12:53] RECOVERY - wiki.yahyabd.xyz - reverse DNS on sslhost is OK: SSL OK - wiki.yahyabd.xyz reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:06] RECOVERY - wiki.wisrail.de - reverse DNS on sslhost is OK: SSL OK - wiki.wisrail.de reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:13] RECOVERY - it.famepedia.org - reverse DNS on sslhost is OK: SSL OK - it.famepedia.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:13:15] RECOVERY - az.wikiretet.ga - reverse DNS on sslhost is OK: SSL OK - az.wikiretet.ga reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:16] RECOVERY - wiki.pixlies.net - reverse DNS on sslhost is OK: SSL OK - wiki.pixlies.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:16] RECOVERY - animatedfeet.miraheze.org - reverse DNS on sslhost is OK: SSL OK - animatedfeet.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:13:20] RECOVERY - polandballwiki.com - reverse DNS on sslhost is OK: SSL OK - polandballwiki.com reverse DNS resolves to cp22.miraheze.org - CNAME FLAT [19:13:21] RECOVERY - drowiki.com - reverse DNS on sslhost is OK: SSL OK - drowiki.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:13:31] RECOVERY - wiki.worldsofweary.com - reverse DNS on sslhost is OK: SSL OK - wiki.worldsofweary.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:32] RECOVERY - webkinzguide.com - reverse DNS on sslhost is OK: SSL OK - webkinzguide.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:13:36] RECOVERY - www.programming.red - reverse DNS on sslhost is OK: SSL OK - www.programming.red reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:13:39] RECOVERY - wiki.thunis.eu - reverse DNS on sslhost is OK: SSL OK - wiki.thunis.eu reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:45] RECOVERY - wiki.sanctuary-rts.com - reverse DNS on sslhost is OK: SSL OK - wiki.sanctuary-rts.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:48] RECOVERY - wiki.umbranet.mandelbrotgames.com - reverse DNS on sslhost is OK: SSL OK - wiki.umbranet.mandelbrotgames.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:49] RECOVERY - pubwiki.lab.co.pl - reverse DNS on sslhost is OK: SSL OK - pubwiki.lab.co.pl reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:49] RECOVERY - tot.wiki - reverse DNS on sslhost is OK: SSL OK - tot.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:13:53] RECOVERY - sega.miraheze.org - reverse DNS on sslhost is OK: SSL OK - sega.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:13:55] RECOVERY - wikimoma.art - reverse DNS on sslhost is OK: SSL OK - wikimoma.art reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:13:57] RECOVERY - gs.sidem.wiki - reverse DNS on sslhost is OK: SSL OK - gs.sidem.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:13:58] RECOVERY - www.wikiretet.ga - reverse DNS on sslhost is OK: SSL OK - www.wikiretet.ga reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:14:00] RECOVERY - www.obeymewiki.com - reverse DNS on sslhost is OK: SSL OK - www.obeymewiki.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:14:10] RECOVERY - baharna.org - reverse DNS on sslhost is OK: SSL OK - baharna.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:14:16] RECOVERY - txt-dex.com - reverse DNS on sslhost is OK: SSL OK - txt-dex.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:14:17] RECOVERY - wiki.bluevertigo.org - reverse DNS on sslhost is OK: SSL OK - wiki.bluevertigo.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:14:17] RECOVERY - allthetropes.miraheze.org - reverse DNS on sslhost is OK: SSL OK - allthetropes.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:14:23] RECOVERY - en.wikiyri.org - reverse DNS on sslhost is OK: SSL OK - en.wikiyri.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:14:24] RECOVERY - beaconspace.unrestrictedlorefare.com - reverse DNS on sslhost is OK: SSL OK - beaconspace.unrestrictedlorefare.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:14:36] RECOVERY - poserdazfreebies.orain.org - reverse DNS on sslhost is OK: SSL OK - poserdazfreebies.orain.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:14:37] RECOVERY - wiki.cyberfurs.org - reverse DNS on sslhost is OK: SSL OK - wiki.cyberfurs.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:14:45] RECOVERY - wiki.helsinginpoytaroolipelaajat.fi - reverse DNS on sslhost is OK: SSL OK - wiki.helsinginpoytaroolipelaajat.fi reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:14:48] RECOVERY - translate.petrawiki.org - reverse DNS on sslhost is OK: SSL OK - translate.petrawiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:14:50] RECOVERY - discordian.wiki - reverse DNS on sslhost is OK: SSL OK - discordian.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:14:53] RECOVERY - wiki.dwarvesrp.com - reverse DNS on sslhost is OK: SSL OK - wiki.dwarvesrp.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:14:57] RECOVERY - archive.a2b2.org - reverse DNS on sslhost is OK: SSL OK - archive.a2b2.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:14:57] RECOVERY - wiki.zymonic.com - reverse DNS on sslhost is OK: SSL OK - wiki.zymonic.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:15:04] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.28, 3.10, 3.36 [19:15:09] RECOVERY - portalsofphereon.com - reverse DNS on sslhost is OK: SSL OK - portalsofphereon.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:15:11] RECOVERY - slymods.info - reverse DNS on sslhost is OK: SSL OK - slymods.info reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:15:20] RECOVERY - www.allthetropes.org - reverse DNS on sslhost is OK: SSL OK - www.allthetropes.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:15:23] RECOVERY - wiki.recaptime.tk - reverse DNS on sslhost is OK: SSL OK - wiki.recaptime.tk reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:15:23] RECOVERY - apeirology.com - reverse DNS on sslhost is OK: SSL OK - apeirology.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:15:29] RECOVERY - chakra.moe - reverse DNS on sslhost is OK: SSL OK - chakra.moe reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:15:33] RECOVERY - www.scum-wiki.com - reverse DNS on sslhost is OK: SSL OK - www.scum-wiki.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:15:43] RECOVERY - hastursnotebook.org - reverse DNS on sslhost is OK: SSL OK - hastursnotebook.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:15:46] RECOVERY - eng.archiopedia.org - reverse DNS on sslhost is OK: SSL OK - eng.archiopedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:15:51] RECOVERY - www.sekaipedia.org - reverse DNS on sslhost is OK: SSL OK - www.sekaipedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:15:54] RECOVERY - wiki.s23.org - reverse DNS on sslhost is OK: SSL OK - wiki.s23.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:15:54] RECOVERY - test3.miraheze.org - reverse DNS on sslhost is OK: SSL OK - test3.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:15:55] RECOVERY - wiki.make717.org - reverse DNS on sslhost is OK: SSL OK - wiki.make717.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:15:55] RECOVERY - wiki.danvs.net - reverse DNS on sslhost is OK: SSL OK - wiki.danvs.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:15:57] RECOVERY - wiki.yumeka.icu - reverse DNS on sslhost is OK: SSL OK - wiki.yumeka.icu reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:15:59] RECOVERY - wiki.jkrstudios.org - reverse DNS on sslhost is OK: SSL OK - wiki.jkrstudios.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:16:06] RECOVERY - staratlaswiki.org - reverse DNS on sslhost is OK: SSL OK - staratlaswiki.org reverse DNS resolves to cp22.miraheze.org - CNAME FLAT [19:16:06] RECOVERY - microworldwiki.ga - reverse DNS on sslhost is OK: SSL OK - microworldwiki.ga reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:16:08] RECOVERY - wiki.hsins.eu - reverse DNS on sslhost is OK: SSL OK - wiki.hsins.eu reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:16:10] RECOVERY - wiki.seamly.net - reverse DNS on sslhost is OK: SSL OK - wiki.seamly.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:16:13] RECOVERY - cyberlaw.ccdcoe.org - reverse DNS on sslhost is OK: SSL OK - cyberlaw.ccdcoe.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:16:20] RECOVERY - mystiverse.wiki - reverse DNS on sslhost is OK: SSL OK - mystiverse.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:16:21] RECOVERY - ffwiki.org - reverse DNS on sslhost is OK: SSL OK - ffwiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:16:22] RECOVERY - www.ambientguitar.org - reverse DNS on sslhost is OK: SSL OK - www.ambientguitar.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:16:25] RECOVERY - erawikisource.miraheze.org - reverse DNS on sslhost is OK: SSL OK - erawikisource.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:16:26] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:16:29] RECOVERY - abeyancewiki.bumblebee-studios.se - reverse DNS on sslhost is OK: SSL OK - abeyancewiki.bumblebee-studios.se reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:16:33] RECOVERY - encyclopediarobotica.org - reverse DNS on sslhost is OK: SSL OK - encyclopediarobotica.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:16:40] RECOVERY - wikipariksha.com - reverse DNS on sslhost is OK: SSL OK - wikipariksha.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:16:46] RECOVERY - donkeykong.miraheze.org - reverse DNS on sslhost is OK: SSL OK - donkeykong.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:16:55] RECOVERY - wiki.rtapp.tk - reverse DNS on sslhost is OK: SSL OK - wiki.rtapp.tk reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:16:57] RECOVERY - wiki.minecraftathome.com - reverse DNS on sslhost is OK: SSL OK - wiki.minecraftathome.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:17:02] RECOVERY - biblestrength.net - reverse DNS on sslhost is OK: SSL OK - biblestrength.net reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:02] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.56, 1.95, 1.92 [19:17:09] RECOVERY - experimyco.com - reverse DNS on sslhost is OK: SSL OK - experimyco.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:12] RECOVERY - tr.wikiretet.ga - reverse DNS on sslhost is OK: SSL OK - tr.wikiretet.ga reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:17:13] RECOVERY - wiki.seredrau.xyz - reverse DNS on sslhost is OK: SSL OK - wiki.seredrau.xyz reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:17:13] RECOVERY - m33ks.ml - reverse DNS on sslhost is OK: SSL OK - m33ks.ml reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:15] RECOVERY - smashloop.wiki - reverse DNS on sslhost is OK: SSL OK - smashloop.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:15] RECOVERY - wiki.nowchess.org - reverse DNS on sslhost is OK: SSL OK - wiki.nowchess.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:17:21] RECOVERY - wiki.conworlds.org - reverse DNS on sslhost is OK: SSL OK - wiki.conworlds.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:17:22] RECOVERY - sparabel.wiki - reverse DNS on sslhost is OK: SSL OK - sparabel.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:26] RECOVERY - www.opendatascot.org - reverse DNS on sslhost is OK: SSL OK - www.opendatascot.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:28] RECOVERY - files.petrawiki.org - reverse DNS on sslhost is OK: SSL OK - files.petrawiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:31] RECOVERY - wiki.anglish.info - reverse DNS on sslhost is OK: SSL OK - wiki.anglish.info reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:17:40] RECOVERY - wiki.eversd.com - reverse DNS on sslhost is OK: SSL OK - wiki.eversd.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:17:43] RECOVERY - wiki.zergmafia.top - reverse DNS on sslhost is OK: SSL OK - wiki.zergmafia.top reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:17:45] RECOVERY - en.famepedia.org - reverse DNS on sslhost is OK: SSL OK - en.famepedia.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:45] RECOVERY - mazakwiki.org - reverse DNS on sslhost is OK: SSL OK - mazakwiki.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:46] RECOVERY - phgalaxy.eu.org - reverse DNS on sslhost is OK: SSL OK - phgalaxy.eu.org reverse DNS resolves to cp22.miraheze.org - CNAME FLAT [19:17:46] RECOVERY - www.zetapedia.com - reverse DNS on sslhost is OK: SSL OK - www.zetapedia.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:47] RECOVERY - johanloopmans.nl - reverse DNS on sslhost is OK: SSL OK - johanloopmans.nl reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:17:48] RECOVERY - celeste.ink - reverse DNS on sslhost is OK: SSL OK - celeste.ink reverse DNS resolves to cp22.miraheze.org - CNAME FLAT [19:17:55] RECOVERY - metroidpedia.com - reverse DNS on sslhost is OK: SSL OK - metroidpedia.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:18:25] RECOVERY - persist.wiki - reverse DNS on sslhost is OK: SSL OK - persist.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:18:26] RECOVERY - wikipedia.yogfront.ooo - reverse DNS on sslhost is OK: SSL OK - wikipedia.yogfront.ooo reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:18:31] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.12, 1.22, 1.63 [19:18:41] RECOVERY - datacrondatabase.com - reverse DNS on sslhost is OK: SSL OK - datacrondatabase.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:18:56] PROBLEM - slupe.fp64.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'slupe.fp64.org' expires in 15 day(s) (Tue 04 Oct 2022 18:47:51 GMT +0000). [19:19:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.30, 1.73, 1.85 [19:21:02] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 1.81, 1.85 [19:21:52] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:22:55] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:23:12] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:23:27] RECOVERY - landofliberos.com - reverse DNS on sslhost is OK: SSL OK - landofliberos.com reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:23:31] RECOVERY - betaheze.org - reverse DNS on sslhost is OK: SSL OK - betaheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:23:48] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 1.992 second response time [19:23:56] RECOVERY - wiki.slimeapedia.org - reverse DNS on sslhost is OK: SSL OK - wiki.slimeapedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:24:01] RECOVERY - dragonquest2.miraheze.org - reverse DNS on sslhost is OK: SSL OK - dragonquest2.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:24:05] RECOVERY - wiki.lu9.io - reverse DNS on sslhost is OK: SSL OK - wiki.lu9.io reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:24:06] RECOVERY - wiki.ravynos.com - reverse DNS on sslhost is OK: SSL OK - wiki.ravynos.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:24:06] RECOVERY - wiki.qadrishattari.xyz - reverse DNS on sslhost is OK: SSL OK - wiki.qadrishattari.xyz reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:24:07] RECOVERY - wikiyri.org - reverse DNS on sslhost is OK: SSL OK - wikiyri.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:24:16] RECOVERY - wiki.evscope.org - reverse DNS on sslhost is OK: SSL OK - wiki.evscope.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:24:17] RECOVERY - pwiki.arkcls.com - reverse DNS on sslhost is OK: SSL OK - pwiki.arkcls.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:24:18] RECOVERY - croc.miraheze.org - reverse DNS on sslhost is OK: SSL OK - croc.miraheze.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:24:19] RECOVERY - rct.wiki - reverse DNS on sslhost is OK: SSL OK - rct.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:24:40] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6f463aca3f53...d675e1ceeb3b [19:24:41] [url] Comparing 6f463aca3f53...d675e1ceeb3b · miraheze/ssl · GitHub | github.com [19:24:42] [02miraheze/ssl] 07MirahezeSSLBot 03d675e1c - Bot: Update SSL cert for slupe.fp64.org [19:24:42] RECOVERY - data.famepedia.org - reverse DNS on sslhost is OK: SSL OK - data.famepedia.org reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:24:43] RECOVERY - adadevelopersacademy.wiki - reverse DNS on sslhost is OK: SSL OK - adadevelopersacademy.wiki reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:24:45] RECOVERY - central.ballmedia.org - reverse DNS on sslhost is OK: SSL OK - central.ballmedia.org reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:24:51] RECOVERY - commonwealth.0um.io - reverse DNS on sslhost is OK: SSL OK - commonwealth.0um.io reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:24:51] RECOVERY - wiki.elgeis.com - reverse DNS on sslhost is OK: SSL OK - wiki.elgeis.com reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:24:58] RECOVERY - wiki.mcpirevival.tk - reverse DNS on sslhost is OK: SSL OK - wiki.mcpirevival.tk reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:25:00] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 6.936 second response time [19:25:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.86, 1.80, 1.83 [19:25:04] RECOVERY - you.r-fit.cc - reverse DNS on sslhost is OK: SSL OK - you.r-fit.cc reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:25:15] RECOVERY - archive.stellurgists.wiki - reverse DNS on sslhost is OK: SSL OK - archive.stellurgists.wiki reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:25:16] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 4.030 second response time [19:25:33] RECOVERY - creativecommons.id - reverse DNS on sslhost is OK: SSL OK - creativecommons.id reverse DNS resolves to cp22.miraheze.org - NS RECORDS OK [19:25:45] PROBLEM - drowiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'drowiki.com' expires in 15 day(s) (Tue 04 Oct 2022 18:56:56 GMT +0000). [19:26:47] PROBLEM - dkpedia.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dkpedia.com' expires in 15 day(s) (Tue 04 Oct 2022 18:55:51 GMT +0000). [19:27:55] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.33, 1.81, 1.59 [19:29:01] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d675e1ceeb3b...768876de5d8e [19:29:02] [url] Comparing d675e1ceeb3b...768876de5d8e · miraheze/ssl · GitHub | github.com [19:29:03] [02miraheze/ssl] 07MirahezeSSLBot 03768876d - Bot: Update SSL cert for drowiki.com [19:29:54] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.02, 1.51, 1.50 [19:31:02] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.13, 1.43, 1.66 [19:32:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/768876de5d8e...05ace655a80f [19:32:43] [url] Comparing 768876de5d8e...05ace655a80f · miraheze/ssl · GitHub | github.com [19:32:44] [02miraheze/ssl] 07MirahezeSSLBot 0305ace65 - Bot: Update SSL cert for dkpedia.com [19:33:34] PROBLEM - cp22 Stunnel HTTP for mw122 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:33:43] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:33:43] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:33:56] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:37:53] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 7.020 second response time [19:37:57] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 6.169 second response time [19:38:00] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 5.232 second response time [19:39:42] RECOVERY - cp22 Stunnel HTTP for mw122 on cp22 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.109 second response time [19:48:50] RECOVERY - slupe.fp64.org - LetsEncrypt on sslhost is OK: OK - Certificate 'slupe.fp64.org' will expire on Sat 17 Dec 2022 18:24:33 GMT +0000. [19:52:44] [02puppet] 07Universal-Omega closed pull request 03#2677: Add LucidChart to the CSP - 13https://github.com/miraheze/puppet/pull/2677 [19:52:45] [url] Page not found · GitHub · GitHub | github.com [19:54:07] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1452346444 secs [19:54:20] RECOVERY - drowiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'drowiki.com' will expire on Sat 17 Dec 2022 18:28:55 GMT +0000. [19:56:37] RECOVERY - dkpedia.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dkpedia.com' will expire on Sat 17 Dec 2022 18:32:37 GMT +0000. [20:12:07] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07748675346 secs [20:22:28] PROBLEM - cp30 APT on cp30 is CRITICAL: CRITICAL - Plugin timed out after 10 seconds [20:23:06] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.08, 3.40, 2.16 [20:24:30] RECOVERY - cp30 APT on cp30 is OK: APT OK: 38 packages available for upgrade (0 critical updates). [20:31:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.38, 1.89, 1.97 [20:33:02] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.72, 2.07, 2.01 [20:35:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.23, 1.76, 1.91 [20:39:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.70, 3.23 [20:41:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.68, 3.92, 3.36 [20:41:30] [02mediawiki] 07Universal-Omega closed pull request 03#9336: Update PageProperties to 1.1.0 - 13https://github.com/miraheze/mediawiki/pull/9336 [20:41:31] [url] Page not found · GitHub · GitHub | github.com [20:41:32] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03update-PageProperties [20:41:33] [02mediawiki] 07Universal-Omega deleted branch 03update-PageProperties - 13https://github.com/miraheze/mediawiki [20:41:34] [url] Page not found · GitHub · GitHub | github.com [20:41:35] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±3] 13https://github.com/miraheze/mediawiki/compare/2795d4b3ad78...09830be9409d [20:41:36] [url] Comparing 2795d4b3ad78...09830be9409d · miraheze/mediawiki · GitHub | github.com [20:41:36] [02miraheze/mediawiki] 07paladox 0309830be - Update PageProperties to 1.1.0 (#9336) [20:42:59] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.70, 3.39, 3.23 [20:43:02] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.32, 1.62 [21:09:52] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/33d69695dfb7 [21:09:54] [02miraheze/dns] 07paladox 0333d6969 - Add cp23 to dns [21:09:55] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [21:09:56] [url] Page not found · GitHub · GitHub | github.com [21:09:57] [02dns] 07paladox opened pull request 03#352: Add cp23 to dns - 13https://github.com/miraheze/dns/pull/352 [21:09:57] [url] Page not found · GitHub · GitHub | github.com [21:10:02] [02dns] 07paladox closed pull request 03#352: Add cp23 to dns - 13https://github.com/miraheze/dns/pull/352 [21:10:03] ... [21:10:03] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [21:10:05] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/36c8aeb49577...1413be3026ab [21:10:05] [url] Comparing 36c8aeb49577...1413be3026ab · miraheze/dns · GitHub | github.com [21:10:06] [02miraheze/dns] 07paladox 031413be3 - Add cp23 to dns (#352) [21:10:08] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [21:10:09] ... [21:21:40] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/2d72d745a7d7 [21:21:40] [url] Page not found · GitHub · GitHub | github.com [21:21:41] [02miraheze/puppet] 07paladox 032d72d74 - Install cp23 [21:21:43] [02puppet] 07paladox created branch 03paladox-patch-2 - 13https://github.com/miraheze/puppet [21:21:43] [url] Page not found · GitHub · GitHub | github.com [21:21:44] [02puppet] 07paladox opened pull request 03#2849: Install cp23 - 13https://github.com/miraheze/puppet/pull/2849 [21:21:45] [url] Page not found · GitHub · GitHub | github.com [21:22:03] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 4.85, 5.23, 5.90 [21:22:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-2 [+1/-0/±0] 13https://github.com/miraheze/puppet/compare/2d72d745a7d7...b8040a4c6074 [21:22:13] [url] Comparing 2d72d745a7d7...b8040a4c6074 · miraheze/puppet · GitHub | github.com [21:22:14] [02miraheze/puppet] 07paladox 03b8040a4 - Create cp23.yaml [21:22:15] [02puppet] 07paladox synchronize pull request 03#2849: Install cp23 - 13https://github.com/miraheze/puppet/pull/2849 [21:22:16] [url] Page not found · GitHub · GitHub | github.com [21:22:24] [02puppet] 07paladox closed pull request 03#2849: Install cp23 - 13https://github.com/miraheze/puppet/pull/2849 [21:22:25] [url] Page not found · GitHub · GitHub | github.com [21:22:26] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-2 [21:22:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/puppet/compare/d6a4465ab816...ce19dc2628bc [21:22:28] [url] Comparing d6a4465ab816...ce19dc2628bc · miraheze/puppet · GitHub | github.com [21:22:29] [02miraheze/puppet] 07paladox 03ce19dc2 - Install cp23 (#2849) [21:22:30] [02puppet] 07paladox deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/puppet [21:22:31] ... [21:23:02] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.02, 2.26, 1.79 [21:24:03] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.71, 5.88, 6.04 [21:25:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.89, 1.72 [21:27:02] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.19, 1.64, 1.64 [21:33:57] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/555086336709 [21:33:59] [02miraheze/dns] 07paladox 035550863 - Pool cp23 into gb [21:34:00] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [21:34:01] [url] Page not found · GitHub · GitHub | github.com [21:34:02] [02dns] 07paladox opened pull request 03#353: Pool cp23 into gb - 13https://github.com/miraheze/dns/pull/353 [21:34:03] ... [21:34:12] [02dns] 07paladox closed pull request 03#353: Pool cp23 into gb - 13https://github.com/miraheze/dns/pull/353 [21:34:12] [url] Page not found · GitHub · GitHub | github.com [21:34:13] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [21:34:15] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/1413be3026ab...6d40ab00def6 [21:34:15] [url] Comparing 1413be3026ab...6d40ab00def6 · miraheze/dns · GitHub | github.com [21:34:16] [02miraheze/dns] 07paladox 036d40ab0 - Pool cp23 into gb (#353) [21:34:18] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [21:34:18] [url] Page not found · GitHub · GitHub | github.com [21:34:35] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.02, 4.07, 5.39 [21:34:39] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 7 backends are down. mw121 mw122 mw131 mw132 mw141 mw142 mediawiki [21:34:41] PROBLEM - cp23 HTTP 4xx/5xx ERROR Rate on cp23 is CRITICAL: CRITICAL - NGINX Error Rate is 63% [21:35:09] PROBLEM - cp23 Stunnel HTTP for puppet141 on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:35:10] PROBLEM - cp23 HTTPS on cp23 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 6071 bytes in 0.065 second response time [21:35:37] PROBLEM - cp23 Stunnel HTTP for phab121 on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:35:42] PROBLEM - cp23 Stunnel HTTP for mail121 on cp23 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:36:36] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [21:36:39] RECOVERY - cp23 HTTP 4xx/5xx ERROR Rate on cp23 is OK: OK - NGINX Error Rate is 11% [21:37:34] RECOVERY - cp23 Stunnel HTTP for phab121 on cp23 is OK: HTTP OK: Status line output matched "500" - 2855 bytes in 0.074 second response time [21:37:47] RECOVERY - cp23 HTTPS on cp23 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3341 bytes in 0.933 second response time [21:38:28] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.95, 6.26, 5.91 [21:38:44] !log added 1g of swap to cp22/23 [21:38:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:40:47] RECOVERY - cp23 Stunnel HTTP for puppet141 on cp23 is OK: HTTP OK: Status line output matched "403" - 289 bytes in 0.025 second response time [21:42:45] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.46, 4.35, 3.27 [21:43:12] RECOVERY - cp23 Stunnel HTTP for mail121 on cp23 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 427 bytes in 0.025 second response time [21:46:38] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.54, 3.96, 3.36 [21:47:55] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:49:53] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 3.851 second response time [21:50:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.48, 3.31, 3.24 [21:51:43] !log [universalomega@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [21:51:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:52:05] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 5.18, 2.93, 2.06 [21:53:36] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/22f9a663337b...7b93a0dbed9f [21:53:36] [url] Comparing 22f9a663337b...7b93a0dbed9f · miraheze/mw-config · GitHub | github.com [21:53:37] [02miraheze/mw-config] 07paladox 037b93a0d - Add cp23 to wgCdnServers [21:53:50] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [21:53:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:53:59] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s [21:54:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:54:05] !log [paladox@mwtask141] starting deploy of {'config': True} to all [21:54:13] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [21:54:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:54:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:54:35] miraheze/mw-config - paladox the build passed. [21:57:30] !log remove the 1g of swap from cp22/23 (it already had 1g available) [21:57:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:36] !log [@test131] starting deploy of {'config': True} to all [21:57:37] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [21:57:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:02:09] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.50, 3.48, 3.31 [22:04:17] PROBLEM - cp23 Stunnel HTTP for mw122 on cp23 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 201 bytes in 0.048 second response time [22:04:55] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:05:07] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:20] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:06:28] PROBLEM - cp22 Stunnel HTTP for mw121 on cp22 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [22:07:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.15, 2.75, 3.11 [22:08:50] !log [universalomega@mwtask141] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 1026s [22:09:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:09:05] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 6.957 second response time [22:09:15] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 29512 bytes in 3.721 second response time [22:09:41] [02mw-config] 07Universal-Omega closed pull request 03#4904: Support PageProperties 1.1.0 - 13https://github.com/miraheze/mw-config/pull/4904 [22:09:42] [url] Page not found · GitHub · GitHub | github.com [22:09:43] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7b93a0dbed9f...7f950aaa9488 [22:09:43] [url] Comparing 7b93a0dbed9f...7f950aaa9488 · miraheze/mw-config · GitHub | github.com [22:09:44] [02miraheze/mw-config] 07paladox 037f950aa - Support PageProperties 1.1.0 (#4904) [22:09:46] [02miraheze/mw-config] 07Universal-Omega deleted branch 03paladox-patch-1 [22:09:47] [02mw-config] 07Universal-Omega deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [22:09:48] [url] Page not found · GitHub · GitHub | github.com [22:10:04] !log [@mwtask141] starting deploy of {'config': True} to all [22:10:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:10:14] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 9s [22:10:18] [02puppet] 07Universal-Omega closed pull request 03#2846: Support PageProperties 1.1.0 - 13https://github.com/miraheze/puppet/pull/2846 [22:10:19] [url] Page not found · GitHub · GitHub | github.com [22:10:19] [02miraheze/puppet] 07Universal-Omega deleted branch 03paladox-patch-1 [22:10:21] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/ce19dc2628bc...44a2ce5ad8e9 [22:10:22] [url] Comparing ce19dc2628bc...44a2ce5ad8e9 · miraheze/puppet · GitHub | github.com [22:10:22] [02miraheze/puppet] 07paladox 0344a2ce5 - Support PageProperties 1.1.0 (#2846) [22:10:24] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.940 second response time [22:10:24] [02puppet] 07Universal-Omega deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/puppet [22:10:25] [url] Page not found · GitHub · GitHub | github.com [22:10:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:10:34] RECOVERY - cp23 Stunnel HTTP for mw122 on cp23 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.190 second response time [22:10:37] RECOVERY - cp22 Stunnel HTTP for mw121 on cp22 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 3.042 second response time [22:10:47] miraheze/mw-config - Universal-Omega the build passed. [22:27:06] !log [@test131] starting deploy of {'config': True} to all [22:27:07] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [22:27:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:27:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:56] PROBLEM - cp30 Disk Space on cp30 is WARNING: DISK WARNING - free space: / 4226 MB (10% inode=96%); [22:36:38] PROBLEM - cp31 Disk Space on cp31 is WARNING: DISK WARNING - free space: / 4225 MB (10% inode=96%); [22:40:52] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.83, 1.56, 1.94 [22:48:39] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.89, 1.79, 1.84 [22:56:48] PROBLEM - antiguabarbudacalypso.com - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.407127141952515 seconds [23:14:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.29, 1.65, 1.93 [23:20:21] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.65, 1.86, 1.89 [23:24:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.13, 1.67, 1.82 [23:30:22] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.96, 1.36, 1.65 [23:30:53] PROBLEM - mon141 NTP time on mon141 is CRITICAL: NTP CRITICAL: Offset 0.6963602901 secs [23:48:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.61, 2.23, 1.77 [23:48:39] PROBLEM - db131 NTP time on db131 is CRITICAL: NTP CRITICAL: Offset 0.692286551 secs [23:53:00] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.83, 1.64, 1.40 [23:54:55] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.56, 1.48, 1.37 [23:56:01] RECOVERY - antiguabarbudacalypso.com - reverse DNS on sslhost is OK: SSL OK - antiguabarbudacalypso.com reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK