[00:00:54] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.63, 1.89, 1.86 [00:01:34] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:01:41] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:01:44] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:02:33] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:02:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.31, 2.15, 1.96 [00:03:10] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.68, 1.80, 1.79 [00:03:19] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:41] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.019 second response time [00:03:45] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 28487 bytes in 0.785 second response time [00:04:07] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:04:16] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:04:46] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.14, 1.80, 1.86 [00:06:18] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:06:24] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:06:29] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:08:14] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.956 second response time [00:08:28] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.536 second response time [00:09:19] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.22, 1.55, 1.67 [00:09:37] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.24, 8.82, 10.00 [00:12:31] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:12:51] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:14:29] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.43, 1.53, 1.67 [00:15:44] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.851 second response time [00:15:51] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.687 second response time [00:16:11] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28487 bytes in 8.718 second response time [00:16:31] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.032 second response time [00:16:35] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.920 second response time [00:16:41] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.658 second response time [00:16:45] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.751 second response time [00:17:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [00:18:28] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.49, 10.09, 10.08 [00:20:08] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:20:13] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:20:43] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.818 second response time [00:21:08] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.744 second response time [00:21:39] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28488 bytes in 1.221 second response time [00:22:06] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.922 second response time [00:22:18] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.833 second response time [00:26:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.99, 10.61, 9.95 [00:26:07] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.40, 11.14, 10.54 [00:27:17] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.59, 9.35, 8.71 [00:28:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.04, 10.37, 10.34 [00:31:51] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.51, 11.52, 10.79 [00:32:48] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.55, 9.55, 10.12 [00:33:06] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.40, 1.63, 1.92 [00:35:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.27, 10.13, 9.42 [00:36:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.00, 10.06, 10.21 [00:37:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.86, 11.08, 10.97 [00:39:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.69, 11.25, 10.60 [00:39:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.19, 11.24, 11.02 [00:39:43] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:40:01] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:40:47] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:40:48] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.82, 11.25, 10.60 [00:40:51] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:40:55] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:41:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.91, 10.24, 10.30 [00:42:50] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.571 second response time [00:42:55] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.062 second response time [00:43:01] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28488 bytes in 8.073 second response time [00:43:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.83, 11.30, 11.11 [00:43:48] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.858 second response time [00:44:10] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 4.061 second response time [00:44:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.14, 10.96, 10.67 [00:45:06] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.12, 1.86, 1.85 [00:45:53] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/IncidentReporting/compare/a6680c0d9c76...5eebe1ad5fd9 [00:45:54] [url] Comparing a6680c0d9c76...5eebe1ad5fd9 · miraheze/IncidentReporting · GitHub | github.com [00:45:55] [02miraheze/IncidentReporting] 07dependabot[bot] 035eebe1a - Bump grunt-banana-checker from 0.9.0 to 0.10.0 (#45) [00:45:56] [02IncidentReporting] 07Universal-Omega closed pull request 03#45: Bump grunt-banana-checker from 0.9.0 to 0.10.0 - 13https://github.com/miraheze/IncidentReporting/pull/45 [00:45:57] [url] Page not found · GitHub · GitHub | github.com [00:45:58] [02miraheze/IncidentReporting] 07Universal-Omega deleted branch 03dependabot/npm_and_yarn/grunt-banana-checker-0.10.0 [00:45:59] [02IncidentReporting] 07Universal-Omega deleted branch 03dependabot/npm_and_yarn/grunt-banana-checker-0.10.0 - 13https://github.com/miraheze/IncidentReporting [00:46:00] [url] Page not found · GitHub · GitHub | github.com [00:46:09] [02CreateWiki] 07Universal-Omega closed pull request 03#327: Bump grunt-banana-checker from 0.9.0 to 0.10.0 - 13https://github.com/miraheze/CreateWiki/pull/327 [00:46:10] ... [00:46:11] [02miraheze/CreateWiki] 07Universal-Omega deleted branch 03dependabot/npm_and_yarn/grunt-banana-checker-0.10.0 [00:46:12] [02CreateWiki] 07Universal-Omega deleted branch 03dependabot/npm_and_yarn/grunt-banana-checker-0.10.0 - 13https://github.com/miraheze/CreateWiki [00:46:13] [url] Page not found · GitHub · GitHub | github.com [00:46:14] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/7fe5ac9fcd49...33899c0228fd [00:46:14] [url] Comparing 7fe5ac9fcd49...33899c0228fd · miraheze/CreateWiki · GitHub | github.com [00:46:15] [02miraheze/CreateWiki] 07dependabot[bot] 0333899c0 - Bump grunt-banana-checker from 0.9.0 to 0.10.0 (#327) [00:46:32] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:47:21] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:47:25] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:47:28] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:47:32] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:48:03] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:48:08] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:49:14] miraheze/IncidentReporting - Universal-Omega the build passed. [00:49:24] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 2.870 second response time [00:49:30] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.067 second response time [00:49:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.23, 11.95, 11.41 [00:49:46] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 1.73, 1.53 [00:50:38] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.85, 1.58, 1.40 [00:50:48] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.77, 11.82, 11.03 [00:50:53] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.49, 11.11, 10.63 [00:52:34] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.01, 1.41, 1.36 [00:52:46] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 7.401 second response time [00:52:48] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.48, 10.68, 10.55 [00:53:31] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 1.875 second response time [00:53:49] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.055 second response time [00:54:07] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 0.851 second response time [00:54:13] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 3.407 second response time [00:55:58] miraheze/CreateWiki - Universal-Omega the build passed. [00:56:37] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.81, 11.48, 10.83 [00:58:32] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.46, 11.18, 10.79 [01:00:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.74, 9.89, 8.85 [01:01:18] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.12, 1.73, 1.78 [01:02:19] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.61, 9.52, 8.85 [01:06:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.39, 12.00, 11.87 [01:07:19] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.21, 1.48, 1.66 [01:08:48] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.32, 12.36, 12.03 [01:11:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.29, 1.94, 1.80 [01:12:13] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:13:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.45, 10.15, 9.51 [01:13:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.83, 1.85, 1.78 [01:14:07] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:14:08] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:14:13] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:14:38] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:15:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.79, 9.94, 9.52 [01:16:16] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 9.601 second response time [01:16:21] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 9.119 second response time [01:16:41] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 4.826 second response time [01:17:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.38, 2.03, 1.86 [01:18:05] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.314 second response time [01:18:09] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.024 second response time [01:18:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.16, 9.64, 10.15 [01:19:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.81, 1.95, 1.86 [01:22:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.38, 11.47, 10.72 [01:23:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.26, 2.17, 1.97 [01:23:40] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [01:24:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.35, 11.23, 10.72 [01:26:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.47, 11.53, 10.88 [01:28:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.45, 11.01, 10.77 [01:30:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.16, 11.41, 11.94 [01:32:48] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.31, 11.93, 12.05 [01:33:50] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:34:24] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:34:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.59, 11.26, 10.78 [01:34:56] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.54, 10.46, 9.65 [01:35:45] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 1.070 second response time [01:36:24] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 4.483 second response time [01:38:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.50, 11.72, 11.11 [01:40:53] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.09, 10.04, 9.77 [01:41:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.61, 1.58, 1.92 [01:42:14] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:42:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.05, 11.67, 11.18 [01:44:16] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 7.451 second response time [01:44:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.45, 11.33, 11.11 [01:46:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.46, 10.39, 9.97 [01:48:49] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.59, 9.76, 9.80 [01:51:15] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:51:40] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [01:52:31] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:52:49] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:53:02] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:53:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.33, 1.78, 1.79 [01:54:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.33, 11.59, 11.17 [01:54:38] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 8.050 second response time [01:54:51] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.222 second response time [01:55:06] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.215 second response time [01:55:25] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 8.130 second response time [01:57:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.63, 1.72, 1.76 [01:58:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.59, 10.76, 10.16 [01:59:17] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:59:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.68, 1.98, 1.85 [02:01:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.97, 1.60, 1.72 [02:01:55] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:04:18] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:04:38] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:04:40] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.71, 10.14, 10.07 [02:05:05] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:05:05] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:05:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.04, 1.73, 1.75 [02:05:31] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 6.212 second response time [02:06:00] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28480 bytes in 6.782 second response time [02:06:22] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 5.524 second response time [02:06:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.44, 11.15, 11.41 [02:06:42] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 6.176 second response time [02:07:06] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 5.059 second response time [02:07:10] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 5.942 second response time [02:09:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.76, 1.87, 1.81 [02:11:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.26, 2.00, 1.86 [02:13:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.02, 1.62, 1.74 [02:14:34] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.15, 10.23, 9.96 [02:15:19] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.99, 1.38, 1.63 [02:16:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.97, 9.91, 9.86 [02:16:55] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:18:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.06, 11.13, 11.07 [02:20:58] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 5.152 second response time [02:23:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.42, 1.84, 1.72 [02:23:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.08, 3.49, 3.94 [02:26:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.83, 10.95, 11.15 [02:28:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.51, 11.98, 11.48 [02:30:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.07, 10.69, 11.07 [02:31:02] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:31:02] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:31:04] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:31:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 14.41, 11.90, 9.83 [02:31:19] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.88, 1.58, 1.69 [02:32:58] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 0.020 second response time [02:33:00] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.020 second response time [02:33:02] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.14, 10.94, 9.74 [02:33:04] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 0.324 second response time [02:34:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.45, 10.86, 10.16 [02:34:58] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.94, 9.40, 9.31 [02:35:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.04, 3.72, 3.66 [02:36:23] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.51, 10.07, 9.94 [02:36:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.87, 11.27, 11.12 [02:37:06] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.83, 2.00 [02:37:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.17, 3.50, 3.59 [02:38:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.02, 11.05, 11.06 [02:40:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.01, 10.87, 10.32 [02:41:06] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.22, 1.92, 1.99 [02:41:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.82, 9.73, 8.85 [02:41:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.15, 3.99, 3.74 [02:41:41] PROBLEM - mw102 MediaWiki Rendering on mw102 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:41:53] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:41:56] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:42:38] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:42:58] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:43:27] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.49, 9.49, 8.86 [02:44:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.67, 10.20, 10.16 [02:48:09] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.713 second response time [02:48:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.54, 10.30, 10.52 [02:48:47] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 8.040 second response time [02:48:59] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.711 second response time [02:49:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.59, 3.73, 3.78 [02:50:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.16, 9.61, 10.23 [02:50:28] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 7.439 second response time [02:51:54] RECOVERY - mw102 MediaWiki Rendering on mw102 is OK: HTTP OK: HTTP/1.1 200 OK - 28479 bytes in 1.405 second response time [02:52:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.30, 9.31, 10.04 [02:53:33] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.81, 1.60, 1.54 [02:53:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 3.60, 3.68 [02:55:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.72, 1.25, 1.42 [02:55:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.45, 3.08, 3.47 [02:57:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.28, 3.48 [02:59:18] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.50, 1.77, 1.58 [03:00:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.16, 3.56, 3.95 [03:03:10] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.55, 10.63, 10.31 [03:03:19] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.15, 1.70, 1.62 [03:03:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.45, 3.20, 3.42 [03:05:05] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.46, 11.61, 10.70 [03:05:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.97, 3.20, 3.40 [03:06:59] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.67, 10.98, 10.59 [03:07:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.33, 10.85, 11.75 [03:09:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.65, 3.41, 3.46 [03:11:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.14, 3.25, 3.39 [03:13:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.81, 11.43, 11.70 [03:13:56] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.99, 2.15, 1.81 [03:15:50] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.00, 1.77, 1.71 [03:16:33] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.33, 9.60, 10.08 [03:17:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.68, 11.78, 11.85 [03:17:45] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.98, 1.54, 1.63 [03:18:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.27, 2.86, 3.31 [03:22:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.72, 4.04, 3.70 [03:23:11] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:23:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.77, 3.51 [03:23:43] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:24:25] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:24:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.19, 10.63, 10.26 [03:24:34] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:24:41] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:25:13] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 15952 bytes in 8.229 second response time [03:25:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.59, 1.96, 1.80 [03:25:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.32, 3.61, 3.48 [03:25:48] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 9.350 second response time [03:26:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.98, 10.42, 10.24 [03:26:41] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 15946 bytes in 9.077 second response time [03:26:44] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 15938 bytes in 7.940 second response time [03:27:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.03, 1.80, 1.75 [03:27:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.87, 12.28, 11.96 [03:28:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.23, 3.79, 3.71 [03:28:34] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 28480 bytes in 3.222 second response time [03:29:19] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.59, 1.83, 1.77 [03:30:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.60, 11.33, 10.63 [03:33:18] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.83, 1.43, 1.63 [03:33:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.47, 3.10, 3.31 [03:34:18] PROBLEM - wiki.autocountsoft.com - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406466245651245 seconds [03:34:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.82, 11.36, 10.80 [03:36:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.44, 2.90, 3.33 [03:36:51] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.84, 10.47, 9.66 [03:42:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.00, 3.41, 3.42 [03:44:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.22, 3.29, 3.37 [03:44:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.35, 11.54, 11.11 [03:44:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.55, 10.95, 10.14 [03:46:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.59, 11.44, 11.12 [03:46:46] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.05, 10.21, 9.97 [03:48:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.51, 3.53, 3.46 [03:48:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.54, 11.83, 11.30 [03:48:45] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.78, 9.89, 9.90 [03:50:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.18, 11.47, 11.23 [03:52:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.27, 11.83, 11.39 [03:54:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.66, 11.26, 11.23 [03:56:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.38, 3.75, 3.54 [03:56:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.80, 11.65, 11.36 [03:58:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.19, 11.64, 11.41 [04:02:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.84, 3.56, 3.56 [04:03:20] RECOVERY - wiki.autocountsoft.com - reverse DNS on sslhost is OK: SSL OK - wiki.autocountsoft.com reverse DNS resolves to cp21.miraheze.org - CNAME OK [04:03:36] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.05, 10.24, 9.75 [04:05:06] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.42, 1.63, 1.99 [04:05:35] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.61, 9.98, 9.69 [04:06:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.94, 3.95, 3.70 [04:06:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.62, 11.82, 11.39 [04:08:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.75, 2.10, 1.59 [04:08:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.52, 11.58, 11.35 [04:09:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.60, 3.31 [04:09:06] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.08, 1.77, 1.95 [04:09:33] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.79, 9.18, 9.46 [04:10:13] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.05, 1.63, 1.48 [04:11:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.33, 3.38, 3.29 [04:12:02] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.miraheze.org/d/GtxbP1Xnk [04:12:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.97, 3.62, 3.68 [04:13:06] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.64, 1.78, 1.92 [04:14:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.39, 4.01, 3.82 [04:15:06] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.17, 1.90, 1.94 [04:16:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.28, 3.40, 3.62 [04:23:59] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.16, 2.32, 1.84 [04:24:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.45, 3.85, 3.66 [04:25:56] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.05, 1.91, 1.74 [04:26:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.18, 3.23, 3.46 [04:28:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.76, 4.30, 3.83 [04:29:49] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.81, 1.54, 1.65 [04:30:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.58, 3.86, 3.71 [04:32:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.64, 9.33, 10.09 [04:35:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.47, 10.53, 9.89 [04:35:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.44, 3.49, 3.35 [04:36:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.19, 10.42, 10.39 [04:37:18] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 10.94, 10.11 [04:37:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.72, 3.07, 3.20 [04:38:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.71, 9.71, 10.13 [04:39:17] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.09, 10.70, 10.11 [04:39:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.46, 10.87, 11.82 [04:42:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.66, 3.05, 3.36 [04:45:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.65, 10.16, 10.10 [04:45:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.14, 11.13, 11.56 [04:47:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.85, 11.12, 11.52 [04:47:39] PROBLEM - wiki-tintin.cf - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki-tintin.cf' expires in 15 day(s) (Thu 28 Jul 2022 04:44:33 GMT +0000). [04:49:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.96, 11.75, 11.69 [04:50:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.95, 3.79, 3.49 [04:50:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.04, 10.97, 10.36 [04:51:11] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.25, 1.84, 1.56 [04:52:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.02, 3.37, 3.36 [04:52:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.47, 10.78, 10.36 [04:53:08] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.95, 1.55, 1.49 [04:53:34] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.61, 3.83, 3.33 [04:53:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.75, 11.51, 11.64 [04:53:41] PROBLEM - persist.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'persist.wiki' expires in 15 day(s) (Thu 28 Jul 2022 04:43:04 GMT +0000). [04:55:09] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/81d6b2cedfa5...097610a44cf0 [04:55:09] [url] Comparing 81d6b2cedfa5...097610a44cf0 · miraheze/ssl · GitHub | github.com [04:55:10] [02miraheze/ssl] 07MirahezeSSLBot 03097610a - Bot: Update SSL cert for wiki-tintin.cf [04:55:34] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.44, 3.36, 3.20 [04:55:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.98, 11.93, 11.77 [04:56:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.53, 3.44 [04:58:02] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.85, 1.77, 1.54 [04:58:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.14, 3.59, 3.46 [04:58:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.21, 10.03, 10.17 [04:59:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.27, 3.37, 3.23 [04:59:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.09, 1.49, 1.46 [05:00:09] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.66, 3.51 [05:02:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/097610a44cf0...4a8a621f665a [05:02:03] [url] Comparing 097610a44cf0...4a8a621f665a · miraheze/ssl · GitHub | github.com [05:02:04] [02miraheze/ssl] 07MirahezeSSLBot 034a8a621 - Bot: Update SSL cert for persist.wiki [05:02:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.02, 3.12, 3.33 [05:03:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.84, 11.94, 11.98 [05:04:33] PROBLEM - bn.wikiyri.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'bn.wikiyri.org' expires in 15 day(s) (Thu 28 Jul 2022 04:49:03 GMT +0000). [05:05:30] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/4a8a621f665a...99af647d8607 [05:05:30] [url] Comparing 4a8a621f665a...99af647d8607 · miraheze/ssl · GitHub | github.com [05:05:31] [02miraheze/ssl] 07MirahezeSSLBot 0399af647 - Bot: Update SSL cert for bn.wikiyri.org [05:06:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.29, 11.30, 11.98 [05:07:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.67, 10.51, 10.40 [05:08:02] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.miraheze.org/d/GtxbP1Xnk [05:08:48] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.23, 11.56, 11.99 [05:11:04] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.55, 9.79, 10.14 [05:13:17] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.55, 9.87, 9.68 [05:13:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.76, 12.35, 11.99 [05:14:55] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.03, 10.36, 10.29 [05:15:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.32, 9.26, 9.49 [05:17:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.97, 11.67, 11.81 [05:18:56] [02miraheze/RemovePII] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/grunt-banana-checker-0.10.0 [+0/-0/±2] 13https://github.com/miraheze/RemovePII/commit/1cc322ba6079 [05:18:58] [02miraheze/RemovePII] 07dependabot[bot] 031cc322b - Bump grunt-banana-checker from 0.9.0 to 0.10.0 [05:18:59] [02RemovePII] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/grunt-banana-checker-0.10.0 - 13https://github.com/miraheze/RemovePII [05:19:00] [url] Page not found · GitHub · GitHub | github.com [05:19:01] [02RemovePII] 07dependabot[bot] opened pull request 03#59: Bump grunt-banana-checker from 0.9.0 to 0.10.0 - 13https://github.com/miraheze/RemovePII/pull/59 [05:19:01] [url] Page not found · GitHub · GitHub | github.com [05:19:02] [02RemovePII] 07dependabot[bot] labeled pull request 03#59: Bump grunt-banana-checker from 0.9.0 to 0.10.0 - 13https://github.com/miraheze/RemovePII/pull/59 [05:19:02] [url] Page not found · GitHub · GitHub | github.com [05:19:04] [02RemovePII] 07dependabot[bot] labeled pull request 03#59: Bump grunt-banana-checker from 0.9.0 to 0.10.0 - 13https://github.com/miraheze/RemovePII/pull/59 [05:19:04] [url] Page not found · GitHub · GitHub | github.com [05:19:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.58, 11.99, 11.90 [05:21:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.07, 11.59, 11.76 [05:22:59] miraheze/RemovePII - dependabot[bot] the build passed. [05:24:28] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.40, 11.49, 10.77 [05:25:37] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.71, 11.73, 11.76 [05:26:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.79, 11.51, 12.00 [05:27:37] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.79, 11.55, 11.71 [05:28:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.70, 11.58, 11.02 [05:28:49]