[00:00:49] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.05, 1.57, 1.27 [00:02:49] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.38, 1.55, 1.30 [00:06:30] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.70, 10.68, 10.39 [00:14:23] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.84, 9.78, 10.09 [00:17:20] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/487e4b30c4ec...fdd83fce1f5e [00:17:22] [02miraheze/ImportDump] 07Universal-Omega 03fdd83fc - Update SpecialRequestImportDump.php [00:17:23] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:19:28] PROBLEM - es101 Current Load on es101 is WARNING: WARNING - load average: 3.44, 3.37, 2.66 [00:20:37] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.81, 10.07, 9.11 [00:20:45] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/fdd83fce1f5e...d6e24adbfdba [00:20:46] [02miraheze/ImportDump] 07Universal-Omega 03d6e24ad - Update SpecialRequestImportDump.php [00:20:48] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:21:14] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.51, 10.77, 10.41 [00:21:22] RECOVERY - es101 Current Load on es101 is OK: OK - load average: 3.05, 3.17, 2.66 [00:21:43] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.49, 2.23, 1.54 [00:22:05] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/d6e24adbfdba...a91acf07e552 [00:22:06] [02miraheze/ImportDump] 07Universal-Omega 03a91acf0 - Update SpecialRequestImportDump.php [00:22:08] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:22:34] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.12, 9.75, 9.11 [00:23:38] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.01, 1.68, 1.42 [00:25:29] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a91acf07e552...fd56b8bc72e3 [00:25:30] [02miraheze/ImportDump] 07Universal-Omega 03fd56b8b - Update SpecialRequestImportDump.php [00:25:32] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:27:04] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/fd56b8bc72e3...2c0e6d112324 [00:27:05] [02miraheze/ImportDump] 07Universal-Omega 032c0e6d1 - Update SpecialRequestImportDump.php [00:27:07] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:27:09] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.19, 11.16, 10.66 [00:29:03] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/2c0e6d112324...979bef8484fb [00:29:04] [02miraheze/ImportDump] 07Universal-Omega 03979bef8 - Update SpecialRequestImportDump.php [00:29:06] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:29:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.21, 11.26, 10.76 [00:32:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.74, 10.05, 9.29 [00:33:41] miraheze/ImportDump - Universal-Omega the build passed. [00:34:16] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.85, 9.97, 9.35 [00:34:23] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/979bef8484fb...dc59a64ccd8c [00:34:24] [02miraheze/ImportDump] 07Universal-Omega 03dc59a64 - Update SpecialRequestImportDump.php [00:34:26] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:35:31] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/dc59a64ccd8c...c7a3861a90dc [00:35:32] [02miraheze/ImportDump] 07Universal-Omega 03c7a3861 - Update SpecialRequestImportDump.php [00:35:34] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:36:49] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/c7a3861a90dc...d2b986aeefba [00:36:51] [02miraheze/ImportDump] 07Universal-Omega 03d2b986a - Update SpecialRequestImportDump.php [00:36:52] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [00:39:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.25, 9.49, 8.39 [00:41:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.95, 9.65, 8.59 [00:41:42] miraheze/ImportDump - Universal-Omega the build passed. [00:42:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.58, 3.29, 3.93 [00:42:56] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.67, 9.59, 10.20 [00:48:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.23, 4.33, 4.06 [00:50:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.06, 3.39, 3.74 [00:52:14] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.78, 10.79, 9.74 [00:52:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.85, 11.31, 10.50 [00:54:09] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.60, 9.34, 9.34 [00:54:44] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.86, 11.08, 10.52 [00:55:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:56:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.83, 3.71, 3.74 [00:58:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.70, 3.74 [01:01:47] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/d2b986aeefba...aece425db47e [01:01:48] [02miraheze/ImportDump] 07Universal-Omega 03aece425 - Remove UploadFromChunks usage [01:01:50] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:03:02] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/aece425db47e...6d21dddd8fda [01:03:03] [02miraheze/ImportDump] 07github-actions 036d21ddd - CI: lint code to MediaWiki standards [01:03:05] [02ImportDump] 07github-actions[bot] synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:04:35] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.52, 10.64, 10.45 [01:04:56] miraheze/ImportDump - Universal-Omega the build has errored. [01:06:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.17, 11.02, 10.63 [01:08:39] [02ImportDump] 07Universal-Omega edited pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:10:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.08, 3.13, 3.40 [01:12:28] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.43, 9.59, 10.13 [01:16:36] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:16:37] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/6d21dddd8fda...06157cc1fb5e [01:16:39] [02miraheze/ImportDump] 07Universal-Omega 0306157cc - Add getFile() [01:18:28] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/06157cc1fb5e...534043ad0739 [01:18:29] [02miraheze/ImportDump] 07Universal-Omega 03534043a - Add file to command [01:18:31] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:19:06] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/534043ad0739...a5c59e108d3b [01:19:08] [02miraheze/ImportDump] 07Universal-Omega 03a5c59e1 - Update extension.json [01:19:09] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:19:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.98, 3.83, 3.56 [01:20:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.61, 9.92, 9.96 [01:20:25] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/a5c59e108d3b...89f4aa174e4b [01:20:27] [02miraheze/ImportDump] 07Universal-Omega 0389f4aa1 - Update extension.json [01:20:28] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:20:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.20, 3.30, 3.95 [01:21:18] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.98, 1.60, 1.29 [01:21:27] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.90, 3.14, 3.34 [01:23:13] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.10, 1.43, 1.27 [01:23:36] [02miraheze/ImportDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/89f4aa174e4b...0fc5d2e48f01 [01:23:37] [02miraheze/ImportDump] 07Universal-Omega 030fc5d2e - Update SpecialRequestImportDump.php [01:23:39] [02ImportDump] 07Universal-Omega synchronize pull request 03#1: Create extension - 13https://github.com/miraheze/ImportDump/pull/1 [01:24:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:25:16] [02mw-config] 07Universal-Omega closed pull request 03#4628: T9125: set wgModerationEmail/wgModerationNotificationEnable to true for obeymewiki - 13https://github.com/miraheze/mw-config/pull/4628 [01:25:18] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/d67911e08b38...afdb960b906b [01:25:19] [02miraheze/mw-config] 07ugochimobi 03afdb960 - T9125: set wgModerationEmail/wgModerationNotificationEnable to true for obeymewiki (#4628) [01:26:15] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.02, 11.33, 10.61 [01:26:26] miraheze/mw-config - Universal-Omega the build passed. [01:26:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.72, 3.51, 3.99 [01:28:11] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.94, 9.86, 8.58 [01:28:16] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.63, 10.12, 9.01 [01:28:18] miraheze/ImportDump - Universal-Omega the build passed. [01:30:08] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.42, 10.56, 8.97 [01:30:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.02, 10.87, 10.65 [01:30:15] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.37, 9.39, 8.87 [01:30:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.21, 2.53, 3.26 [01:32:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.60, 10.36, 9.11 [01:32:29] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.59, 2.02, 1.41 [01:32:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.77, 3.71, 3.86 [01:34:03] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.41, 9.17, 8.81 [01:34:29] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.78, 1.57, 1.32 [01:34:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.46, 3.60, 3.79 [01:38:04] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.39, 9.66, 10.10 [01:38:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.55, 3.85, 3.82 [01:40:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.90, 4.13, 3.47 [01:41:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:41:59] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.64, 10.25, 10.25 [01:42:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.97, 3.71, 3.39 [01:43:57] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 15.25, 12.03, 10.89 [01:44:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.30, 3.13, 3.21 [01:44:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.25, 3.79, 3.88 [01:45:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.66, 11.42, 10.82 [01:46:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:46:11] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.73, 3.47, 3.32 [01:46:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.69, 4.09, 4.00 [01:48:44] !log [@test101] starting deploy of {'config': True} to all [01:48:45] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [01:48:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:48:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:49:59] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.96, 3.89, 3.50 [01:51:33] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.54, 3.41 [01:52:19] !log [@mwtask111] starting deploy of {'config': True} to all [01:52:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:52:31] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 12s [01:52:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:53:27] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.09, 3.07, 3.26 [01:53:48] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.51, 3.41, 3.42 [01:54:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.71, 3.91 [01:57:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.18, 3.81, 3.58 [01:57:46] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.39, 11.24, 10.90 [01:59:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.33, 3.39, 3.46 [01:59:44] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.22, 11.26, 10.95 [02:03:19] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.68, 3.86, 3.61 [02:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:05:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.02, 3.12, 3.36 [02:05:39] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.16, 11.16, 10.89 [02:06:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.30, 2.89, 3.39 [02:07:37] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.68, 10.83, 10.83 [02:11:23] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [02:11:23] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [02:15:30] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.67, 9.60, 10.20 [02:18:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:19:16] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 16.93, 11.42, 9.27 [02:19:46] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:19:53] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:20:38] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:20:53] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:20:56] PROBLEM - cp30 Stunnel HTTP for mw112 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:21:43] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 1.196 second response time [02:21:48] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.019 second response time [02:22:36] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.405 second response time [02:22:49] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.019 second response time [02:22:53] RECOVERY - cp30 Stunnel HTTP for mw112 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.330 second response time [02:25:02] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.48, 10.18, 9.67 [02:27:07] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.40, 3.83, 3.26 [02:29:01] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.79, 3.32 [02:30:56] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.71, 4.32, 3.58 [02:32:03] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.69, 9.47, 8.46 [02:32:50] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.68, 3.77, 3.47 [02:32:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.46, 3.27 [02:34:44] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.74, 4.37, 3.73 [02:34:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.31, 3.81, 3.43 [02:36:03] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.97, 8.59, 8.36 [02:36:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:36:38] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.56, 3.86, 3.63 [02:36:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.22, 3.25, 3.27 [02:40:44] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [02:40:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.42, 4.10, 3.64 [02:41:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:42:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.71, 3.59, 3.51 [02:44:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.70, 2.84, 3.31 [02:46:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.65, 3.56, 3.48 [02:50:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:50:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.90, 3.78, 3.57 [02:52:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.41, 4.09, 3.58 [02:54:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.99, 3.61 [02:56:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 7.72, 5.00, 4.00 [02:56:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 10.29, 5.48, 4.24 [02:58:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.14, 4.21, 3.56 [03:00:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:00:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.28, 9.89, 9.32 [03:00:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.78, 3.67, 3.45 [03:02:03] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.91, 9.59, 8.58 [03:04:03] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.22, 8.81, 8.41 [03:04:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.46, 3.12, 3.28 [03:04:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.90, 3.96 [03:06:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.46, 3.44, 3.73 [03:06:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.41, 3.84, 3.92 [03:08:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.54, 3.81 [03:12:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.56, 3.59, 3.68 [03:12:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.02, 4.25, 3.99 [03:13:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.89, 9.86, 9.87 [03:14:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.19, 3.76, 3.47 [03:16:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.78, 3.61, 3.69 [03:16:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.23, 3.26, 3.32 [03:18:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.08, 4.01, 3.84 [03:18:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.85, 3.96 [03:20:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.67, 3.65, 3.74 [03:22:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 3.75, 3.90 [03:24:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.85, 3.32, 3.72 [03:25:15] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [03:28:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.16, 3.04, 3.36 [03:30:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.00, 3.47, 3.23 [03:30:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.04, 3.23, 3.51 [03:32:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.36, 3.43 [03:32:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.86, 3.39, 3.53 [03:34:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.08, 3.06, 3.30 [03:34:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.25, 3.08, 3.14 [03:36:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.06, 3.56, 3.56 [03:39:07] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 1.73, 1.47 [03:41:02] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.60, 1.67, 1.47 [03:42:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.56, 4.03, 3.53 [03:42:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.20, 3.76, 3.34 [03:44:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.29, 3.41, 3.34 [03:46:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.28, 3.35, 3.33 [03:46:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.90, 3.44, 3.30 [03:51:14] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [03:51:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:52:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.87, 3.24, 3.30 [03:52:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.28, 3.79, 3.92 [04:06:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.29, 3.03, 3.38 [04:07:00] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.25, 10.69, 9.75 [04:11:41] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [04:12:55] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.24, 10.10, 9.84 [04:16:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:16:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.07, 3.97, 3.61 [04:18:43] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.37, 9.50, 8.68 [04:20:43] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.21, 9.30, 8.70 [04:20:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.71, 3.23, 3.38 [04:21:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:24:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.42, 3.52, 3.48 [04:26:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.53, 3.18, 3.36 [04:27:57] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.11, 1.78, 1.50 [04:31:56] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.72, 1.38, 1.41 [04:36:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:41:03] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [04:41:03] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [04:50:19] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.52, 10.47, 9.34 [04:54:15] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.70, 9.97, 9.39 [05:00:08] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.70, 10.66, 9.86 [05:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:08:04] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.05, 9.19, 9.61 [05:10:24] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [05:13:31] alerting : [FIRING:1] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:32:40] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 16.64, 13.06, 10.83 [05:33:31] alerting : [FIRING:2] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:33:34] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:33:41] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:33:57] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:34:08] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:34:14] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:35:32] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22336 bytes in 0.401 second response time [05:35:40] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.328 second response time [05:35:54] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.016 second response time [05:36:03] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.316 second response time [05:36:13] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 1.255 second response time [05:38:31] alerting : [FIRING:1] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:38:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.38, 10.70, 10.76 [05:41:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.12, 2.62 [05:42:33] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.55, 3.25, 2.85 [05:43:06] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 2.83, 2.57 [05:44:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.74, 3.67, 3.05 [05:44:49] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.63, 3.87, 2.33 [05:46:28] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.79, 8.90, 9.94 [05:46:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.05, 3.40, 3.02 [05:46:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.99, 4.14, 3.46 [05:49:47] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.89, 7.22, 4.12 [05:50:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.80, 3.89, 3.29 [05:52:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.64, 3.56, 3.25 [05:52:49] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.83, 1.76, 1.91 [05:54:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.55, 3.17, 3.14 [05:54:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.04, 3.47, 3.52 [05:56:49] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.62, 1.06, 1.58 [06:02:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.02, 3.03, 3.28 [06:07:47] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.75, 1.00, 1.88 [06:11:47] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.67, 0.88, 1.63 [06:18:31] ok : [RESOLVED] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:19:50] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 2.00, 1.73, 1.19 [06:20:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:21:50] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.57, 1.66, 1.23 [06:28:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.48, 4.08, 3.14 [06:28:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.33, 4.78, 3.66 [06:28:49] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.82, 2.19, 1.57 [06:29:19] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.16, 5.44, 3.70 [06:30:49] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.02, 1.68, 1.45 [06:31:47] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.98, 10.33, 9.35 [06:32:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.73, 3.69, 3.23 [06:33:45] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.11, 10.78, 9.63 [06:37:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.21, 10.98, 10.02 [06:38:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.33, 4.01, 3.47 [06:40:24] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [06:40:24] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:43:36] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.09, 10.03, 9.92 [06:44:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.67, 3.78, 3.66 [06:45:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:48:16] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.28, 1.83, 1.58 [06:48:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.04, 3.39, 3.82 [06:52:08] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.66, 1.88, 1.66 [06:54:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.98, 2.99, 3.39 [06:56:00] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.30, 1.58, 1.59 [06:57:47] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.70, 2.25, 1.63 [06:58:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.91, 3.43, 3.51 [07:00:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.53, 3.01, 3.34 [07:00:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.56, 3.44, 3.96 [07:01:47] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.21, 1.77, 1.58 [07:02:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 4.24, 4.20 [07:03:28] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.38, 9.88, 9.69 [07:03:47] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.15, 1.64, 1.57 [07:04:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.79, 3.53, 3.49 [07:07:28] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.78, 9.32, 9.60 [07:07:50] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.72, 1.62 [07:08:43] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.39, 3.91, 3.59 [07:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:10:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.39, 3.43 [07:12:30] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.13, 3.66, 3.63 [07:14:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:14:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.55, 3.22, 3.38 [07:16:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.62, 3.62 [07:16:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.61, 3.93 [07:19:50] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.08, 1.89, 1.75 [07:22:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.60, 2.87, 3.28 [07:23:47] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.94, 1.32, 1.27 [07:23:50] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.54, 1.83, 1.77 [07:25:47] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.20, 2.01, 1.53 [07:26:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.22, 2.82, 3.33 [07:27:47] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.09, 1.68, 1.47 [07:27:50] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.40, 1.58, 1.68 [07:29:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:39:06] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [07:44:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:53:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:54:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.59, 3.36, 3.26 [07:55:47] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.04, 1.86, 1.49 [07:57:47] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.67, 1.82, 1.53 [07:58:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:58:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 3.53, 2.96 [07:59:47] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.04, 1.90, 1.59 [08:00:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.63, 4.08, 3.65 [08:00:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.86, 3.32, 2.96 [08:01:47] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.09, 1.58, 1.51 [08:02:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.34, 3.88, 3.63 [08:04:04] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.16, 4.63, 3.94 [08:10:30] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.76, 3.49, 3.15 [08:11:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.82, 3.84 [08:12:30] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.95, 3.03, 3.01 [08:15:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.31, 3.10 [08:15:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 3.49, 3.68 [08:17:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.48, 3.02, 3.02 [08:17:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.57, 3.19, 3.55 [08:20:35] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.35, 9.51, 8.70 [08:23:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.77, 2.90, 3.34 [08:24:32] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.00, 9.79, 9.04 [08:26:43] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.31, 1.94, 1.62 [08:28:42] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.69, 1.79, 1.60 [08:32:41] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.26, 1.56, 1.56 [08:40:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.63, 3.20, 3.11 [08:42:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.67, 2.79, 2.96 [08:46:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.90, 3.41, 3.00 [08:46:49] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.59, 3.29 [08:47:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.79, 3.07, 2.92 [08:54:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.01, 3.20 [09:06:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.38, 3.77, 3.21 [09:09:20] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.18, 1.85, 1.55 [09:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:10:49] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.29, 10.26, 9.05 [09:11:19] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.19, 1.56, 1.48 [09:11:52] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.22, 3.95, 3.53 [09:12:47] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.55, 9.85, 9.03 [09:13:47] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.35, 3.02, 3.24 [09:17:16] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.72, 2.05, 1.68 [09:19:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:23:13] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.96, 2.00, 1.79 [09:29:11] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.16, 1.82, 1.76 [09:34:10] PROBLEM - munwiki.info - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns1.dnsowl.com.', 'ns2.dnsowl.com.', 'ns3.dnsowl.com.'], 'CNAME': None} [09:35:08] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.80, 1.43, 1.62 [09:41:04] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.62, 2.18, 1.87 [09:43:03] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.27, 1.85, 1.78 [09:45:03] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.80, 1.53, 1.67 [09:50:43] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.04, 9.79, 8.07 [09:52:43] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.35, 9.52, 8.17 [10:02:52] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.62, 1.85, 1.70 [10:06:51] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 3.86, 2.55, 1.98 [10:08:43] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.18, 2.73 [10:10:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.79, 3.07, 2.75 [10:12:48] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.12, 1.86, 1.87 [10:14:29] PROBLEM - munwiki.info - LetsEncrypt on sslhost is CRITICAL: connect to address munwiki.info and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [10:14:47] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.03, 2.00, 1.92 [10:18:45] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.80, 1.90, 1.89 [10:20:44]