[00:00:36] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.11, 10.83, 10.56
[00:03:07] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.48, 10.22, 9.64
[00:07:06] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.16, 10.88, 10.02
[00:09:05] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.79, 10.18, 9.87
[00:10:34] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.92, 2.00
[00:13:48] <icinga-miraheze>	 PROBLEM - wiki.dereric.gq - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.dereric.gq' expires in 15 day(s) (Fri 27 May 2022 23:58:53 GMT +0000).
[00:17:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.47, 10.04, 9.13
[00:18:31] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.39, 1.98, 1.96
[00:18:35] <Not-34e8>	 [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/702424475858...0996cb3e1873
[00:18:35] <MirahezeBot>	 [url] Comparing 702424475858...0996cb3e1873 · miraheze/ssl · GitHub | github.com
[00:18:36] <Not-34e8>	 [02miraheze/ssl] 07MirahezeSSLBot 030996cb3 - Bot: Update SSL cert for wiki.dereric.gq
[00:21:38] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.20, 9.78, 9.26
[00:23:31] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[00:24:28] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.18, 1.78, 1.93
[00:30:26] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.16, 1.31, 1.65
[00:34:28] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.55, 3.97
[00:36:23] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.79, 3.65, 3.98
[00:38:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[00:38:24] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.70, 3.71, 3.91
[00:38:25] <icinga-miraheze>	 PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.83, 1.40, 1.03
[00:38:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.11, 11.54, 10.88
[00:40:25] <icinga-miraheze>	 RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.73, 1.09, 0.96
[00:40:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.36, 11.28, 10.86
[00:42:21] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.75, 3.30, 3.70
[00:43:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.35, 3.93
[00:43:37] <icinga-miraheze>	 RECOVERY - wiki.dereric.gq - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.dereric.gq' will expire on Tue 09 Aug 2022 23:18:28 GMT +0000.
[00:44:19] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.36, 3.77, 3.80
[00:45:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.70, 4.45, 4.27
[00:46:17] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.12, 3.34, 3.63
[00:46:26] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.00, 9.46, 10.10
[00:48:13] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.15, 2.66, 3.31
[00:48:15] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.90, 1.56, 1.46
[00:49:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.53, 9.88, 9.15
[00:50:14] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.30, 1.88, 1.60
[00:51:37] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 10.19, 9.89, 9.25
[00:52:13] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.74, 1.86, 1.63
[00:52:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.09, 10.56, 10.29
[00:53:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.92, 3.69, 3.97
[00:54:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.92, 11.13, 10.54
[00:56:11] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.62, 1.67, 1.60
[00:56:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.19, 4.14, 3.76
[00:57:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.69, 3.91, 3.98
[00:58:27] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.10, 11.82, 10.95
[00:59:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.97, 4.00
[01:00:01] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.66, 3.47
[01:00:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.65, 10.29, 10.47
[01:01:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.26, 4.02, 4.01
[01:02:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.15, 3.98, 3.90
[01:02:26] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.31, 9.56, 10.18
[01:03:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[01:03:58] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.16, 3.20, 3.35
[01:05:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.34, 3.48, 3.82
[01:07:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.15, 3.56, 3.79
[01:08:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.02, 3.72, 3.68
[01:10:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.34, 3.41, 3.57
[01:10:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.82, 10.31, 10.14
[01:11:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[01:12:26] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.86, 10.16, 10.10
[01:13:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.27, 3.64, 3.83
[01:14:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.09, 3.76, 3.64
[01:15:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.96, 4.32, 4.07
[01:18:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.84, 3.70
[01:20:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.31, 2.00, 1.74
[01:21:20] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.43, 10.32, 10.17
[01:22:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.97, 2.00, 1.77
[01:23:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.76, 3.93
[01:28:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.17, 3.65, 3.66
[01:32:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.18, 3.36, 3.54
[01:32:57] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.38, 11.17, 10.59
[01:34:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.04, 1.90, 1.82
[01:34:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.17, 4.07, 3.78
[01:34:53] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.94, 11.08, 10.63
[01:36:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.90, 1.92, 1.84
[01:36:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.63, 3.83, 3.72
[01:36:49] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.51, 11.54, 10.85
[01:37:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.97, 4.09, 3.86
[01:38:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.94, 4.03, 3.82
[01:38:45] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.52, 11.49, 10.91
[01:42:18] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.41, 4.42, 3.75
[01:42:38] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.05, 11.95, 11.23
[01:44:34] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.14, 10.87, 10.91
[01:48:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.45, 2.06, 1.91
[01:48:13] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.52, 3.83, 3.74
[01:50:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.14, 11.40, 11.07
[01:51:38] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.70, 10.07, 9.50
[01:52:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.49, 10.38, 10.74
[01:52:37] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.66, 10.49, 9.54
[01:53:37] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.95, 10.03, 9.55
[01:54:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 2.00, 1.96
[01:54:36] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.79, 9.95, 9.45
[02:00:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.17, 3.66, 3.95
[02:00:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.33, 11.01, 10.70
[02:02:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.41, 10.73, 10.63
[02:03:59] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.46, 3.04, 3.33
[02:06:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.11, 1.42, 1.68
[02:10:16] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.84, 2.61, 3.32
[02:13:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.44, 3.52, 3.89
[02:13:09] <icinga-miraheze>	 PROBLEM - cloud10 Puppet on cloud10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2]
[02:15:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.26, 3.99, 4.03
[02:18:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.37, 10.95, 10.66
[02:19:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.12, 3.60, 3.86
[02:20:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.88, 1.68, 1.58
[02:20:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.64, 11.11, 10.75
[02:21:56] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.72, 2.22, 1.67
[02:22:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.32, 1.65, 1.59
[02:25:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.10, 3.55, 3.71
[02:25:56] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.01, 1.81, 1.65
[02:26:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[02:26:36] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.69, 3.31, 3.18
[02:27:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.37, 3.50, 3.67
[02:27:56] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.21, 1.57, 1.58
[02:28:26] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.58, 8.99, 9.96
[02:28:34] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.07, 3.23, 3.16
[02:36:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.93, 10.25, 10.09
[02:37:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.89, 4.07, 3.83
[02:38:24] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 3.59, 3.23
[02:38:26] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.43, 9.72, 9.92
[02:39:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.90, 3.91, 3.79
[02:39:09] <icinga-miraheze>	 RECOVERY - cloud10 Puppet on cloud10 is OK: OK: Puppet is currently enabled, last run 21 seconds ago with 0 failures
[02:40:22] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.57, 3.21, 3.13
[02:41:59] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.82, 3.66, 3.29
[02:43:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.07, 4.00, 3.85
[02:45:56] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.04, 3.25, 3.21
[02:47:14] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.31, 3.60, 3.31
[02:49:12] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.19, 3.56, 3.34
[02:50:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.38, 1.99, 1.68
[02:51:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.70, 3.95, 3.94
[02:52:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.90, 1.69
[02:53:08] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.52, 3.19, 3.24
[02:56:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.48, 1.68, 1.64
[02:57:43] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.65, 3.61, 3.43
[02:59:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.37, 3.81, 3.83
[02:59:41] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.77, 3.26, 3.33
[03:03:35] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 3.70, 3.52
[03:05:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.54, 3.55, 3.77
[03:05:33] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.44, 3.27, 3.39
[03:13:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.20, 2.86, 3.37
[03:14:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[03:17:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.61, 3.17, 3.41
[03:19:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.70, 3.59
[03:19:56] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.62, 2.16, 1.84
[03:21:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.45, 9.32, 8.19
[03:23:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.27, 3.93, 3.75
[03:23:53] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.97, 1.84
[03:24:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[03:25:37] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.76, 8.97, 8.33
[03:27:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.75, 2.78, 3.32
[03:29:20] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.31, 9.84, 9.21
[03:35:09] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.45, 11.24, 9.95
[03:37:05] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.82, 11.33, 10.14
[03:37:56] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.66, 3.42
[03:38:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[03:39:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.53, 3.43
[03:41:52] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.27, 3.14, 3.28
[03:43:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[03:44:49] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.06, 9.44, 9.74
[03:47:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.18, 3.08, 3.33
[03:47:40] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.45, 1.97, 1.85
[03:53:37] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.23, 1.79, 1.84
[03:59:34] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.13, 1.38, 1.63
[03:59:47] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.92, 3.10, 3.07
[04:01:41] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.98, 2.94, 3.01
[04:02:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[04:07:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[04:14:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.19, 3.53, 3.32
[04:19:22] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.70, 2.01, 1.64
[04:19:41] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.96, 3.32, 3.34
[04:21:21] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.95, 1.66
[04:25:19] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.51, 1.70, 1.63
[04:35:46] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.02, 3.10, 2.70
[04:37:13] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.87, 1.66, 1.59
[04:37:46] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.12, 2.68, 2.59
[04:41:11] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.43, 1.61, 1.59
[04:46:13] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.03, 3.64, 3.38
[04:48:07] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.30, 3.26, 3.27
[04:49:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.55, 1.92, 1.70
[04:53:03] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 1.83, 1.72
[05:00:59] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.88, 1.78
[05:04:57] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.85, 1.80
[05:12:28] <icinga-miraheze>	 PROBLEM - ns2 NTP time on ns2 is UNKNOWN: check_ntp_time: Invalid hostname/address - time.cloudflare.comUsage: check_ntp_time -H <host> [-4|-6] [-w <warn>] [-c <crit>] [-v verbose] [-o <time offset>]
[05:14:26] <icinga-miraheze>	 RECOVERY - ns2 NTP time on ns2 is OK: NTP OK: Offset -0.0005310773849 secs
[05:18:49] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.54, 2.04, 1.89
[05:24:46] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.62, 1.90, 1.90
[05:32:42] <icinga-miraheze>	 PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.77, 2.07, 1.36
[05:34:37] <icinga-miraheze>	 PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.88, 1.96, 1.39
[05:34:41] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.39, 1.45, 1.66
[05:35:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.49, 3.22, 2.83
[05:36:33] <icinga-miraheze>	 RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.01, 1.61, 1.33
[05:37:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.15, 2.88, 2.76
[05:40:46] <Not-34e8>	 [02ssl] 07RecapTimeSquad synchronize pull request 03#514: Add redirects for wiki.rtapp.tk and wiki.recaptime.tk as per T9210 - 13https://github.com/miraheze/ssl/pull/514
[05:40:46] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[05:44:08] <mhbridgebot>	 [discord] <Ugochimobi> @Reception123 please can you get to the script?
[05:44:23] <mhbridgebot>	 [discord] <Ugochimobi> @Reception123
[05:44:49] <Reception123>	 which one is that?
[05:45:32] <Not-34e8>	 [02ssl] 07RecapTimeSquad synchronize pull request 03#514: Add redirects for wiki.rtapp.tk and wiki.recaptime.tk as per T9210 - 13https://github.com/miraheze/ssl/pull/514
[05:45:33] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[05:46:03] <mhbridgebot>	 [discord] <Ugochimobi> @Reception123 the one I requested on phab
[05:47:16] <Reception123>	 !log sudo -u www-data php /srv/mediawiki/w/extensions/Wikibase/repo/maintenance/changePropertyDataType.php --wiki=gratisdatawiki --property-id P386 --new-data-type commonsMedia
[05:47:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[05:47:33] <Reception123>	 !log sudo -u www-data php /srv/mediawiki/w/extensions/Wikibase/repo/maintenance/changePropertyDataType.php --wiki=gratisdatawiki --property-id P387 --new-data-type commonsMedia
[05:47:37] <Reception123>	 @Ugochimobi done ^
[05:47:40] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[05:49:21] <mhbridgebot>	 [discord] <Ugochimobi> @Reception123 thanks ;)
[05:49:25] <Reception123>	 no problem
[05:50:32] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.01, 1.59, 1.49
[05:52:31] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.37, 1.56, 1.50
[05:53:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.81, 9.71, 8.26
[05:56:51] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.81, 10.09, 9.19
[05:57:37] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.37, 9.23, 8.42
[05:57:46] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.38, 2.78
[05:57:47] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.89, 4.26, 3.49
[05:58:30] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.07, 3.95, 3.12
[05:58:47] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.57, 10.62, 9.47
[05:59:46] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.22, 3.21, 2.81
[06:00:28] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.31, 3.32, 2.98
[06:00:43] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.62, 9.75, 9.29
[06:01:35] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.49, 3.74, 3.50
[06:05:22] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.41, 3.07, 3.29
[06:08:22] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.73, 2.08, 1.70
[06:15:06] <icinga-miraheze>	 alerting : [FIRING:1] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[06:24:20] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.70, 3.35, 3.14
[06:26:13] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.16, 3.34, 3.16
[06:55:06] <icinga-miraheze>	 ok : [RESOLVED] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[06:59:29] <icinga-miraheze>	 PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.94, 1.99, 1.35
[07:01:26] <icinga-miraheze>	 RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.69, 1.49, 1.24
[07:07:16] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.77, 9.91, 8.79
[07:11:09] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.63, 9.79, 8.99
[07:18:48] <icinga-miraheze>	 PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query.
[08:15:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 3.31, 2.67
[08:17:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.02, 2.99, 2.62
[08:23:28] <icinga-miraheze>	 PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2]
[08:46:48] <icinga-miraheze>	 RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK
[08:51:28] <icinga-miraheze>	 RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[09:09:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.95, 3.40, 2.90
[09:11:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.39, 3.97, 3.16
[09:12:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.87, 5.03, 3.33
[09:12:34] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.65, 3.93, 2.89
[09:14:32] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.38, 3.78, 2.96
[09:15:07] <RhinosF1>	 ugochimobi: you edit conflicted with me adding the template in https://phabricator.miraheze.org/T9214#186781
[09:15:07] <MirahezeBot>	 [url] ⚓ T9214 Allow LucidChart iframes in CSP | phabricator.miraheze.org
[09:16:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.29, 3.52, 3.09
[09:17:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.46, 3.84, 3.45
[09:17:17] <ugochimobi>	 RhinosF1: oh, I just saw, very sorry about that.
[09:18:28] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.54, 3.19, 2.91
[09:18:48] <icinga-miraheze>	 PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in <module> main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l
[09:18:48] <icinga-miraheze>	 n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[09:19:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.97, 3.24, 3.28
[09:20:16] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.49, 3.15, 3.04
[09:21:15] <RhinosF1>	 ugochimobi: no worries
[09:32:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.36, 1.50, 1.95
[09:38:09] <ugochimobi>	 Reception123: after running that script, is there another maintenance that needs to be done, the entities are kinda laggy right now, maybe rebuildLinks.php or something related..?
[09:42:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.54, 1.47, 1.70
[09:47:09] <icinga-miraheze>	 PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.58, 1.75, 1.19
[09:47:36] <icinga-miraheze>	 PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query.
[09:49:09] <icinga-miraheze>	 RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.54, 1.28, 1.08
[09:50:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.45, 2.02, 1.83
[09:52:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.58, 1.85, 1.79
[09:58:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.42, 1.57, 1.68
[10:09:02] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.68, 1.66
[10:16:48] <icinga-miraheze>	 RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK
[10:18:56] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.77, 2.15, 1.87
[10:26:52] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.91, 1.90
[10:40:45] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.23, 1.51, 1.70
[10:50:39] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.54, 2.00, 1.79
[10:52:38] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.21, 1.66, 1.68
[11:20:22] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.41, 1.98, 1.62
[11:22:21] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.57, 1.82, 1.61
[11:26:19] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.39, 1.69, 1.61
[11:30:31] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[11:37:13] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.28, 10.29, 8.94
[11:39:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.78, 3.46, 3.01
[11:41:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.32, 3.10, 2.94
[11:41:05] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.04, 10.94, 9.49
[11:41:42] <icinga-miraheze>	 PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.84, 1.38, 1.05
[11:43:01] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.64, 11.08, 9.70
[11:43:42] <icinga-miraheze>	 RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.94, 1.13, 0.99
[11:45:31] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[11:46:53] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.39, 11.32, 10.08
[11:48:42] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.63, 10.32, 8.68
[11:48:49] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.71, 10.95, 10.08
[11:50:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.45, 1.92, 1.70
[11:50:42] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.60, 9.34, 8.53
[11:51:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.95, 10.65, 9.22
[11:52:41] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.56, 11.90, 10.63
[11:53:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[11:54:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.99, 1.81
[11:54:29] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.02, 1.77, 1.23
[11:56:25] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.72, 1.42, 1.16
[11:57:37] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.31, 9.93, 9.41
[12:09:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.67, 11.07, 9.91
[12:11:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.30, 11.06, 10.06
[12:14:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.83, 11.45, 11.81
[12:14:45] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 15.76, 12.62, 10.48
[12:16:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.89, 11.97, 11.96
[12:17:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.89, 11.73, 10.64
[12:18:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.30, 1.98, 1.88
[12:18:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.67, 11.88, 11.93
[12:18:44] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.44, 10.75, 10.27
[12:20:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.19, 12.49, 12.16
[12:21:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.57, 11.45, 10.77
[12:22:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.39, 11.71, 11.92
[12:22:43] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.17, 9.56, 9.89
[12:22:46] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.21, 3.27, 2.60
[12:23:20] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.67, 4.06, 3.02
[12:23:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.21, 11.59, 10.89
[12:24:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.65, 2.00, 1.97
[12:24:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.67, 12.82, 12.30
[12:24:31] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.89, 2.21, 1.43
[12:24:45] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.55, 3.04, 2.60
[12:25:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.15, 3.68, 3.04
[12:25:18] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.70, 3.55, 2.96
[12:26:27] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.77, 1.56, 1.28
[12:27:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.30, 3.20, 2.94
[12:27:16] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.05, 2.94, 2.79
[12:27:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.90, 11.38, 11.00
[12:28:10] <icinga-miraheze>	 PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.07, 1.57, 1.16
[12:30:07] <icinga-miraheze>	 RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.00, 1.36, 1.13
[12:31:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.95, 11.53, 11.10
[12:33:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.35, 11.67, 11.22
[12:33:39] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.09, 10.33, 10.06
[12:34:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.27, 1.45, 1.69
[12:35:38] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.98, 9.85, 9.91
[12:41:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.73, 11.44, 11.08
[12:45:28] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.83, 3.38, 3.03
[12:45:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.03, 11.36, 11.20
[12:47:22] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.20, 3.06, 2.96
[12:48:48] <icinga-miraheze>	 PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in <module> main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l
[12:48:48] <icinga-miraheze>	 n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[12:50:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.11, 1.70, 1.56
[12:52:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.85, 1.63
[12:53:03] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.04, 3.73, 3.23
[12:54:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.16, 1.59, 1.56
[12:55:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.09, 3.49, 3.21
[12:59:31] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.62, 9.96, 9.58
[13:01:31] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.30, 10.70, 9.89
[13:01:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.71, 10.36, 10.60
[13:03:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.35, 3.09, 3.22
[13:03:30] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.65, 10.43, 9.91
[13:05:30] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.70, 9.58, 9.67
[13:05:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.63, 11.07, 10.87
[13:07:33] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 3.76, 3.14
[13:08:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[13:09:31] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.19, 3.26, 3.01
[13:11:09] <icinga-miraheze>	 PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.30, 1.72, 1.38
[13:11:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.22, 11.50, 11.11
[13:13:09] <icinga-miraheze>	 RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.95, 1.42, 1.31
[13:13:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.55, 11.09, 11.03
[13:13:59] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.81, 3.32, 2.96
[13:14:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.32, 11.21, 11.85
[13:15:31] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[13:15:57] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.01, 3.34, 3.00
[13:17:28] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.43, 3.82, 3.45
[13:17:56] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.09, 3.27, 3.02
[13:18:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.42, 1.88, 1.67
[13:19:19] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.99, 3.55, 3.25
[13:19:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.71, 10.58, 10.65
[13:21:16] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.76, 3.54
[13:21:18] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.58, 3.86, 3.39
[13:21:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.73, 10.77, 10.73
[13:22:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.31, 12.18, 11.91
[13:23:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.29, 3.60, 3.36
[13:24:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.78, 11.27, 11.62
[13:25:14] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.23, 3.63, 3.38
[13:25:31] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[13:25:37] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.27, 9.33, 10.19
[13:26:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.37, 1.97, 1.93
[13:27:12] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.82, 3.27, 3.27
[13:29:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.89, 3.00, 3.35
[13:32:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[13:33:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 3.52, 3.45
[13:34:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.16, 11.22, 11.33
[13:35:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.67, 3.20, 3.34
[13:38:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.73, 11.94, 11.64
[13:41:47] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.92, 3.91, 3.54
[13:43:41] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.20, 3.54, 3.45
[13:44:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.13, 12.20, 11.76
[13:46:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.19, 11.81, 11.67
[13:46:48] <icinga-miraheze>	 PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query.
[13:46:49] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.92, 3.64, 3.31
[13:47:08] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.32, 10.72, 10.12
[13:47:28] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 4.06, 3.69
[13:48:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.46, 2.08, 1.92
[13:48:47] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.83, 3.93, 3.44
[13:49:16] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.46, 10.55, 9.78
[13:49:24] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.76, 4.10, 3.39
[13:50:17] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.01, 10.73, 9.81
[13:50:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.74, 11.84, 11.68
[13:52:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[13:52:16] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.93, 10.01, 9.66
[13:52:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.34, 11.63, 11.62
[13:52:44] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.53, 3.39, 3.33
[13:52:54] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.27, 11.31, 10.70
[13:53:04] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.29, 9.89, 9.69
[13:53:20] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.95, 3.67, 3.39
[13:55:18] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.73, 4.02, 3.54
[13:56:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.95, 12.22, 11.85
[13:56:38] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.06, 3.42, 3.37
[13:57:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.68, 3.77
[13:58:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.93, 1.97
[13:58:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.76, 11.99, 11.81
[13:58:36] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.56, 3.77, 3.50
[13:59:15] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.84, 3.47, 3.43
[14:00:35] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.39, 3.22, 3.33
[14:01:13] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.09, 3.27, 3.36
[14:02:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[14:03:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.28, 3.63, 3.69
[14:04:25] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.76, 9.50, 10.16
[14:04:29] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.52, 3.51, 3.43
[14:06:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.35, 11.84, 11.63
[14:06:27] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.55, 3.81, 3.54
[14:08:25] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.90, 3.47, 3.45
[14:09:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.35, 3.70, 3.72
[14:12:21] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.94, 3.20, 3.34
[14:12:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.27, 11.08, 11.52
[14:15:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.85, 3.58, 3.59
[14:16:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.32, 1.44, 1.66
[14:17:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.58, 3.58
[14:18:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.61, 11.34, 11.40
[14:19:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.86, 3.92, 3.69
[14:20:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.28, 1.87, 1.78
[14:20:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.89, 11.12, 11.32
[14:22:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.97, 1.83
[14:22:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.35, 3.21
[14:23:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.80, 3.78, 3.72
[14:24:16] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.31, 3.28, 3.20
[14:25:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.90, 3.77
[14:25:56] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.19, 2.55, 1.66
[14:26:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.88, 11.82, 11.48
[14:27:27] <icinga-miraheze>	 PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[14:27:43] <icinga-miraheze>	 PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 1.55, 1.82, 1.45
[14:27:56] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.57, 1.90, 1.53
[14:28:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.97, 1.38, 1.62
[14:28:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.73, 4.97, 3.80
[14:28:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.50, 11.69, 11.48
[14:28:32] <icinga-miraheze>	 PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[14:28:40] <icinga-miraheze>	 PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[14:29:09] <icinga-miraheze>	 PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.31, 1.85, 1.38
[14:29:42] <icinga-miraheze>	 RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 1.05, 1.56, 1.41
[14:29:56] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.57, 1.46, 1.42
[14:30:21] <icinga-miraheze>	 PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[14:30:46] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.15, 5.32, 3.93
[14:31:09] <icinga-miraheze>	 PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 2.00, 1.78, 1.40
[14:31:39] <icinga-miraheze>	 RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 4.724 second response time
[14:32:25] <icinga-miraheze>	 RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 7.604 second response time
[14:32:37] <icinga-miraheze>	 RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 3.731 second response time
[14:32:45] <icinga-miraheze>	 RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22334 bytes in 6.123 second response time
[14:33:09] <icinga-miraheze>	 RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.60, 1.35, 1.29
[14:40:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.07, 11.19, 11.18
[14:46:01] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.41, 9.86, 8.92
[14:46:48] <icinga-miraheze>	 RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK
[14:48:00] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.83, 9.89, 9.06
[14:48:24] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.56, 10.41, 9.62
[14:50:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.23, 1.79, 1.55
[14:50:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.26, 11.26, 11.37
[14:52:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.87, 1.84, 1.60
[14:52:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.51, 11.89, 11.59
[14:54:10] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.73, 9.48, 9.54
[14:54:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.34, 11.26, 11.40
[14:55:04] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.45, 9.86, 9.29
[14:56:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.45, 1.62, 1.56
[14:56:58] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.02, 9.79, 9.35
[14:57:57] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.54, 10.23, 9.45
[14:59:56] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 10.18, 10.06, 9.48
[15:02:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[15:02:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.82, 1.71, 1.60
[15:06:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.64, 10.99, 10.78
[15:08:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.66, 1.66, 1.63
[15:11:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[15:14:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.93, 11.53, 11.24
[15:20:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.77, 2.06, 1.76
[15:22:03] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.78, 3.06, 3.80
[15:24:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.81, 1.97, 1.81
[15:26:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[15:29:56] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.23, 2.85, 3.36
[15:30:31] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[15:31:47] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 15.22, 11.47, 9.96
[15:32:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.12, 3.36, 3.87
[15:34:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.37, 12.05, 11.29
[15:35:42] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.29, 10.33, 9.45
[15:35:46] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.04, 11.29, 10.24
[15:36:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.87, 4.27, 4.12
[15:38:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.28, 11.70, 11.34
[15:38:47] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.51, 4.52, 3.81
[15:39:29] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.67, 9.30, 9.22
[15:40:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.95, 12.08, 11.52
[15:43:16] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.27, 10.14, 9.57
[15:44:42] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.83, 3.95, 3.84
[15:45:10] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.61, 10.11, 9.63
[15:45:43] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.43, 11.39, 10.70
[15:46:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.88, 11.81, 11.68
[15:46:40] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.13, 4.45, 4.04
[15:47:43] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.53, 10.46, 10.46
[15:48:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.91, 1.85
[15:48:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.81, 12.08, 11.81
[15:50:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.58, 3.55, 3.79
[15:51:42] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.72, 9.50, 10.08
[15:52:35] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.03, 3.77, 3.81
[15:56:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.75, 1.90, 1.92
[15:56:31] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.63, 3.34, 3.65
[15:58:30] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.30, 3.74, 3.76
[16:02:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 3.53, 2.25, 2.00
[16:02:26] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.30, 3.58, 3.69
[16:02:38] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.27, 10.98, 10.43
[16:03:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.34, 3.17, 3.87
[16:04:14] <icinga-miraheze>	 PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.230 second response time
[16:04:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.11, 3.42, 3.88
[16:04:28] <icinga-miraheze>	 PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[16:04:36] <icinga-miraheze>	 PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[16:04:37] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.44, 10.50, 10.33
[16:04:38] <icinga-miraheze>	 PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[16:06:02] <icinga-miraheze>	 PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[16:06:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.26, 2.00, 1.98
[16:06:23] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.96, 2.78, 3.33
[16:06:32] <icinga-miraheze>	 RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 8.636 second response time
[16:06:37] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.54, 9.87, 10.10
[16:06:38] <icinga-miraheze>	 RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 5.485 second response time
[16:06:38] <icinga-miraheze>	 RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22334 bytes in 5.968 second response time
[16:07:59] <icinga-miraheze>	 RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.017 second response time
[16:08:22] <icinga-miraheze>	 RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.503 second response time
[16:10:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.46, 3.53, 3.74
[16:12:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.11, 3.30, 3.62
[16:14:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.32, 1.42, 1.68
[16:14:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.48, 3.57, 3.67
[16:15:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.30, 4.00, 3.86
[16:16:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.55, 3.65
[16:17:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.94, 3.87
[16:18:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.94, 11.73, 11.96
[16:18:48] <icinga-miraheze>	 PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query.
[16:19:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.13, 4.36, 4.00
[16:20:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.17, 1.76, 1.72
[16:20:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.44, 4.02, 3.79
[16:20:41] <MirahezeLSBot>	 !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildLinks.php --wiki=gratisdatawiki (END - exit=256)
[16:20:49] <MirahezeLSBot>	 !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/refreshLinks.php --wiki=gratisdatawiki (START)
[16:20:51] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:21:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:21:06] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.12, 3.66, 3.43
[16:21:13] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.98, 10.84, 10.15
[16:22:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.76, 1.74, 1.72
[16:22:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.26, 3.87, 3.77
[16:23:04] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.86, 3.79, 3.51
[16:23:08] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.23, 11.39, 10.44
[16:24:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.54, 1.65, 1.69
[16:24:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.83, 4.19, 3.92
[16:24:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.91, 11.90, 11.90
[16:25:54] <Not-34e8>	 [02dns] 07Reception123 closed pull request 03#271: add cloudwiki.org zone - 13https://github.com/miraheze/dns/pull/271
[16:25:54] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[16:25:55] <Not-34e8>	 [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/e90a8990a795...fcf1bf347b2b
[16:25:56] <MirahezeBot>	 [url] Comparing e90a8990a795...fcf1bf347b2b · miraheze/dns · GitHub | github.com
[16:25:57] <Not-34e8>	 [02miraheze/dns] 07MacFan4000 03fcf1bf3 - add cloudwiki.org zone (#271)
[16:26:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.75, 3.71, 3.78
[16:26:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.97, 11.54, 11.77
[16:28:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.43, 4.37, 4.01
[16:28:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.71, 11.74, 11.80
[16:28:54] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.83, 11.65, 10.77
[16:29:55] <icinga-miraheze>	 PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 5.32, 4.17, 2.35
[16:30:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.01, 10.35, 11.29
[16:31:18] <Not-34e8>	 [02puppet] 07Reception123 commented on pull request 03#2433: Grant mw team access to jobchron121 - 13https://github.com/miraheze/puppet/pull/2433#issuecomment-1125198776
[16:31:18] <MirahezeBot>	 [url] Grant mw team access to jobchron121 by paladox · Pull Request #2433 · miraheze/puppet · GitHub | github.com
[16:31:43] <Not-34e8>	 [02puppet] 07Reception123 edited a comment on pull request 03#2433: Grant mw team access to jobchron121 - 13https://github.com/miraheze/puppet/pull/2433#issuecomment-1125198776
[16:31:43] <MirahezeBot>	 [url] Grant mw team access to jobchron121 by paladox · Pull Request #2433 · miraheze/puppet · GitHub | github.com
[16:31:46] <Not-34e8>	 [02puppet] 07Reception123 closed pull request 03#2433: Grant mw team access to jobchron121 - 13https://github.com/miraheze/puppet/pull/2433
[16:31:46] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[16:31:47] <Not-34e8>	 [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/ece79368c7dc...917f6a1e10ce
[16:31:48] <MirahezeBot>	 [url] Comparing ece79368c7dc...917f6a1e10ce · miraheze/puppet · GitHub | github.com
[16:31:49] <Not-34e8>	 [02miraheze/puppet] 07paladox 03917f6a1 - Grant mw team access to jobchron121 (#2433)
[16:31:50] <Not-34e8>	 [02puppet] 07Reception123 deleted branch 03paladox-patch-6 - 13https://github.com/miraheze/puppet
[16:31:51] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[16:31:52] <Not-34e8>	 [02miraheze/puppet] 07Reception123 deleted branch 03paladox-patch-6
[16:32:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.06, 3.76, 3.86
[16:32:56] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.60, 2.89, 3.25
[16:33:28] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.58, 10.30, 10.03
[16:34:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.85, 11.22, 11.39
[16:35:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.86, 3.48, 3.88
[16:35:27] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.93, 9.94, 9.92
[16:35:52] <Not-34e8>	 [02puppet] 07RhinosF1 opened pull request 03#2533: Add UO to cache-admins - 13https://github.com/miraheze/puppet/pull/2533
[16:35:53] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[16:35:59] <RhinosF1>	 Reception123: ^
[16:36:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.01, 3.75, 3.81
[16:36:20] <RhinosF1>	 I checked and it's definitely defined everywhere
[16:36:51] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.40, 3.38
[16:37:21] <MacFan4000>	 CosmicAlpha: ^^
[16:37:56] <Not-34e8>	 [02puppet] 07Reception123 closed pull request 03#2533: Add UO to cache-admins - 13https://github.com/miraheze/puppet/pull/2533
[16:37:57] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[16:37:58] <Reception123>	 thanks RhinosF1 
[16:37:58] <Not-34e8>	 [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/917f6a1e10ce...340fefcdaf7f
[16:37:58] <MirahezeBot>	 [url] Comparing 917f6a1e10ce...340fefcdaf7f · miraheze/puppet · GitHub | github.com
[16:37:59] <Not-34e8>	 [02miraheze/puppet] 07RhinosF1 03340fefc - Update data.yaml (#2533)
[16:38:14] <RhinosF1>	 Np Reception123
[16:38:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.12, 3.43, 3.68
[16:38:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.20, 11.34, 11.48
[16:38:49] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.06, 3.33, 3.36
[16:39:55] <icinga-miraheze>	 PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 2.11, 3.81, 3.25
[16:40:48] <CosmicAlpha>	 Thanks RhinosF1!
[16:41:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.52, 3.69, 3.81
[16:42:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.48, 4.20, 3.89
[16:42:24] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.46, 11.27, 10.78
[16:43:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.55, 3.75
[16:43:55] <icinga-miraheze>	 RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 2.56, 3.39, 3.20
[16:44:19] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.47, 10.93, 10.71
[16:45:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.05, 4.31, 4.01
[16:46:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.88, 3.86, 3.84
[16:47:36] <icinga-miraheze>	 RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK
[16:47:55] <icinga-miraheze>	 PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.91, 4.09, 3.52
[16:48:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.41, 1.84, 1.63
[16:49:55] <icinga-miraheze>	 PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 2.98, 3.67, 3.44
[16:50:05] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.25, 10.96, 10.69
[16:52:00] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.96, 11.14, 10.78
[16:52:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.69, 11.54, 11.13
[16:53:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.78, 3.88
[16:53:55] <icinga-miraheze>	 PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 7.35, 5.02, 3.99
[16:53:56] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.04, 11.88, 11.09
[16:53:56] <Not-34e8>	 [02puppet] 07Universal-Omega opened pull request 03#2534: monitoring: add MacFan4000 to puppetusers - 13https://github.com/miraheze/puppet/pull/2534
[16:53:56] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[16:54:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.92, 1.78
[16:54:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.67, 10.80, 10.91
[16:55:51] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.41, 10.47, 10.67
[16:58:05] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.31, 1.60, 1.68
[17:00:16] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.64, 2.98, 3.33
[17:01:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.27, 3.60, 3.71
[17:02:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.54, 11.69, 11.19
[17:03:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.09, 11.39, 10.98
[17:05:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.83, 11.75, 11.18
[17:06:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.65, 1.65
[17:06:16] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.64, 3.15, 3.25
[17:07:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.01, 3.47, 3.64
[17:07:51] <Not-34e8>	 [02puppet] 07Reception123 closed pull request 03#2534: monitoring: add MacFan4000 to puppetusers - 13https://github.com/miraheze/puppet/pull/2534
[17:07:51] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[17:07:52] <Not-34e8>	 [02miraheze/puppet] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/340fefcdaf7f...1d68a0e58747
[17:07:52] <MirahezeBot>	 [url] Comparing 340fefcdaf7f...1d68a0e58747 · miraheze/puppet · GitHub | github.com
[17:07:53] <Not-34e8>	 [02miraheze/puppet] 07Universal-Omega 031d68a0e - monitoring: add MacFan4000 to puppetusers (#2534)
[17:08:16] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.24, 3.19, 3.25
[17:10:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.19, 10.96, 11.27
[17:10:52] <MirahezeLSBot>	 !log [reception@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/refreshLinks.php --wiki=gratisdatawiki (END - exit=0)
[17:11:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 3.62, 3.63
[17:11:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[17:12:51] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.77, 10.13, 9.36
[17:15:11] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.20, 3.62, 3.44
[17:16:10] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.60, 3.80, 3.49
[17:16:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.08, 10.90, 11.08
[17:17:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.43, 3.96, 3.79
[17:17:55] <icinga-miraheze>	 PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 0.28, 1.92, 3.92
[17:18:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.48, 2.09, 1.86
[17:18:42] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.56, 10.20, 9.67
[17:18:48] <icinga-miraheze>	 PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in <module> main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l
[17:18:48] <icinga-miraheze>	 n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[17:20:07] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.63, 3.29, 3.35
[17:21:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.42, 3.91, 3.78
[17:21:55] <icinga-miraheze>	 RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.58, 1.57, 3.30
[17:23:00] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.90, 3.66, 3.69
[17:23:03] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.31, 3.36, 3.40
[17:25:37] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.31, 9.49, 10.11
[17:26:26] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.63, 11.81, 11.57
[17:27:00] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.84, 2.92, 3.36
[17:27:09] <icinga-miraheze>	 PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.74, 1.74, 1.25
[17:28:05] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.77, 1.94, 1.95
[17:30:57] <icinga-miraheze>	 RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.49, 1.41, 1.20
[17:32:43] <icinga-miraheze>	 PROBLEM - wiki.phgalaxy.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.phgalaxy.eu.org All nameservers failed to answer the query.
[17:35:38] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.81, 11.40, 11.38
[17:35:58] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.46, 3.65, 3.48
[17:37:37] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.11, 11.31, 11.35
[17:38:29] <Not-34e8>	 [02ssl] 07MacFan4000 commented on pull request 03#514: Add redirects for wiki.rtapp.tk and wiki.recaptime.tk as per T9210 - 13https://github.com/miraheze/ssl/pull/514#issuecomment-1125257873
[17:38:30] <MirahezeBot>	 [url] Add redirects for wiki.rtapp.tk and wiki.recaptime.tk as per T9210 by ajhalili2006 · Pull Request #514 · miraheze/ssl · GitHub | github.com
[17:40:19] <Not-34e8>	 [02ssl] 07Universal-Omega reviewed pull request 03#514 commit - 13https://github.com/miraheze/ssl/pull/514#discussion_r871651804
[17:40:20] <MirahezeBot>	 [url] Add redirects for wiki.rtapp.tk and wiki.recaptime.tk as per T9210 by ajhalili2006 · Pull Request #514 · miraheze/ssl · GitHub | github.com
[17:43:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.46, 4.17, 3.63
[17:43:39] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.16, 1.41, 1.66
[17:43:43] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.81, 10.70, 9.73
[17:43:45] <icinga-miraheze>	 PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.08, 9.87, 8.78
[17:45:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.04, 3.82, 3.57
[17:45:43] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.30, 10.86, 9.93
[17:47:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.30, 4.07, 3.67
[17:47:19] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.36, 10.39, 9.83
[17:47:34] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.53, 12.04, 11.70
[17:47:37] <icinga-miraheze>	 RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.12, 9.73, 8.99
[17:49:39] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.74, 2.02, 1.82
[17:53:38] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.20, 1.76, 1.78
[17:53:43] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.53, 9.72, 9.81
[17:53:57] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.53, 3.98, 3.52
[17:54:38] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.89, 10.47, 9.80
[17:55:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.95, 3.99, 3.81
[17:55:17] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.63, 9.46, 9.76
[17:55:31] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.88, 11.80, 11.79
[17:55:39] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.09, 1.55, 1.70
[17:57:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.41, 3.98, 3.81
[17:57:28] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ssl/commit/97741f455f67
[17:57:29] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 0397741f4 - add cloudwiki.org cert
[17:57:31] <Not-34e8>	 [02ssl] 07MacFan4000 created branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl
[17:57:31] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[17:57:35] <Not-34e8>	 [02ssl] 07MacFan4000 opened pull request 03#515: add 2 certs - 13https://github.com/miraheze/ssl/pull/515
[17:57:35] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[17:57:55] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.86, 3.91, 3.61
[17:59:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.35, 3.76, 3.76
[17:59:43] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.69, 10.86, 10.19
[17:59:54] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.01, 4.00, 3.67
[18:00:31] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[18:01:29] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.03, 11.20, 11.46
[18:01:43] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.67, 10.22, 10.06
[18:01:53] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.38, 3.54, 3.55
[18:02:38] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.27, 11.99, 10.74
[18:02:42] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.59, 3.32, 3.87
[18:02:57] <Not-34e8>	 [02ssl] 07MacFan4000 edited pull request 03#515: add cloud wiki.org cert - 13https://github.com/miraheze/ssl/pull/515
[18:02:58] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:03:05] <Not-34e8>	 [02ssl] 07MacFan4000 edited pull request 03#515: add cloudwiki.org cert - 13https://github.com/miraheze/ssl/pull/515
[18:03:05] <MirahezeBot>	 ...
[18:04:37] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.07, 3.89, 4.00
[18:04:39] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.94, 10.71, 10.43
[18:05:28] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.90, 11.79, 11.66
[18:05:43] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.08, 10.77, 10.28
[18:05:45] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/97741f455f67...c24967df6251
[18:05:46] <MirahezeBot>	 [url] Comparing 97741f455f67...c24967df6251 · miraheze/ssl · GitHub | github.com
[18:05:46] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 03c24967d - Update certs.yaml
[18:05:48] <Not-34e8>	 [02ssl] 07MacFan4000 synchronize pull request 03#515: add cloudwiki.org cert - 13https://github.com/miraheze/ssl/pull/515
[18:05:48] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:06:29] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/0996cb3e1873...bac8e97c996e
[18:06:30] <MirahezeBot>	 [url] Comparing 0996cb3e1873...bac8e97c996e · miraheze/ssl · GitHub | github.com
[18:06:31] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 03bac8e97 - add cloudwiki.org cert (#515)
[18:06:31] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[18:06:31] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.68, 3.90
[18:06:32] <Not-34e8>	 [02ssl] 07MacFan4000 closed pull request 03#515: add cloudwiki.org cert - 13https://github.com/miraheze/ssl/pull/515
[18:06:33] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:06:34] <Not-34e8>	 [02ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl
[18:06:34] <MirahezeBot>	 ...
[18:06:35] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1
[18:07:27] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.13, 12.16, 11.81
[18:07:38] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.24, 1.69, 1.59
[18:07:43] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.57, 10.39, 10.21
[18:07:50] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.55, 3.78, 3.64
[18:08:26] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.12, 4.04, 4.02
[18:09:43] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.48, 10.79, 10.35
[18:09:48] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.69, 3.47, 3.55
[18:10:20] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.34, 3.40, 3.79
[18:11:04] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.59, 2.97, 3.34
[18:12:11] <Not-34e8>	 [02mediawiki] 07Universal-Omega closed pull request 03#6972: Bump skins/Citizen from `0f38149` to `2787d49` - 13https://github.com/miraheze/mediawiki/pull/6972
[18:12:11] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:12:13] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/75e0d3b93289...a8c224c321d4
[18:12:14] <MirahezeBot>	 [url] Comparing 75e0d3b93289...a8c224c321d4 · miraheze/mediawiki · GitHub | github.com
[18:12:14] <Not-34e8>	 [02miraheze/mediawiki] 07lens0021 03a8c224c - Bump skins/Citizen from `0f38149` to `2787d49` (#6972)
[18:12:46] <icinga-miraheze>	 PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.65, 10.21, 9.44
[18:13:13] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.01, 10.70, 10.03
[18:13:16] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/a8c224c321d4...60302cd08c74
[18:13:16] <MirahezeBot>	 [url] Comparing a8c224c321d4...60302cd08c74 · miraheze/mediawiki · GitHub | github.com
[18:13:17] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega 0360302cd - Update EmbedVideo
[18:13:25] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.51, 11.75, 11.78
[18:13:43] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.75, 11.47, 10.77
[18:13:46] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.90, 2.95, 3.34
[18:14:36] <MirahezeLSBot>	 !log [universalomega@mwtask111] starting deploy of {'world': True} to all
[18:14:38] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.87, 9.70, 10.16
[18:14:40] <icinga-miraheze>	 RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.81, 8.99, 9.09
[18:14:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:15:12] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.27, 10.20, 9.93
[18:16:13] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.45, 3.61, 3.72
[18:16:14] <icinga-miraheze>	 RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK
[18:17:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.30, 3.36
[18:17:58] <CosmicAlpha>	 !log DELETE FROM oldimage WHERE oi_archive_name = ''; on zhpolandballwiki
[18:18:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:18:13] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.33, 3.55, 3.69
[18:19:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.57, 3.72, 3.50
[18:19:23] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.00, 11.64, 11.55
[18:21:10] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.22, 10.85, 10.29
[18:21:41] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.30, 3.81, 3.55
[18:22:09] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+1/-0/±1] 13https://github.com/miraheze/mediawiki/compare/60302cd08c74...07d06216450a
[18:22:09] <MirahezeBot>	 [url] Comparing 60302cd08c74...07d06216450a · miraheze/mediawiki · GitHub | github.com
[18:22:10] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega 0307d0621 - Install SemanticScribunto
[18:22:13] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 3.78, 3.73
[18:23:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.23, 3.98, 3.70
[18:23:10] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.46, 11.63, 10.65
[18:23:21] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.60, 11.19, 11.45
[18:23:37] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/3d90a5e4af87
[18:23:38] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega 033d90a5e - add SemanticScribunto to extension-list
[18:23:40] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.51, 3.74, 3.56
[18:23:40] <Not-34e8>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config
[18:23:40] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.35, 2.03, 1.43
[18:23:40] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:23:41] <Not-34e8>	 [02mw-config] 07Universal-Omega opened pull request 03#4690: add SemanticScribunto to extension-list - 13https://github.com/miraheze/mw-config/pull/4690
[18:23:42] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:24:03] <MirahezeLSBot>	 !log [universalomega@mwtask111] finished deploy of {'world': True} to all - SUCCESS in 566s
[18:24:04] <MirahezeLSBot>	 !log [universalomega@mwtask111] starting deploy of {'l10n': True} to all
[18:24:13] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.77, 3.73
[18:24:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:24:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:24:59] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[18:25:04] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.59, 4.15, 3.79
[18:25:09] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.57, 11.41, 10.67
[18:25:39] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 3.72, 3.56
[18:25:44] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.18, 9.61, 10.19
[18:26:54] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/ef05e937e931
[18:26:56] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega 03ef05e93 - Add SemanticScribunto to ManageWikiExtensions
[18:26:57] <Not-34e8>	 [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config
[18:26:58] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:27:12] <Not-34e8>	 [02mw-config] 07Universal-Omega opened pull request 03#4691: T9196: add SemanticScribunto to ManageWikiExtensions - 13https://github.com/miraheze/mw-config/pull/4691
[18:27:12] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:27:27] <MirahezeLSBot>	 !log [universalomega@mwtask111] finished deploy of {'l10n': True} to all - SUCCESS in 202s
[18:27:40] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.95, 1.59
[18:27:50] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:28:13] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.25, 4.17, 3.90
[18:28:32] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[18:28:52] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/07d06216450a...128f957a0ea6
[18:28:53] <MirahezeBot>	 [url] Comparing 07d06216450a...128f957a0ea6 · miraheze/mediawiki · GitHub | github.com
[18:28:54] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega 03128f957 - Update .branches.json
[18:29:11] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/3f16766ba4a8...5c53390d1617
[18:29:11] <MirahezeBot>	 [url] Comparing 3f16766ba4a8...5c53390d1617 · miraheze/mediawiki · GitHub | github.com
[18:29:12] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega 035c53390 - Update .branches.json
[18:29:27] <MirahezeLSBot>	 !log [universalomega@mwtask111] starting deploy of {'world': True, 'extensionlist': True} to all
[18:29:58] <MirahezeLSBot>	 !log [universalomega@test101] starting deploy of {'world': True, 'extensionlist': True} to all
[18:30:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:30:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:31:22] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.84, 3.86, 3.85
[18:31:24] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.82, 3.68, 3.64
[18:31:33] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.38, 12.22, 11.25
[18:31:34] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.56, 1.22, 1.36
[18:33:26] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.96, 3.70, 3.86
[18:33:29] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.40, 11.38, 11.08
[18:33:43] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.46, 11.45, 11.44
[18:33:59] <MirahezeLSBot>	 !log [universalomega@test101] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output.
[18:34:04] <MirahezeLSBot>	 !log [universalomega@mwtask111] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output.
[18:34:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:34:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:35:14] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.22, 2.78, 3.26
[18:35:35] <Not-34e8>	 [02mw-config] 07Universal-Omega closed pull request 03#4691: T9196: add SemanticScribunto to ManageWikiExtensions - 13https://github.com/miraheze/mw-config/pull/4691
[18:35:36] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:35:39] <Not-34e8>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config
[18:35:39] <MirahezeBot>	 ...
[18:35:40] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2
[18:35:46] <Not-34e8>	 [02mw-config] 07Universal-Omega closed pull request 03#4690: add SemanticScribunto to extension-list - 13https://github.com/miraheze/mw-config/pull/4690
[18:35:46] <MirahezeBot>	 ...
[18:35:47] <Not-34e8>	 [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config
[18:35:47] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:35:49] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1
[18:37:16] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/5c53390d1617...316a00cc2710
[18:37:16] <MirahezeBot>	 [url] Comparing 5c53390d1617...316a00cc2710 · miraheze/mediawiki · GitHub | github.com
[18:37:17] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega 03316a00c - Revert "Update .branches.json"
[18:39:06] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega pushed 032 commits to 03REL1_37 [+0/-1/±2] 13https://github.com/miraheze/mediawiki/compare/128f957a0ea6...3c7650182158
[18:39:07] <MirahezeBot>	 [url] Comparing 128f957a0ea6...3c7650182158 · miraheze/mediawiki · GitHub | github.com
[18:39:08] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega 032158d56 - Revert "Update .branches.json"
[18:39:09] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega 033c76501 - Revert "Install SemanticScribunto"
[18:39:25] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.89, 11.35, 11.51
[18:39:43] <MirahezeLSBot>	 !log [universalomega@test101] starting deploy of {'world': True, 'extensionlist': True} to all
[18:39:48] <MirahezeLSBot>	 !log [universalomega@mwtask111] starting deploy of {'world': True, 'extensionlist': True} to all
[18:39:53] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:40:04] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:41:00] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.44, 10.24, 9.94
[18:41:09] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.75, 8.91, 10.07
[18:41:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.31, 3.67, 3.72
[18:42:54] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.99, 9.48, 9.70
[18:43:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.67, 3.56, 3.67
[18:44:52] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.60, 4.05, 3.78
[18:45:01] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.59, 10.05, 10.30
[18:45:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.35, 3.80, 3.74
[18:45:41] <MirahezeLSBot>	 !log [universalomega@mwtask111] finished deploy of {'world': True, 'extensionlist': True} to all - SUCCESS in 352s
[18:45:42] <MirahezeLSBot>	 !log [universalomega@test101] finished deploy of {'world': True, 'extensionlist': True} to all - SUCCESS in 358s
[18:45:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:46:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:46:47] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.55, 3.39, 3.33
[18:46:56] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.83, 9.05, 9.92
[18:47:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.13, 3.40, 3.59
[18:48:42] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.47, 2.97, 3.17
[18:49:16] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega pushed 0350 commits to 03REL1_38 [+6/-0/±251] 13https://github.com/miraheze/mediawiki/compare/316a00cc2710...0cb1d27be4e6
[18:49:17] <MirahezeBot>	 [url] Comparing 316a00cc2710...0cb1d27be4e6 · miraheze/mediawiki · GitHub | github.com
[18:49:18] <Not-34e8>	 [02miraheze/mediawiki] 07Daimona 03c4c7771 - Temporarily undeprecate EditPage::$textbox2
[18:49:19] <Not-34e8>	 [02miraheze/mediawiki] 07umherirrender 03fea0e7f - phan: Remove PhanCompatibleAccessMethodOnTraitDefinition suppression
[18:49:21] <Not-34e8>	 [02miraheze/mediawiki] 07umherirrender 03fcf31f0 - Simplify TransactionManager::pendingWriteQueryDuration
[18:49:22] <Not-34e8>	 [02miraheze/mediawiki] ... and 47 more commits.
[18:50:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.90, 3.79
[18:50:56] <MirahezeLSBot>	 !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True} to all
[18:51:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:52:43] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.99, 10.74, 10.36
[18:52:45] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.94, 12.13, 11.68
[18:53:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.66, 3.90, 3.71
[18:53:25] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.16, 10.05, 9.84
[18:53:52] <Not-34e8>	 [02mediawiki] 07Universal-Omega closed pull request 03#6912: Bump skins/Timeless from `459a98c` to `38af74d` - 13https://github.com/miraheze/mediawiki/pull/6912
[18:53:52] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:53:54] <Not-34e8>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#6912: Bump skins/Timeless from `459a98c` to `38af74d` - 13https://github.com/miraheze/mediawiki/pull/6912#issuecomment-1125320238
[18:53:54] <MirahezeBot>	 [url] Bump skins/Timeless from `459a98c` to `38af74d` by dependabot[bot] · Pull Request #6912 · miraheze/mediawiki · GitHub | github.com
[18:53:55] <Not-34e8>	 [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/skins/Timeless-38af74d - 13https://github.com/miraheze/mediawiki
[18:53:55] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:53:57] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/skins/Timeless-38af74d
[18:54:38] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.36, 10.20, 10.20
[18:54:39] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.59, 11.91, 11.65
[18:54:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.80, 4.01, 3.82
[18:54:54] <Not-34e8>	 [02mediawiki] 07Universal-Omega closed pull request 03#6888: Bump skins/MinervaNeue from `31c45f7` to `3f56c1d` - 13https://github.com/miraheze/mediawiki/pull/6888
[18:54:55] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:54:56] <Not-34e8>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#6888: Bump skins/MinervaNeue from `31c45f7` to `3f56c1d` - 13https://github.com/miraheze/mediawiki/pull/6888#issuecomment-1125321056
[18:54:56] <MirahezeBot>	 [url] Bump skins/MinervaNeue from `31c45f7` to `3f56c1d` by dependabot[bot] · Pull Request #6888 · miraheze/mediawiki · GitHub | github.com
[18:54:57] <Not-34e8>	 [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/skins/MinervaNeue-3f56c1d - 13https://github.com/miraheze/mediawiki
[18:54:58] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:54:59] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/skins/MinervaNeue-3f56c1d
[18:55:12] <MirahezeLSBot>	 !log [universalomega@test101] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output.
[18:55:15] <Not-34e8>	 [02mediawiki] 07Universal-Omega closed pull request 03#6906: Bump skins/MonoBook from `b62b8f2` to `0267402` - 13https://github.com/miraheze/mediawiki/pull/6906
[18:55:16] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:55:17] <Not-34e8>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#6906: Bump skins/MonoBook from `b62b8f2` to `0267402` - 13https://github.com/miraheze/mediawiki/pull/6906#issuecomment-1125321335
[18:55:17] <MirahezeBot>	 [url] Bump skins/MonoBook from `b62b8f2` to `0267402` by dependabot[bot] · Pull Request #6906 · miraheze/mediawiki · GitHub | github.com
[18:55:18] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/skins/MonoBook-0267402
[18:55:19] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.15, 9.99, 9.86
[18:55:20] <Not-34e8>	 [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/skins/MonoBook-0267402 - 13https://github.com/miraheze/mediawiki
[18:55:20] <MirahezeBot>	 ...
[18:55:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.68, 3.63, 3.62
[18:55:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[18:55:34] <Not-34e8>	 [02mediawiki] 07Universal-Omega closed pull request 03#6937: Bump skins/Vector from `3b6e67a` to `0283942` - 13https://github.com/miraheze/mediawiki/pull/6937
[18:55:35] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:55:36] <Not-34e8>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#6937: Bump skins/Vector from `3b6e67a` to `0283942` - 13https://github.com/miraheze/mediawiki/pull/6937#issuecomment-1125321606
[18:55:36] <MirahezeBot>	 [url] Bump skins/Vector from `3b6e67a` to `0283942` by dependabot[bot] · Pull Request #6937 · miraheze/mediawiki · GitHub | github.com
[18:55:37] <Not-34e8>	 [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/skins/Vector-0283942 - 13https://github.com/miraheze/mediawiki
[18:55:38] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[18:55:39] <Not-34e8>	 [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_38/skins/Vector-0283942
[18:56:33] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.80, 12.23, 11.80
[18:57:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.21, 4.09, 3.81
[18:59:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.86, 3.77
[19:00:00] <MirahezeLSBot>	 !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True} to all
[19:00:15] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:00:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.07, 11.03, 10.60
[19:00:45] <icinga-miraheze>	 PROBLEM - mem121 APT on mem121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected.
[19:01:13] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871716469
[19:01:13] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[19:01:28] <Not-34e8>	 [02mw-config] 07Universal-Omega closed pull request 03#4688: remove citation from wgMetadataGenerators for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4688
[19:01:29] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[19:01:30] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/788110989f62...d05c0d416a9f
[19:01:30] <MirahezeBot>	 [url] Comparing 788110989f62...d05c0d416a9f · miraheze/mw-config · GitHub | github.com
[19:01:31] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[19:01:31] <Not-34e8>	 [02miraheze/mw-config] 07ugochimobi 03d05c0d4 - remove citation from wgMetadataGenerators for gratispaideiawiki (#4688)
[19:01:47] <Not-34e8>	 [02mw-config] 07Universal-Omega closed pull request 03#4677: Enable TextExtracts globally + SEO fixes - 13https://github.com/miraheze/mw-config/pull/4677
[19:01:47] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[19:01:48] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/d05c0d416a9f...583b074073ae
[19:01:49] <MirahezeBot>	 [url] Comparing d05c0d416a9f...583b074073ae · miraheze/mw-config · GitHub | github.com
[19:01:50] <Not-34e8>	 [02miraheze/mw-config] 07AgentIsai 03583b074 - Enable TextExtracts globally + SEO fixes (#4677)
[19:02:48] <icinga-miraheze>	 PROBLEM - mem121 APT on mem121 is CRITICAL: APT CRITICAL: 46 packages available for upgrade (5 critical updates).
[19:02:54] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[19:03:40] <MirahezeLSBot>	 !log [universalomega@test101] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output.
[19:03:48] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:03:52] <MirahezeLSBot>	 !log [universalomega@mwtask111] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php textextracts (START)
[19:03:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:04:10] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.97, 11.96, 11.86
[19:04:37] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.81, 9.74, 10.16
[19:04:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.40, 3.21, 3.54
[19:04:56] <MirahezeLSBot>	 !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True} to all
[19:05:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:06:44] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.25, 2.93, 3.40
[19:07:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.11, 3.63, 3.59
[19:08:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[19:09:14] <MirahezeLSBot>	 !log [universalomega@test101] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output.
[19:09:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.09, 3.42, 3.51
[19:09:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:10:18] <MirahezeLSBot>	 !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True} to all
[19:10:30] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:10:58] <CosmicAlpha>	 !log sudo -u www-data http_proxy=http://bast.miraheze.org:8080 composer install --no-dev on test101
[19:11:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:11:54] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.54, 11.85, 11.77
[19:12:55] <icinga-miraheze>	 PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 3.59, 3.33, 2.90
[19:13:54] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.66, 11.35, 11.60
[19:14:38] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.03, 3.41, 3.16
[19:14:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.68, 3.83, 3.60
[19:16:04] <icinga-miraheze>	 PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query.
[19:16:33] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.46, 3.21
[19:16:34] <icinga-miraheze>	 PROBLEM - test101 MediaWiki Rendering on test101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[19:16:51] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/583b074073ae...25f9adbd73e3
[19:16:51] <MirahezeBot>	 [url] Comparing 583b074073ae...25f9adbd73e3 · miraheze/mw-config · GitHub | github.com
[19:16:52] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega 0325f9adb - fix
[19:17:54] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.24, 11.95, 11.77
[19:17:59] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[19:18:28] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.78, 3.23, 3.16
[19:18:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.51, 11.05, 10.37
[19:18:55] <icinga-miraheze>	 RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 3.24, 3.37, 3.08
[19:19:04] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.58, 10.31, 9.77
[19:20:01] <MirahezeLSBot>	 !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True} to all
[19:20:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:20:35] <MirahezeLSBot>	 !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 34s
[19:20:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:21:03] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.86, 9.69, 9.63
[19:22:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.47, 3.91, 3.82
[19:22:49] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 4.01, 2.20, 1.46
[19:22:55] <icinga-miraheze>	 PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 4.10, 3.70, 3.28
[19:23:22] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.32, 3.05, 3.38
[19:24:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.52, 11.88, 11.02
[19:24:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.06, 4.00, 3.84
[19:24:49] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.97, 1.75, 1.39
[19:25:50] <MirahezeLSBot>	 !log [@mwtask111] starting deploy of {'config': True} to all
[19:26:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:26:07] <MirahezeLSBot>	 !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 17s
[19:26:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:26:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.72, 3.44, 3.65
[19:28:26] <CosmicAlpha>	 !log screen -ls | grep Detached | cut -d. -f1 | awk '{print $1}' | xargs kill on mwtask111
[19:28:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.82, 12.18, 11.33
[19:28:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:30:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.13, 11.78, 11.30
[19:30:49] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.48, 1.52, 1.38
[19:30:55] <icinga-miraheze>	 PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 2.62, 3.53, 3.48
[19:31:42] <icinga-miraheze>	 PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.96, 10.88, 9.74
[19:32:55] <icinga-miraheze>	 RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 2.24, 3.11, 3.33
[19:33:36] <icinga-miraheze>	 RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.91, 10.11, 9.60
[19:33:50] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.48, 3.46, 3.15
[19:34:11] <MirahezeLSBot>	 !log [universalomega@test101] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 1433s
[19:34:24] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:34:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.86, 4.43, 3.94
[19:34:51] <icinga-miraheze>	 PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.97, 10.05, 9.08
[19:35:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.50, 3.47, 3.41
[19:35:24] <icinga-miraheze>	 RECOVERY - test101 MediaWiki Rendering on test101 is OK: HTTP OK: HTTP/1.1 200 OK - 52095 bytes in 9.691 second response time
[19:35:45] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.33, 3.13
[19:36:35] <CosmicAlpha>	 !log upgrade and reboot test101
[19:36:47] <icinga-miraheze>	 RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.48, 9.03, 8.83
[19:36:50] <icinga-miraheze>	 RECOVERY - test101 APT on test101 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[19:36:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:37:16] <icinga-miraheze>	 PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.79, 0.55, 0.19
[19:37:40] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.21, 3.00, 3.04
[19:39:15] <icinga-miraheze>	 RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.38, 0.80, 0.33
[19:39:16] <icinga-miraheze>	 PROBLEM - test101 Check Gluster Clients on test101 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs'
[19:39:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.52, 3.64, 3.48
[19:39:35] <icinga-miraheze>	 RECOVERY - mw101 APT on mw101 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[19:40:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.86, 3.91, 3.90
[19:40:53] <icinga-miraheze>	 PROBLEM - test101 APT on test101 is CRITICAL: APT CRITICAL: 1 packages available for upgrade (1 critical updates).
[19:41:20] <RhinosF1>	 CosmicAlpha: has toggle extension not finished yet?
[19:41:22] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.62, 3.15, 3.31
[19:41:39] <RhinosF1>	 90 minutes is a long time
[19:42:34] <CosmicAlpha>	 !log upgrade, depool, reboot, and than repool mw101
[19:42:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.84, 11.42, 11.09
[19:42:39] <icinga-miraheze>	 PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.44, 10.47, 9.44
[19:43:06] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:43:15] <CosmicAlpha>	 RhinosF1: no, still running, It always takes a long time for that though. It's on 'm'.
[19:43:32] <RhinosF1>	 CosmicAlpha: hmm
[19:43:49] <RhinosF1>	 It should help when we drop the long closed batch
[19:44:16] <RhinosF1>	 I wonder if we could make it run more than 1 wiki at once
[19:44:36] <icinga-miraheze>	 RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.69, 9.76, 9.30
[19:44:37] <icinga-miraheze>	 PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.99, 11.47, 11.15
[19:44:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.36, 4.15, 3.95
[19:44:57] <icinga-miraheze>	 PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.64, 10.49, 9.20
[19:44:57] <CosmicAlpha>	 !log upgrade and reboot test101 (again!)
[19:45:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:45:18] <icinga-miraheze>	 PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in <module> main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l
[19:45:18] <icinga-miraheze>	 n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL
[19:45:21] <icinga-miraheze>	 RECOVERY - test101 APT on test101 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[19:45:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.40, 3.85, 3.54
[19:46:57] <icinga-miraheze>	 RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.18, 9.82, 9.13
[19:48:37] <icinga-miraheze>	 RECOVERY - mw102 APT on mw102 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[19:48:56] <CosmicAlpha>	 !log upgrade, depool, reboot, and than repool mw102
[19:49:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:50:13] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.42, 3.21
[19:51:54] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.47, 11.20, 11.82
[19:52:53] <Not-34e8>	 [02mw-config] 07ugochimobi reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871756845
[19:52:54] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[19:54:04] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 4.07, 3.52
[19:55:39] <icinga-miraheze>	 RECOVERY - mw111 APT on mw111 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[19:55:41] <CosmicAlpha>	 !log upgrade, depool, reboot, and then repool mw111
[19:55:53] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:55:54] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.87, 1.64, 0.56
[19:55:59] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.22, 3.50, 3.39
[19:56:57] <icinga-miraheze>	 RECOVERY - mw112 APT on mw112 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[19:58:36] <CosmicAlpha>	 !log upgrade, depool, reboot, and then repool mw112
[19:58:37] <icinga-miraheze>	 RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 4.76, 1.22, 0.41
[19:58:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:59:49] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 4.09, 3.66
[19:59:57] <CosmicAlpha>	 !log mount /mnt/mediawiki-static on test101
[20:00:03] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:01:16] <icinga-miraheze>	 RECOVERY - test101 Check Gluster Clients on test101 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs'
[20:01:44] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.18, 3.99, 3.69
[20:02:19] <icinga-miraheze>	 RECOVERY - mw121 APT on mw121 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[20:03:07] <CosmicAlpha>	 !log upgrade, depool, reboot, and then repool mw121
[20:03:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:03:39] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.19, 4.11, 3.77
[20:03:54] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.98, 9.02, 4.79
[20:05:38] <CosmicAlpha>	 !log upgrade, depool, reboot, and then repool mw122
[20:05:43] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:07:33] <icinga-miraheze>	 RECOVERY - mw122 APT on mw122 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[20:08:49] <icinga-miraheze>	 PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw122
[20:09:20] <icinga-miraheze>	 PROBLEM - cp21 Varnish Backends on cp21 is CRITICAL: 1 backends are down. mw122
[20:09:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.39, 3.90, 3.81
[20:10:48] <icinga-miraheze>	 RECOVERY - cp31 Varnish Backends on cp31 is OK: All 12 backends are healthy
[20:11:19] <icinga-miraheze>	 RECOVERY - cp21 Varnish Backends on cp21 is OK: All 12 backends are healthy
[20:11:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.61, 4.18, 3.90
[20:11:54] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.33, 9.91, 7.16
[20:13:14] <MirahezeLSBot>	 !log [universalomega@mwtask111] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/extensions/ManageWiki/maintenance/toggleExtension.php textextracts (END - exit=0)
[20:13:21] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:14:12] <CosmicAlpha>	 !log upgrade and reboot mwtask111
[20:14:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:14:31] <icinga-miraheze>	 RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK
[20:15:04] <icinga-miraheze>	 RECOVERY - mwtask111 APT on mwtask111 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[20:17:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.75, 3.86, 3.89
[20:17:47] <icinga-miraheze>	 PROBLEM - mwtask111 Check Gluster Clients on mwtask111 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs'
[20:18:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[20:18:51] <CosmicAlpha>	 !log mount /mnt/mediawiki-static on mwtask111
[20:18:59] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:19:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.08, 3.90, 3.90
[20:19:47] <icinga-miraheze>	 RECOVERY - mwtask111 Check Gluster Clients on mwtask111 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs'
[20:21:06] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.16, 1.71, 1.41
[20:21:48] <CosmicAlpha>	 !log sudo apt upgrade on jobchron121 (upgrades kernel to 5.10.0-14-amd64 (+49 other packages))
[20:21:52] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:23:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[20:23:01] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.50, 1.25, 1.27
[20:24:04] <icinga-miraheze>	 RECOVERY - jobchron121 APT on jobchron121 is OK: APT OK: 0 packages available for upgrade (0 critical updates).
[20:25:19] <CosmicAlpha>	 !log reboot jobchron121
[20:25:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:26:40] <icinga-miraheze>	 PROBLEM - mw102 JobRunner Service on mw102 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService'
[20:27:26] <icinga-miraheze>	 PROBLEM - mw112 JobRunner Service on mw112 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService'
[20:27:44] <RhinosF1>	 Hmm
[20:28:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[20:28:16] <icinga-miraheze>	 PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.14, 2.22, 1.37
[20:28:39] <icinga-miraheze>	 RECOVERY - mw102 JobRunner Service on mw102 is OK: PROCS OK: 1 process with args 'redisJobRunnerService'
[20:28:54] <CosmicAlpha>	 !log sudo service jobrunner restart on mw*, mwtask111, and test101
[20:29:00] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:29:26] <icinga-miraheze>	 RECOVERY - mw112 JobRunner Service on mw112 is OK: PROCS OK: 1 process with args 'redisJobRunnerService'
[20:30:16] <icinga-miraheze>	 PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.31, 1.86, 1.34
[20:30:57] <CosmicAlpha>	 RhinosF1: ^ fixed that.  Had to restart jobrunner after rebooting jobchron121.
[20:31:18] <RhinosF1>	 CosmicAlpha: okay
[20:31:48] <RhinosF1>	 CosmicAlpha: test shouldn't have needed a restart though
[20:31:58] <RhinosF1>	 It doesn't use jobchron
[20:32:15] <icinga-miraheze>	 RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.71, 1.45, 1.26
[20:32:39] <CosmicAlpha>	 RhinosF1: I just did it on all, but true yeah it didn't need it I guess.
[20:33:58] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871786108
[20:33:58] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[20:37:28] <MirahezeLSBot>	 !log [universalomega@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/recountCategories.php --wiki=criticalrolewiki --mode=subcats (END - exit=0)
[20:37:34] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:37:41] <RhinosF1>	 CosmicAlpha: we should probably do something about jobchron not being redundant on prod
[20:37:49] <MirahezeLSBot>	 !log [universalomega@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/recountCategories.php --wiki=criticalrolewiki --mode=files (END - exit=0)
[20:37:54] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:38:26] <MirahezeLSBot>	 !log [universalomega@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/recountCategories.php --wiki=criticalrolewiki --mode=pages (END - exit=0)
[20:38:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:40:11] <MirahezeLSBot>	 !log [universalomega@mwtask111] sudo -u www-data php /srv/mediawiki/w/maintenance/cleanupEmptyCategories.php --wiki=criticalrolewiki --mode=remove (END - exit=0)
[20:40:25] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[20:41:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[20:49:05] <Not-34e8>	 [02mw-config] 07ugochimobi synchronize pull request 03#4689: Set meta tags on entity pages gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4689
[20:49:06] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[20:50:13] <miraheze-github>	 miraheze/mw-config - ugochimobi the build passed.
[20:50:25] <Not-34e8>	 [02mw-config] 07ugochimobi reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871797933
[20:50:26] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[20:51:33] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871798772
[20:51:34] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[20:51:34] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871799078
[20:51:35] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[20:51:36] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871798690
[20:51:36] <MirahezeBot>	 ...
[20:51:37] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871799223
[20:51:38] <MirahezeBot>	 ...
[20:51:39] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871798954
[20:51:39] <MirahezeBot>	 ...
[20:51:40] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871798616
[20:51:41] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[20:52:49] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.79, 1.61, 1.34
[20:54:49] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.67, 1.62, 1.37
[20:56:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[20:56:20] <Not-34e8>	 [02mw-config] 07ugochimobi reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871803152
[20:56:21] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[21:00:46] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871806171
[21:00:46] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[21:01:53] <Not-34e8>	 [02mw-config] 07ugochimobi reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871807111
[21:03:31] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[21:03:55] <Not-34e8>	 [02mw-config] 07ugochimobi synchronize pull request 03#4689: Set meta tags on entity pages gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4689
[21:03:55] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[21:04:14] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.36, 10.12, 9.46
[21:05:09] <miraheze-github>	 miraheze/mw-config - ugochimobi the build passed.
[21:06:08] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.09, 10.93, 9.83
[21:08:02] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.89, 10.18, 9.67
[21:08:31] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[21:09:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.67, 3.19, 3.84
[21:09:23] <Not-34e8>	 [02mw-config] 07ugochimobi reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871812120
[21:09:24] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[21:09:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.03, 3.49, 4.00
[21:10:18] <Not-34e8>	 [02mw-config] 07Universal-Omega closed pull request 03#4689: Set meta tags on entity pages gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4689
[21:10:19] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[21:10:20] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/25f9adbd73e3...2a00a0717902
[21:10:20] <MirahezeBot>	 [url] Comparing 25f9adbd73e3...2a00a0717902 · miraheze/mw-config · GitHub | github.com
[21:10:21] <Not-34e8>	 [02miraheze/mw-config] 07ugochimobi 032a00a07 - Set meta tags on entity pages gratisdatawiki (#4689)
[21:10:40] <MirahezeLSBot>	 !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all
[21:10:45] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:10:57] <MirahezeLSBot>	 !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 17s
[21:11:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:11:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.10, 3.22, 3.75
[21:11:42] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[21:13:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.30, 3.27, 3.70
[21:13:37] <Not-34e8>	 [02mw-config] 07Universal-Omega reviewed pull request 03#4678 commit - 13https://github.com/miraheze/mw-config/pull/4678#discussion_r871814876
[21:13:37] <MirahezeBot>	 [url] setup entitySources for gratisdatawiki and co by ugochimobi · Pull Request #4678 · miraheze/mw-config · GitHub | github.com
[21:15:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 3.54, 3.74
[21:17:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.92, 3.55, 3.71
[21:19:02] <MirahezeLSBot>	 !log [@test101] starting deploy of {'config': True} to all
[21:19:03] <MirahezeLSBot>	 !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s
[21:19:08] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:19:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[21:19:58] <Not-34e8>	 [02mw-config] 07ugochimobi synchronize pull request 03#4678: setup entitySources for gratisdatawiki and co - 13https://github.com/miraheze/mw-config/pull/4678
[21:19:59] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[21:20:27] <Not-34e8>	 [02mw-config] 07ugochimobi reviewed pull request 03#4678 commit - 13https://github.com/miraheze/mw-config/pull/4678#discussion_r871819079
[21:20:28] <MirahezeBot>	 [url] setup entitySources for gratisdatawiki and co by ugochimobi · Pull Request #4678 · miraheze/mw-config · GitHub | github.com
[21:21:08] <miraheze-github>	 miraheze/mw-config - ugochimobi the build passed.
[21:21:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.72, 4.66, 4.03
[21:21:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.71, 3.71, 3.69
[21:23:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.88, 3.69, 3.68
[21:25:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.63, 3.83, 3.86
[21:27:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.16, 4.03, 3.93
[21:28:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.54, 3.53, 3.96
[21:29:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.38, 3.65, 3.79
[21:31:37] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.50, 2.93, 3.36
[21:34:54] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.08, 10.10, 9.44
[21:36:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.17, 3.48, 3.71
[21:36:48] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.90, 9.97, 9.47
[21:37:22] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.52, 2.90, 3.39
[21:37:55] <Not-34e8>	 [02mw-config] 07ugochimobi reviewed pull request 03#4689 commit - 13https://github.com/miraheze/mw-config/pull/4689#discussion_r871829895
[21:37:56] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[21:38:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[21:38:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.09, 2.96, 3.49
[21:39:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.12, 3.23
[21:40:36] <icinga-miraheze>	 PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.54, 9.32, 8.38
[21:40:37] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.18, 10.33, 9.75
[21:40:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 3.35, 3.56
[21:41:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.67, 3.76, 3.47
[21:41:54] <icinga-miraheze>	 PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2]
[21:42:31] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.72, 9.85, 9.65
[21:42:35] <icinga-miraheze>	 RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.41, 9.08, 8.42
[21:42:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.81, 3.51, 3.59
[21:43:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.96, 3.45, 3.38
[21:44:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.73, 4.20, 3.83
[21:45:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.99, 4.35, 3.71
[21:47:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 3.99, 4.08, 3.73
[21:47:58] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 6.33, 3.58, 2.11
[21:49:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.34, 3.81, 3.67
[21:49:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.21, 3.64, 3.55
[21:54:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.21, 3.53, 3.86
[21:55:22] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.79, 2.76, 3.29
[21:57:34] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.24, 1.74, 1.83
[21:58:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[21:59:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.55, 3.24, 3.36
[22:01:24] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.61, 2.06, 1.93
[22:01:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.14, 3.82, 3.63
[22:03:19] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.36, 1.75, 1.83
[22:03:22] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.25, 3.30, 3.37
[22:03:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.30, 3.43, 3.52
[22:05:15] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.06, 1.98, 1.90
[22:07:10] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.82, 1.55, 1.76
[22:09:05] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.84, 1.40, 1.68
[22:09:37] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.14, 3.17, 3.40
[22:09:54] <icinga-miraheze>	 RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 26 seconds ago with 0 failures
[22:14:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.09, 3.94, 3.69
[22:16:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.86, 3.69
[22:18:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.39, 4.18, 3.84
[22:22:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.76, 3.90, 3.85
[22:24:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.06, 4.86, 4.18
[22:29:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.48, 3.13, 2.99
[22:31:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.87, 3.56, 3.15
[22:32:45] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03revert-4689-patch-75 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/3ff9b6b18323
[22:32:46] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega 033ff9b6b - Revert "Set meta tags on entity pages gratisdatawiki (#4689)"
[22:32:48] <Not-34e8>	 [02mw-config] 07Universal-Omega created branch 03revert-4689-patch-75 - 13https://github.com/miraheze/mw-config
[22:32:48] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[22:32:50] <Not-34e8>	 [02mw-config] 07Universal-Omega opened pull request 03#4692: Revert "Set meta tags on entity pages gratisdatawiki" - 13https://github.com/miraheze/mw-config/pull/4692
[22:32:51] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[22:33:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.53, 3.21, 3.06
[22:33:55] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[22:34:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.70, 3.81, 3.97
[22:35:14] <Not-34e8>	 [02mw-config] 07Universal-Omega commented on pull request 03#4689: Set meta tags on entity pages gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4689#issuecomment-1125479673
[22:35:15] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[22:35:27] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.49, 1.77, 1.51
[22:35:37] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.99, 3.00, 2.99
[22:37:22] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.06, 1.96, 1.62
[22:37:52] <Not-34e8>	 [02mw-config] 07Universal-Omega edited pull request 03#4692: Revert "Set meta tags on entity pages gratisdatawiki" - 13https://github.com/miraheze/mw-config/pull/4692
[22:37:52] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[22:37:54] <Not-34e8>	 [02mw-config] 07Universal-Omega closed pull request 03#4692: Revert "Set meta tags on entity pages gratisdatawiki" - 13https://github.com/miraheze/mw-config/pull/4692
[22:37:54] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[22:37:55] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2a00a0717902...9c0da0770a66
[22:37:56] <MirahezeBot>	 [url] Comparing 2a00a0717902...9c0da0770a66 · miraheze/mw-config · GitHub | github.com
[22:37:57] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega 039c0da07 - Revert "Set meta tags on entity pages gratisdatawiki (#4689)" (#4692)
[22:37:58] <Not-34e8>	 [02mw-config] 07Universal-Omega deleted branch 03revert-4689-patch-75 - 13https://github.com/miraheze/mw-config
[22:37:59] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[22:38:00] <Not-34e8>	 [02miraheze/mw-config] 07Universal-Omega deleted branch 03revert-4689-patch-75
[22:38:58] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[22:39:17] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.67, 1.89, 1.63
[22:43:07] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.56, 1.61, 1.57
[22:43:54] <Not-34e8>	 [02mw-config] 07ugochimobi commented on pull request 03#4689: Set meta tags on entity pages gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4689#issuecomment-1125484239
[22:43:55] <MirahezeBot>	 [url] Set meta tags on entity pages gratisdatawiki by ugochimobi · Pull Request #4689 · miraheze/mw-config · GitHub | github.com
[22:44:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.70, 4.03, 3.79
[22:47:20] <Not-34e8>	 [02puppet] 07Universal-Omega opened pull request 03#2535: deploy-mediawiki: use http_proxy for composer - 13https://github.com/miraheze/puppet/pull/2535
[22:47:21] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[22:47:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.47, 3.17
[22:48:14] <MirahezeLSBot>	 !log [@test101] starting deploy of {'config': True} to all
[22:48:15] <MirahezeLSBot>	 !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s
[22:48:20] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:48:26] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:48:28] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.85, 3.47, 3.22
[22:49:37] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.35, 3.37, 3.17
[22:50:01] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[22:52:09] <MirahezeLSBot>	 !log [@mwtask111] starting deploy of {'config': True} to all
[22:52:18] <MirahezeLSBot>	 !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 9s
[22:52:19] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:52:23] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.09, 4.40, 3.62
[22:52:29] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[22:53:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 4.07, 3.50
[22:55:37] <icinga-miraheze>	 PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.23, 1.88, 1.66
[22:57:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.56, 3.99, 3.63
[22:59:27] <icinga-miraheze>	 RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.87, 1.59, 1.61
[22:59:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.43, 4.38, 3.82
[23:00:01] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[23:00:02] <MirahezeLSBot>	 !log [@test101] starting deploy of {'l10nupdate': True} to all
[23:00:03] <MirahezeLSBot>	 !log [@mwtask111] starting deploy of {'l10nupdate': True} to all
[23:00:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:00:13] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:03:37] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.62, 3.58, 3.64
[23:04:08] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.27, 3.49, 3.81
[23:06:06] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.42, 3.61, 3.80
[23:08:03] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.02, 3.39, 3.70
[23:09:37] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.34, 2.84, 3.34
[23:11:58] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.07, 2.91, 3.40
[23:13:59] <MirahezeLSBot>	 !log [@test101] finished deploy of {'l10nupdate': True} to all - SUCCESS in 837s
[23:14:05] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:15:38] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ssl/commit/adaa0fa77748
[23:15:40] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 03adaa0fa - add evil.wiki cert
[23:15:41] <Not-34e8>	 [02ssl] 07MacFan4000 created branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl
[23:15:42] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[23:15:51] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.45, 3.48, 3.54
[23:18:56] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/adaa0fa77748...332e5379a5c5
[23:18:56] <MirahezeBot>	 [url] Comparing adaa0fa77748...332e5379a5c5 · miraheze/ssl · GitHub | github.com
[23:18:57] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 03332e537 - Update certs.yaml
[23:19:17] <Not-34e8>	 [02ssl] 07MacFan4000 opened pull request 03#516: add evil.wiki cert - 13https://github.com/miraheze/ssl/pull/516
[23:19:17] <MirahezeBot>	 ...
[23:19:46] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.43, 3.12, 3.39
[23:20:43] <icinga-miraheze>	 PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.57, 10.12, 9.30
[23:20:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.63, 3.63, 3.98
[23:22:21] <Not-34e8>	 [02ssl] 07MacFan4000 closed pull request 03#516: add evil.wiki cert - 13https://github.com/miraheze/ssl/pull/516
[23:22:21] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[23:22:22] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/bac8e97c996e...b64071a91f5c
[23:22:23] <MirahezeBot>	 [url] Comparing bac8e97c996e...b64071a91f5c · miraheze/ssl · GitHub | github.com
[23:22:24] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 03b64071a - add evil.wiki cert (#516)
[23:22:25] <Not-34e8>	 [02ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl
[23:22:26] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[23:22:27] <Not-34e8>	 [02miraheze/ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1
[23:22:37] <icinga-miraheze>	 RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.62, 10.06, 9.41
[23:23:39] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.89, 3.43, 3.48
[23:26:04] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[23:26:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.43, 3.73, 3.87
[23:26:49] <MirahezeLSBot>	 !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 1607s
[23:26:56] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:28:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.06, 3.50, 3.78
[23:30:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.13, 3.70, 3.81
[23:31:04] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[23:33:26] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.42, 4.18, 3.81
[23:34:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.75, 3.82
[23:35:17] <icinga-miraheze>	 PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.98, 3.73, 3.42
[23:35:24] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.29, 3.64, 3.65
[23:36:06] <Not-34e8>	 [02puppet] 07Universal-Omega opened pull request 03#2536: Enable shellbox on test101 - 13https://github.com/miraheze/puppet/pull/2536
[23:36:07] <MirahezeBot>	 [url] Page not found · GitHub · GitHub | github.com
[23:37:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.97, 3.79, 3.68
[23:38:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.60, 4.16, 3.95
[23:41:02] <icinga-miraheze>	 RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.13, 3.18, 3.32
[23:41:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.54, 3.72, 3.69
[23:42:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.72, 3.98, 3.92
[23:43:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.05, 3.68, 3.66
[23:44:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.11, 4.24, 4.04
[23:45:22] <icinga-miraheze>	 PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.35, 3.16, 3.47
[23:46:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.86, 3.91
[23:49:22] <icinga-miraheze>	 RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.30, 2.94, 3.33
[23:54:44] <icinga-miraheze>	 PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.32, 3.21, 3.52
[23:56:44] <icinga-miraheze>	 RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.73, 2.93, 3.38