[00:01:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.76, 3.96, 3.72 [00:01:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.25, 9.22, 8.99 [00:01:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.94, 9.15, 8.68 [00:02:52] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle. [00:02:53] RECOVERY - cp30 Disk Space on cp30 is OK: DISK OK - free space: / 6010 MB (15% inode=96%); [00:03:06] RECOVERY - matomo101 Disk Space on matomo101 is OK: DISK OK - free space: / 1785 MB (18% inode=80%); [00:03:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.17, 4.01, 3.76 [00:03:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.50, 9.48, 8.88 [00:03:54] RECOVERY - cp31 Disk Space on cp31 is OK: DISK OK - free space: / 8751 MB (22% inode=96%); [00:05:26] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [00:05:36] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.43, 9.12, 8.27 [00:06:28] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.81, 3.62, 3.27 [00:06:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.18, 3.70, 3.25 [00:07:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.57, 9.07, 9.01 [00:07:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.70, 3.95, 3.81 [00:07:31] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.34, 8.22, 8.05 [00:08:26] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.18, 3.40, 3.23 [00:09:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.92, 4.45, 4.02 [00:10:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.72, 4.40, 3.58 [00:11:06] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.46, 7.91, 8.38 [00:11:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.10, 8.67, 8.91 [00:12:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.93, 3.51 [00:13:18] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.98, 9.33, 8.49 [00:13:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.66, 3.51, 3.73 [00:15:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.21, 7.62, 8.41 [00:15:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.37, 3.71, 3.77 [00:16:31] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.70, 4.20, 3.66 [00:17:09] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.02, 9.55, 8.81 [00:17:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.13, 3.31, 3.63 [00:17:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.82, 9.15, 8.96 [00:18:31] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.55, 3.48 [00:19:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.70, 2.79, 3.40 [00:20:31] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.55, 3.26, 3.39 [00:21:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.59, 9.49, 9.19 [00:22:02] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.86, 8.49, 7.48 [00:23:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.67, 10.46, 9.59 [00:23:57] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.80, 8.03, 7.42 [00:24:50] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.36, 9.38, 8.92 [00:26:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:26:46] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.79, 8.90, 8.79 [00:27:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.29, 9.01, 8.45 [00:27:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.20, 9.74, 9.50 [00:29:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.52, 9.04, 8.53 [00:29:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.69, 10.47, 9.80 [00:31:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:31:34] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.59, 9.87, 8.89 [00:32:52] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:33:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.81, 10.02, 9.06 [00:33:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.49, 9.54, 9.58 [00:33:31] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.77, 9.67, 8.92 [00:34:27] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.68, 9.56, 9.02 [00:36:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.09, 9.47, 9.06 [00:37:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.45, 9.58, 9.13 [00:37:24] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.60, 9.72, 9.08 [00:37:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.91, 10.44, 9.91 [00:39:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.83, 9.94, 9.78 [00:45:09] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.85, 9.92, 9.59 [00:46:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:47:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.98, 7.51, 8.38 [00:49:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.89, 10.54, 9.93 [00:52:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:53:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.70, 9.91, 9.85 [00:55:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.45, 10.16, 9.94 [00:59:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.83, 9.44, 9.74 [01:01:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.11, 9.85, 9.86 [01:04:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.63, 10.07, 9.40 [01:05:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.23, 9.97, 9.96 [01:08:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.05, 9.68, 9.43 [01:10:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.57, 9.76, 9.48 [01:12:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.47, 9.57, 9.44 [01:12:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:13:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.12, 9.25, 9.54 [01:14:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.58, 7.61, 8.26 [01:15:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.39, 8.69, 9.28 [01:18:17] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.28, 9.06, 8.61 [01:19:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.51, 9.98, 9.65 [01:19:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:20:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.66, 8.50, 8.46 [01:21:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.57, 9.49, 9.52 [01:22:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.98, 8.90, 9.05 [01:24:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.26, 8.74, 8.99 [01:27:55] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.13, 9.36, 8.68 [01:29:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:29:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.30, 8.83, 8.56 [01:31:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.21, 9.51, 9.24 [01:33:27] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.57, 9.32, 9.22 [01:33:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.23, 8.45, 8.47 [01:36:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:38:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.18, 8.00, 8.49 [01:41:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.13, 8.82, 8.82 [01:41:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:43:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.55, 7.95, 8.50 [01:46:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:47:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.61, 9.09, 8.82 [01:51:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:55:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.82, 9.53, 9.25 [01:59:47] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.49, 8.77, 8.39 [02:01:43] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.13, 7.87, 8.11 [02:02:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.01, 8.32, 7.54 [02:03:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.12, 8.93, 8.95 [02:04:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:05:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.62, 8.57, 8.81 [02:05:34] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.00, 9.09, 8.51 [02:05:55] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.29, 8.55, 8.23 [02:06:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.04, 7.76, 7.53 [02:07:30] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.43, 8.09, 8.19 [02:07:50] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.10, 7.72, 7.97 [02:11:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.63, 8.75, 8.40 [02:13:20] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.41, 7.56, 8.01 [02:13:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.08, 7.74, 8.31 [02:19:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:21:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.83, 8.03, 7.92 [02:21:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.08, 8.86, 8.46 [02:22:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.72, 7.70, 7.83 [02:23:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.85, 8.65, 8.45 [02:25:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:26:53] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.08, 9.58, 8.47 [02:28:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.36, 9.24, 8.47 [02:29:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.41, 8.72, 8.13 [02:30:40] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.28, 8.98, 8.33 [02:31:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.20, 7.86, 7.89 [02:31:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.78, 9.46, 8.90 [02:32:45] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.26, 8.35, 8.26 [02:32:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.85, 7.41, 6.87 [02:34:31] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.82, 9.35, 8.58 [02:34:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.67, 7.35, 6.91 [02:35:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.92, 8.81, 8.33 [02:35:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.38, 9.00, 8.91 [02:36:26] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.87, 9.45, 8.71 [02:39:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.91, 9.24, 8.97 [02:39:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.98, 9.50, 8.80 [02:40:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:41:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.97, 9.40, 9.06 [02:41:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.42, 10.17, 9.12 [02:42:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.17, 9.48, 8.93 [02:43:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.90, 8.34, 8.34 [02:43:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.75, 10.45, 9.51 [02:43:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:43:33] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.58, 9.90, 9.15 [02:44:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.54, 9.32, 8.96 [02:45:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.92, 9.69, 9.33 [02:45:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.25, 10.24, 9.35 [02:47:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.27, 10.54, 9.67 [02:47:25] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.15, 8.80, 8.94 [02:51:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.71, 9.07, 8.55 [02:53:15] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.43, 7.33, 8.35 [02:53:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.03, 10.00, 9.84 [02:55:08] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.03, 9.11, 8.65 [02:55:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 9.50, 10.05, 9.89 [02:57:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.84, 9.60, 8.91 [02:57:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.49, 9.99, 9.90 [03:02:50] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.18, 1.77, 1.36 [03:03:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.30, 7.87, 8.39 [03:03:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:04:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.90, 9.25, 9.06 [03:04:47] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.89, 3.64, 3.24 [03:04:50] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.65, 1.44, 1.29 [03:06:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.40, 8.70, 8.87 [03:07:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.94, 8.47, 8.46 [03:08:25] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.03, 9.03, 8.97 [03:08:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:08:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.14, 3.16, 3.16 [03:09:48] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.58, 8.10, 8.32 [03:10:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.67, 8.43, 8.75 [03:11:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.07, 7.17, 8.43 [03:12:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 5.47, 7.58, 8.42 [03:13:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:19:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.62, 9.30, 8.74 [03:20:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:21:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.63, 9.05, 8.70 [03:25:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:32:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.95, 8.46, 7.27 [03:33:02] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.46, 2.06, 1.50 [03:33:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.68, 7.93, 8.39 [03:34:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.35, 7.82, 7.20 [03:34:59] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.60, 1.55, 1.38 [03:35:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.21, 1.72, 1.40 [03:36:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.79, 8.61, 8.03 [03:37:18] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.46, 1.34 [03:37:21] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [03:37:22] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:38:11] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.43, 8.13, 7.92 [03:40:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:45:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:52:16] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.02, 8.91, 8.37 [03:52:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:54:11] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.30, 8.42, 8.26 [03:56:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.42, 9.05, 8.38 [03:58:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.74, 8.34, 8.21 [04:07:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:13:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:18:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:27:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:28:22] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.54, 8.68, 7.92 [04:30:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.18, 7.93, 7.74 [04:36:04] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [04:36:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.71, 9.93, 8.58 [04:37:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:38:03] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.02, 9.74, 8.68 [04:38:20] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.02, 8.48, 7.89 [04:40:16] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.64, 7.80, 7.71 [04:41:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:45:44] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.27, 8.23, 8.43 [04:46:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:51:47] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.96, 8.63, 8.13 [04:52:27] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 2.00, 1.92, 1.24 [04:53:42] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.27, 7.77, 7.88 [04:54:27] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.62, 1.43, 1.14 [04:56:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:02:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.65, 8.47, 8.22 [05:05:58] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.12, 7.69, 8.01 [05:06:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:19:05] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.36, 1.60, 1.32 [05:21:03] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.47, 1.31 [05:27:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.75, 8.10, 7.79 [05:27:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:29:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.89, 7.84, 7.72 [05:32:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:37:22] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [05:37:22] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:50:16] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.97, 7.71, 7.14 [05:50:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:52:11] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.80, 7.42, 7.11 [06:00:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:00:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.16, 2.22, 1.55 [06:02:50] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.99, 1.83, 1.49 [06:04:50] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.87, 1.47, 1.39 [06:06:43] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [06:07:15] [02miraheze/.github] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/.github/compare/d230f34bdc88...78dc6c4cd31d [06:07:16] [02miraheze/.github] 07Universal-Omega 0378dc6c4 - Add REL1_38 to CI [06:07:35] [02miraheze/GlobalNewFiles] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/GlobalNewFiles/compare/0075232a3bfd...2e26ec34f0a1 [06:07:36] [02miraheze/GlobalNewFiles] 07Universal-Omega 032e26ec3 - Update workflow [06:07:38] [02miraheze/RemovePII] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RemovePII/compare/43e73f4f7644...86094b9ffdbd [06:07:39] [02miraheze/RemovePII] 07Universal-Omega 0386094b9 - Update workflow [06:07:41] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/3e1b25c14cad...1979d0202ae2 [06:07:42] [02miraheze/CreateWiki] 07Universal-Omega 031979d02 - Update workflow [06:07:44] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/9e32a52e81fc...775909e5422e [06:07:45] [02miraheze/ManageWiki] 07Universal-Omega 03775909e - Update workflow [06:07:47] [02miraheze/YouTube] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/YouTube/compare/d95d4b80896e...a83a9c523def [06:07:48] [02miraheze/YouTube] 07Universal-Omega 03a83a9c5 - Update workflow [06:07:50] [02miraheze/PDFEmbed] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/compare/59b420a92318...23ff5d45e95d [06:07:51] [02miraheze/PDFEmbed] 07Universal-Omega 0323ff5d4 - Update workflow [06:07:53] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/b9d7aaa998da...b7a6648759f1 [06:07:54] [02miraheze/DataDump] 07Universal-Omega 03b7a6648 - Update workflow [06:07:56] [02miraheze/SpriteSheet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/e578c88f3f51...bdcf0582c151 [06:07:57] [02miraheze/SpriteSheet] 07Universal-Omega 03bdcf058 - Update workflow [06:07:59] [02miraheze/WikiDiscover] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/WikiDiscover/compare/348f5af53244...db281e4e79c8 [06:08:00] [02miraheze/WikiDiscover] 07Universal-Omega 03db281e4 - Update workflow [06:08:02] [02miraheze/IncidentReporting] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/IncidentReporting/compare/072c15739551...fec1ee8e0cbb [06:08:03] [02miraheze/IncidentReporting] 07Universal-Omega 03fec1ee8 - Update workflow [06:08:05] [02miraheze/MatomoAnalytics] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/020d1590f556...2e4ddb60888f [06:08:06] [02miraheze/MatomoAnalytics] 07Universal-Omega 032e4ddb6 - Update workflow [06:08:08] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/50296dc1129d...991d188ea6ea [06:08:09] [02miraheze/MirahezeMagic] 07Universal-Omega 03991d188 - Update workflow [06:08:11] [02miraheze/RottenLinks] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/RottenLinks/compare/f6b5b9fc4233...9dcd03b14463 [06:08:12] [02miraheze/RottenLinks] 07Universal-Omega 039dcd03b - Update workflow [06:08:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.71, 8.35, 7.87 [06:08:44] [02miraheze/CustomHeader] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CustomHeader/compare/dc86100d83f8...a7a8b6a3c2e5 [06:08:45] [02miraheze/CustomHeader] 07Universal-Omega 03a7a8b6a - Update workflow [06:10:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.95, 8.09, 7.46 [06:10:28] miraheze/GlobalNewFiles - Universal-Omega the build has errored. [06:10:28] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.23, 8.38, 7.94 [06:11:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:12:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.57, 7.45, 7.30 [06:12:24] miraheze/WikiDiscover - Universal-Omega the build has errored. [06:12:42] miraheze/ManageWiki - Universal-Omega the build has errored. [06:13:49] miraheze/CreateWiki - Universal-Omega the build has errored. [06:14:25] miraheze/MirahezeMagic - Universal-Omega the build has errored. [06:15:47] miraheze/GlobalNewFiles - Universal-Omega the build has errored. [06:21:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:26:43] miraheze/RemovePII - Universal-Omega the build passed. [06:28:20] miraheze/SpriteSheet - Universal-Omega the build passed. [06:28:22] miraheze/PDFEmbed - Universal-Omega the build passed. [06:28:29] miraheze/MatomoAnalytics - Universal-Omega the build passed. [06:28:31] miraheze/DataDump - Universal-Omega the build passed. [06:28:36] miraheze/YouTube - Universal-Omega the build passed. [06:28:43] miraheze/CustomHeader - Universal-Omega the build passed. [06:28:46] miraheze/RottenLinks - Universal-Omega the build passed. [06:29:03] miraheze/IncidentReporting - Universal-Omega the build passed. [06:35:09] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.54, 1.85, 1.38 [06:35:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:39:00] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.96, 1.98, 1.55 [06:40:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:40:56] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.88, 2.26, 1.70 [06:41:18] [02mw-config] 07Reception123 closed pull request 03#4474: Add RelatedActicles configurations to ManageWikiSettings.php - 13https://github.com/miraheze/mw-config/pull/4474 [06:41:20] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/aefa8bd5d082...9e29df798b54 [06:41:21] [02miraheze/mw-config] 07lens0021 039e29df7 - Add RelatedActicles configurations to ManageWikiSettings.php (#4474) [06:42:17] miraheze/mw-config - Reception123 the build passed. [06:43:10] [02mw-config] 07Reception123 reviewed pull request 03#4500 commit - 13https://github.com/miraheze/mw-config/pull/4500#discussion_r827673295 [06:43:32] [02mw-config] 07Reception123 reviewed pull request 03#4501 commit - 13https://github.com/miraheze/mw-config/pull/4501#discussion_r827673478 [06:45:56] [02mw-config] 07Reception123 commented on pull request 03#4506: T8924: setting wgPopupsReferencePreviewsBetaFeature to false - 13https://github.com/miraheze/mw-config/pull/4506#issuecomment-1068791663 [06:45:58] [02mw-config] 07Reception123 closed pull request 03#4506: T8924: setting wgPopupsReferencePreviewsBetaFeature to false - 13https://github.com/miraheze/mw-config/pull/4506 [06:46:23] [02mw-config] 07Reception123 closed pull request 03#4507: T8925: setting Tweeki's subnav to false on obeymewiki - 13https://github.com/miraheze/mw-config/pull/4507 [06:46:24] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/9e29df798b54...a67b1d567472 [06:46:26] [02miraheze/mw-config] 07ugochimobi 03a67b1d5 - T8925: setting Tweeki's subnav to false on obeymewiki (#4507) [06:47:20] miraheze/mw-config - Reception123 the build passed. [06:47:25] [02mw-config] 07Reception123 commented on pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509#issuecomment-1068792419 [06:47:49] [02mw-config] 07Reception123 closed pull request 03#4510: T8932: ApprovedRevs configs - 13https://github.com/miraheze/mw-config/pull/4510 [06:47:50] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a67b1d567472...18e569fa516b [06:47:52] [02miraheze/mw-config] 07ugochimobi 0318e569f - T8932: ApprovedRevs configs (#4510) [06:48:57] !log [@test101] starting deploy of {'config': True} to all [06:48:57] miraheze/mw-config - Reception123 the build passed. [06:48:58] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [06:49:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:49:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:53:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:54:58] !log [@mwtask111] starting deploy of {'config': True} to all [06:55:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:55:10] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 12s [06:55:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:57:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.78, 8.19, 7.57 [06:58:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:59:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.11, 7.93, 7.56 [07:05:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:15:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:23:18] miraheze/GlobalNewFiles - Universal-Omega the build has errored. [07:23:57] miraheze/MirahezeMagic - Universal-Omega the build has errored. [07:24:34] miraheze/ManageWiki - Universal-Omega the build has errored. [07:24:36] miraheze/WikiDiscover - Universal-Omega the build has errored. [07:25:21] miraheze/CreateWiki - Universal-Omega the build has errored. [07:25:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:30:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:39:05] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.98, 6.77, 5.40 [07:39:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:40:32] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 0.78, 1.24, 1.88 [07:41:05] PROBLEM - db101 Current Load on db101 is CRITICAL: CRITICAL - load average: 9.67, 7.83, 5.96 [07:42:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.54, 0.98, 1.70 [07:43:05] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.34, 7.66, 6.12 [07:44:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:47:05] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 3.41, 5.79, 5.76 [07:54:25] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.82, 7.58, 7.03 [07:55:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:56:25] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 4.99, 6.65, 6.76 [08:00:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:08:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:50:32] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.58, 1.84, 1.22 [09:56:32] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.03, 1.76, 1.45 [09:58:32] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.38, 1.60, 1.43 [10:07:40] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [10:07:40] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:14:31] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:16:10] [02mw-config] 07ugochimobi synchronize pull request 03#4509: Popups config for gratispaideiawiki - 13https://github.com/miraheze/mw-config/pull/4509 [10:17:24] miraheze/mw-config - ugochimobi the build passed. [10:30:04] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/18e569fa516b...c43182e3c561 [10:30:06] [02miraheze/mw-config] 07Reception123 03c43182e - fix mistake [10:30:24] !log [reception@mwtask111] starting deploy of {'config': True} to all [10:30:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:30:35] !log [reception@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 10s [10:30:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:31:19] miraheze/mw-config - Reception123 the build passed. [10:32:24] !log [reception@mwtask111] starting deploy of {'config': True} to all [10:32:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:32:32] !log [reception@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 7s [10:32:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:36:23] !log [@mwtask111] starting deploy of {'config': True} to all [10:36:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:36:34] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 10s [10:36:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:36:55] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/68c1a66d08ec [10:36:56] [02miraheze/mw-config] 07Reception123 0368c1a66 - rm requires from relatedarticles config [10:36:58] [02mw-config] 07Reception123 created branch 03Reception123-patch-2 - 13https://github.com/miraheze/mw-config [10:37:00] [02mw-config] 07Reception123 opened pull request 03#4512: rm requires from relatedarticles config - 13https://github.com/miraheze/mw-config/pull/4512 [10:37:05] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.50, 1.64, 1.27 [10:38:20] miraheze/mw-config - Reception123 the build has errored. [10:38:23] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/68c1a66d08ec...12ce3b52bb39 [10:38:24] [02miraheze/mw-config] 07Reception123 0312ce3b5 - Update ManageWikiSettings.php [10:38:26] [02mw-config] 07Reception123 synchronize pull request 03#4512: rm requires from relatedarticles config - 13https://github.com/miraheze/mw-config/pull/4512 [10:38:33] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:39:01] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.79, 1.24, 1.16 [10:39:07] [02miraheze/mw-config] 07github-actions[bot] pushed 031 commit to 03Reception123-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/12ce3b52bb39...82e22e32afa8 [10:39:09] [02miraheze/mw-config] 07github-actions 0382e22e3 - CI: lint code to MediaWiki standards [10:39:10] [02mw-config] 07github-actions[bot] synchronize pull request 03#4512: rm requires from relatedarticles config - 13https://github.com/miraheze/mw-config/pull/4512 [10:39:26] [02mw-config] 07Reception123 closed pull request 03#4512: rm requires from relatedarticles config - 13https://github.com/miraheze/mw-config/pull/4512 [10:39:28] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/c43182e3c561...72ea039d4637 [10:39:29] [02miraheze/mw-config] 07Reception123 0372ea039 - rm requires from relatedarticles config (#4512) [10:39:31] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-2 [10:39:32] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-2 - 13https://github.com/miraheze/mw-config [10:39:37] !log [reception@mwtask111] starting deploy of {'config': True} to all [10:39:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:39:45] !log [reception@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 8s [10:39:49] miraheze/mw-config - Reception123 the build passed. [10:39:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:40:28] miraheze/mw-config - Reception123 the build passed. [10:41:06] [02mw-config] 07Reception123 commented on pull request 03#4474: Add RelatedActicles configurations to ManageWikiSettings.php - 13https://github.com/miraheze/mw-config/pull/4474#issuecomment-1068979579 [10:44:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.41, 7.97, 6.57 [10:46:55] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.26, 7.56, 6.58 [10:48:41] !log [@test101] starting deploy of {'config': True} to all [10:48:42] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [10:48:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:49:23] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.80, 1.60, 1.40 [10:51:21] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.58, 1.53, 1.39 [10:51:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.02, 8.44, 7.43 [10:53:19] !log [@mwtask111] starting deploy of {'config': True} to all [10:53:25] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.25, 8.12, 7.45 [10:53:34] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 15s [10:54:58]