[00:00:04] RECOVERY - es111 Current Load on es111 is OK: OK - load average: 2.19, 3.18, 3.24 [00:00:18] !log [@test101] finished deploy of {'l10nupdate': True} to all - SUCCESS in 3616s [00:01:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 6.76, 10.03, 11.81 [00:02:18] PROBLEM - cp20 Stunnel HTTP for mw122 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:02:23] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:02:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:02:58] RECOVERY - es111 Disk Space on es111 is OK: DISK OK - free space: / 31330 MB (11% inode=99%); [00:03:30] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:43] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:44] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:03:45] PROBLEM - cp30 Stunnel HTTP for mw101 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:04:01] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:04:02] PROBLEM - cp31 Stunnel HTTP for mw101 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:04:21] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22334 bytes in 0.412 second response time [00:04:30] PROBLEM - cp31 Varnish Backends on cp31 is CRITICAL: 1 backends are down. mw111 [00:04:31] PROBLEM - es121 Current Load on es121 is CRITICAL: CRITICAL - load average: 4.49, 3.05, 1.93 [00:04:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.81, 1.67, 1.55 [00:05:32] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22334 bytes in 3.974 second response time [00:05:38] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.015 second response time [00:05:40] RECOVERY - cp30 Stunnel HTTP for mw101 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.331 second response time [00:05:40] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 1.769 second response time [00:05:59] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.016 second response time [00:05:59] RECOVERY - cp31 Stunnel HTTP for mw101 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.316 second response time [00:06:16] RECOVERY - cp20 Stunnel HTTP for mw122 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.016 second response time [00:06:30] RECOVERY - cp31 Varnish Backends on cp31 is OK: All 12 backends are healthy [00:06:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.08, 3.91, 3.33 [00:06:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.93, 1.41, 1.47 [00:09:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.74, 10.41, 11.04 [00:13:57] Having Issue when logigng in Miraheze. Getting 503 error even when cache and cookies have been cleared in Miraheze.org domains [00:13:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.15, 10.36, 10.94 [00:15:13] It appears to happen when opening too many Miraheze.org links [00:16:10] PROBLEM - es121 Disk Space on es121 is WARNING: DISK WARNING - free space: / 28011 MB (10% inode=99%); [00:16:58] PROBLEM - es111 Disk Space on es111 is WARNING: DISK WARNING - free space: / 29073 MB (10% inode=99%); [00:17:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.34, 10.90, 10.99 [00:19:07] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.88, 3.83, 3.44 [00:20:53] Managed to log in [00:22:47] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.07, 1.66, 1.46 [00:22:58] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.99, 2.87, 3.14 [00:23:18] Is the problem being worked on? When I log in, I get logged out at the same time [00:24:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.35, 3.40, 3.97 [00:24:47] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.48, 1.58, 1.45 [00:26:31] PROBLEM - es121 Current Load on es121 is WARNING: WARNING - load average: 3.73, 3.95, 3.73 [00:28:11] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.40, 10.48, 9.33 [00:28:31] PROBLEM - es121 Current Load on es121 is CRITICAL: CRITICAL - load average: 4.44, 4.08, 3.80 [00:28:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.20, 3.81, 3.99 [00:29:53] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.13, 1.40, 1.90 [00:30:11] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.12, 9.49, 9.11 [00:30:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.35, 3.78, 3.96 [00:31:43] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.23, 3.54, 3.37 [00:32:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.29, 4.19, 4.10 [00:33:39] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.93, 4.14, 3.60 [00:35:35] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.10, 3.76, 3.53 [00:35:51] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.04, 1.20, 1.65 [00:36:43] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:37:00] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:38:01] PROBLEM - cp20 Stunnel HTTP for mw111 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:38:48] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:39:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.85, 3.61 [00:40:09] RECOVERY - cp20 Stunnel HTTP for mw111 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 9.374 second response time [00:40:31] PROBLEM - es121 Current Load on es121 is WARNING: WARNING - load average: 3.40, 3.86, 3.92 [00:40:56] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 9.219 second response time [00:41:01] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 8.333 second response time [00:41:14] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22334 bytes in 8.758 second response time [00:43:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.75, 3.43, 3.50 [00:43:19] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.93, 3.46, 3.94 [00:44:31] PROBLEM - es121 Current Load on es121 is CRITICAL: CRITICAL - load average: 4.91, 4.29, 4.07 [00:44:58] PROBLEM - es111 Disk Space on es111 is CRITICAL: DISK CRITICAL - free space: / 15670 MB (5% inode=99%); [00:47:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.10, 3.78, 3.62 [00:47:17] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.58, 4.22, 4.10 [00:49:06] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.75, 3.64 [00:49:48] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.40, 1.94, 1.71 [00:50:10] RECOVERY - es121 Disk Space on es121 is OK: DISK OK - free space: / 36417 MB (13% inode=99%); [00:50:31] PROBLEM - es121 Current Load on es121 is WARNING: WARNING - load average: 3.09, 3.90, 4.00 [00:52:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.40, 1.94, 1.54 [00:52:58] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 4.00, 3.74 [00:53:47] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.60, 1.90, 1.77 [00:54:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.13, 3.75, 3.69 [00:54:58] RECOVERY - es111 Disk Space on es111 is OK: DISK OK - free space: / 34370 MB (12% inode=99%); [00:56:50] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.13, 4.29, 3.89 [00:57:30] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 13041 MB (9% inode=99%); [00:58:31] RECOVERY - es121 Current Load on es121 is OK: OK - load average: 2.88, 2.85, 3.38 [00:58:45] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.83, 3.81, 3.77 [00:58:50] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.45, 1.86, 1.67 [01:00:50] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.42, 1.70, 1.63 [01:01:45] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.45, 1.61, 1.68 [01:02:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.09, 3.22, 3.95 [01:04:17] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.90, 1.62, 1.23 [01:04:58] PROBLEM - es111 Disk Space on es111 is WARNING: DISK WARNING - free space: / 25830 MB (9% inode=99%); [01:06:11] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.89, 1.31, 1.16 [01:06:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.87, 3.45, 3.51 [01:06:31] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 10.01, 6.71, 4.31 [01:08:31] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.04, 5.13, 4.01 [01:10:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.12, 3.84, 3.72 [01:10:31] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.21, 4.93, 4.08 [01:10:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.28, 4.13, 4.01 [01:12:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.87, 4.06, 3.82 [01:12:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.51, 3.96, 3.97 [01:15:29] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7692 MB (5% inode=99%); [01:16:21] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.81, 3.79 [01:19:16] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.98, 5.88, 4.70 [01:19:39] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.18, 1.88, 1.73 [01:20:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.04, 2.61, 3.34 [01:21:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.86, 3.57, 3.93 [01:21:11] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.74, 4.83, 4.45 [01:21:39] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.96, 1.92, 1.77 [01:24:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.95, 2.60, 3.27 [01:24:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:26:07] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.32, 1.62, 1.39 [01:27:02] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.96, 3.51, 3.69 [01:27:37] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.10, 1.97, 1.83 [01:28:51] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 6.07, 5.66, 4.93 [01:29:01] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.78, 3.51, 3.66 [01:29:37] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.68, 1.86, 1.81 [01:30:07] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.40, 1.90, 1.59 [01:30:51] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.60, 1.73, 1.61 [01:32:03] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:32:07] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.84, 1.54, 1.49 [01:32:49] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.69, 10.27, 9.12 [01:32:51] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.27, 1.51, 1.54 [01:32:58] RECOVERY - es111 Disk Space on es111 is OK: DISK OK - free space: / 34558 MB (12% inode=99%); [01:34:46] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.23, 9.90, 9.13 [01:35:00] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.62, 3.70, 3.66 [01:36:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.77, 4.06, 3.64 [01:37:00] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.42, 3.53, 3.60 [01:38:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.16, 3.70, 3.56 [01:40:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.76, 4.01, 3.70 [01:42:08] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.53, 9.89, 9.04 [01:42:31] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.73, 5.93, 5.96 [01:42:57] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.64, 3.47, 3.51 [01:44:02] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.01, 9.79, 9.12 [01:44:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.43, 3.41, 3.54 [01:45:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.10, 4.03, 3.55 [01:46:56] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.35, 3.10, 3.37 [01:47:32] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.33, 2.02, 1.90 [01:47:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.74, 10.96, 11.86 [01:48:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.70, 1.86, 1.65 [01:49:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.96, 3.62 [01:50:31] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 10.49, 5.91, 5.61 [01:50:56] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.19, 2.19, 1.78 [01:50:59] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.57, 4.13, 3.72 [01:52:07] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.18, 1.65, 1.37 [01:52:31] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.86, 5.40, 5.47 [01:52:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.56, 3.82, 3.65 [01:53:29] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 15860 MB (11% inode=99%); [01:53:31] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.99, 1.96 [01:54:07] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.02, 1.40, 1.31 [01:54:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.89, 1.65, 1.66 [01:57:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.11, 12.04, 11.94 [01:58:42] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.32, 2.91, 3.31 [01:58:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.71, 1.81, 1.73 [02:00:56] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.12, 1.83, 1.74 [02:01:29] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 13028 MB (9% inode=99%); [02:01:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.33, 11.61, 11.85 [02:02:31] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 6.26, 5.47, 5.45 [02:03:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.67, 11.58, 11.78 [02:04:31] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.66, 4.80, 5.19 [02:04:56] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.91, 1.61, 1.70 [02:06:31] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.15, 5.57, 5.40 [02:06:40] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.03, 3.00, 3.39 [02:07:27] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.39, 1.45, 1.68 [02:08:31] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.60, 4.80, 5.14 [02:12:31] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.87, 4.34, 4.86 [02:13:29] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7867 MB (5% inode=99%); [02:13:36] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.24, 3.33, 3.42 [02:13:39] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.76, 10.46, 9.54 [02:15:34] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.63, 3.06, 3.31 [02:15:36] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.80, 9.63, 9.36 [02:16:31] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 11.07, 13.92, 9.45 [02:17:03] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:17:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.59, 11.56, 11.86 [02:19:24] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.97, 1.68, 1.61 [02:20:16] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.23, 10.21, 8.89 [02:22:15] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 9.78, 10.16, 9.04 [02:23:23] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.10, 1.50, 1.56 [02:23:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.37, 12.56, 12.22 [02:24:33] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:26:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.47, 3.80, 3.42 [02:26:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.19, 3.43, 3.29 [02:28:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.95, 3.65, 3.41 [02:28:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.64, 3.59, 3.35 [02:30:19] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.72, 4.36, 3.70 [02:30:31] PROBLEM - es121 Current Load on es121 is WARNING: WARNING - load average: 3.64, 3.07, 2.70 [02:31:37] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.20, 3.91, 3.23 [02:32:31] PROBLEM - es121 Current Load on es121 is CRITICAL: CRITICAL - load average: 4.46, 3.75, 3.01 [02:32:41] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.94, 3.58 [02:33:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.56, 3.68, 3.22 [02:34:31] PROBLEM - es121 Current Load on es121 is WARNING: WARNING - load average: 3.11, 3.59, 3.05 [02:36:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.48, 4.16, 3.73 [02:37:35] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.15, 3.40, 3.21 [02:38:28] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.83, 3.66 [02:38:31] RECOVERY - es121 Current Load on es121 is OK: OK - load average: 2.25, 3.31, 3.09 [02:40:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.87, 2.01, 1.80 [02:41:29] RECOVERY - db112 Disk Space on db112 is OK: DISK OK - free space: / 18094 MB (13% inode=99%); [02:44:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.33, 1.91, 1.82 [02:45:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.42, 10.40, 9.64 [02:46:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.79, 3.05, 3.36 [02:47:16] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.67, 9.82, 9.52 [02:48:05] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.81, 3.54, 3.90 [02:48:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.21, 1.54, 1.69 [02:49:19] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.45, 1.96, 1.66 [02:49:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.16, 11.46, 11.87 [02:51:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.19, 12.01, 12.02 [02:52:11] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.99, 10.04, 9.20 [02:52:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.72, 1.84, 1.80 [02:53:18] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.86, 2.00, 1.75 [02:54:11] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.46, 9.75, 9.22 [02:54:33] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:55:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.69, 2.78, 3.35 [02:56:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.70, 3.33, 3.27 [02:56:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.26, 1.72, 1.74 [02:58:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.56, 3.36 [02:58:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.17, 1.53, 1.67 [02:59:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.19, 3.32, 3.47 [02:59:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.34, 11.73, 11.93 [03:00:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.78, 3.51, 3.36 [03:01:16] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.47, 1.60, 1.65 [03:02:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.00, 2.99, 3.19 [03:02:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.17, 9.57, 9.00 [03:03:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:03:50] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.98, 3.06, 3.33 [03:03:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.58, 12.20, 12.03 [03:04:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.96, 8.91, 8.83 [03:09:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.85, 11.87, 11.98 [03:10:42] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.61, 3.48, 3.49 [03:13:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:15:13] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.71, 1.72, 1.68 [03:16:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.50, 4.37, 3.65 [03:16:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 4.14, 3.76 [03:17:13] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.34, 1.92, 1.75 [03:19:14] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.33, 3.14, 2.07 [03:22:14] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.97, 5.32, 3.96 [03:23:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:23:03] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.92, 1.96, 1.82 [03:23:12] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.75, 1.98, 1.87 [03:23:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.47, 10.79, 10.86 [03:25:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.76, 10.64, 10.79 [03:26:52] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.33, 1.55, 1.67 [03:35:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.90, 11.50, 11.04 [03:37:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.78, 11.19, 10.98 [03:49:12] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.61, 2.07, 1.90 [03:50:58] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.70, 1.92, 1.67 [03:52:58] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.61, 2.59, 1.98 [03:53:12] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.26, 1.82, 1.86 [03:58:58] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.14, 1.99, 1.93 [03:59:12] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.35, 1.44, 1.66 [04:00:54] PROBLEM - es121 Disk Space on es121 is WARNING: DISK WARNING - free space: / 28585 MB (10% inode=99%); [04:01:27] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.14, 10.23, 9.40 [04:02:52] RECOVERY - es121 Disk Space on es121 is OK: DISK OK - free space: / 29772 MB (11% inode=99%); [04:03:24] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.81, 10.61, 9.66 [04:04:58] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.92, 1.35, 1.66 [04:07:18] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.53, 9.62, 9.53 [04:11:15] Hi [04:11:24] RhinosF1 [04:11:30] Can you see please [04:11:38] I have same problem [04:13:38] PROBLEM - es121 Disk Space on es121 is WARNING: DISK WARNING - free space: / 28459 MB (10% inode=99%); [04:14:49] PROBLEM - es121 Current Load on es121 is WARNING: WARNING - load average: 3.76, 3.34, 2.93 [04:16:43] RECOVERY - es121 Current Load on es121 is OK: OK - load average: 2.88, 3.11, 2.90 [04:17:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.43, 11.08, 10.70 [04:19:12] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.27, 1.75, 1.53 [04:19:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.99, 11.37, 10.86 [04:20:12] Are you here [04:22:31] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 0.79, 1.78, 5.39 [04:22:58] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 1.92, 1.68 [04:23:12] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.55, 1.80, 1.62 [04:24:31] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.62, 1.38, 4.80 [04:25:12] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.29, 1.64, 1.59 [04:25:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.46, 11.56, 11.08 [04:26:58] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.09, 1.71, 1.67 [04:27:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.59, 11.27, 11.04 [04:28:58] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.45, 1.61, 1.63 [04:32:39] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.51, 10.23, 9.49 [04:35:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.21, 10.92, 10.80 [04:36:39] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 9.95, 9.82, 9.47 [04:36:42] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.19, 10.31, 9.65 [04:37:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.63, 10.57, 10.70 [04:38:39] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.94, 9.96, 9.59 [04:40:00] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.21, 9.88, 9.53 [04:40:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.37, 10.13, 9.45 [04:42:39] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.20, 10.67, 9.98 [04:44:00] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.12, 9.92, 9.68 [04:47:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.50, 9.43, 10.16 [04:48:39] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.28, 10.02, 9.96 [04:49:15] PROBLEM - es121 Current Load on es121 is CRITICAL: CRITICAL - load average: 4.77, 4.00, 3.35 [04:50:08] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.34, 1.88, 1.68 [04:50:18] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.54, 9.87, 9.76 [04:51:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.27, 10.29, 10.36 [04:52:08] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.84, 1.87, 1.71 [04:53:58] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.36, 9.31, 10.00 [04:54:59] PROBLEM - es121 Current Load on es121 is WARNING: WARNING - load average: 2.72, 3.61, 3.43 [04:56:54] RECOVERY - es121 Current Load on es121 is OK: OK - load average: 2.34, 3.11, 3.26 [05:01:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 12.00, 10.57, 10.17 [05:01:39] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.41, 3.46, 3.98 [05:01:53] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.84, 11.38, 10.19 [05:01:55] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.14, 10.91, 10.19 [05:02:05] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.66, 2.17, 1.89 [05:02:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.87, 10.13, 9.91 [05:03:38] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.04, 3.51, 3.92 [05:03:50] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.12, 10.15, 9.88 [05:03:55] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.82, 9.98, 9.93 [05:04:48] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.27, 10.77, 10.16 [05:05:37] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.64, 3.49, 3.86 [05:06:46] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.35, 10.10, 10.01 [05:08:31] PROBLEM - es121 Current Load on es121 is CRITICAL: CRITICAL - load average: 4.56, 3.87, 3.55 [05:10:07] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.44, 1.82, 1.40 [05:10:31] PROBLEM - es121 Current Load on es121 is WARNING: WARNING - load average: 3.18, 3.57, 3.48 [05:12:07] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.80, 1.50, 1.33 [05:12:37] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.79, 10.48, 10.20 [05:13:01] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.02, 1.63, 1.27 [05:13:35] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.16, 2.75, 3.37 [05:14:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.28, 3.59, 3.99 [05:14:34] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.26, 9.68, 9.94 [05:15:01] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.35, 1.21 [05:16:31] RECOVERY - es121 Current Load on es121 is OK: OK - load average: 2.20, 3.09, 3.32 [05:16:56] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.41, 9.43, 9.90 [05:18:37] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.83, 10.26, 9.99 [05:19:48] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:19:55] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:20:12] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:20:17] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:20:32] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.02, 9.73, 9.84 [05:20:46] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:21:46] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14626 bytes in 0.231 second response time [05:21:54] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22334 bytes in 0.330 second response time [05:22:12] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14640 bytes in 0.328 second response time [05:22:16] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14634 bytes in 0.430 second response time [05:22:23] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.42, 10.38, 10.10 [05:22:45] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22334 bytes in 1.557 second response time [05:24:20] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.07, 9.85, 9.93 [05:26:20] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.52, 3.39, 3.59 [05:28:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:28:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.86, 3.75, 3.71 [05:29:27] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.06, 3.49, 3.34 [05:33:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:34:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.46, 10.07, 9.91 [05:34:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.98, 3.81, 3.99 [05:35:24] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.75, 3.22, 3.29 [05:36:04] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.07, 10.02, 9.91 [05:37:24] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/d0cd796e137c [05:37:26] [02miraheze/mw-config] 07Reception123 03d0cd796 - add NamespacePreload ext. (T9128) [05:37:27] [02mw-config] 07Reception123 created branch 03Reception123-patch-1 - 13https://github.com/miraheze/mw-config [05:37:29] [02mw-config] 07Reception123 opened pull request 03#4659: add NamespacePreload ext. (T9128) - 13https://github.com/miraheze/mw-config/pull/4659 [05:38:00] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/d0cd796e137c...67f6fc732600 [05:38:02] [02miraheze/mw-config] 07Reception123 0367f6fc7 - Update extension-list [05:38:03] [02mw-config] 07Reception123 synchronize pull request 03#4659: add NamespacePreload ext. (T9128) - 13https://github.com/miraheze/mw-config/pull/4659 [05:38:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.30, 2.94, 3.34 [05:38:33] miraheze/mw-config - Reception123 the build has errored. [05:38:50] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_37 [+1/-0/±1] 13https://github.com/miraheze/mediawiki/compare/fd8aea1ecd90...79097b1bbfaa [05:38:51] [02miraheze/mediawiki] 07Reception123 0379097b1 - Install NamespacePreload (T9128) [05:39:08] miraheze/mw-config - Reception123 the build has errored. [05:39:52] [02mw-config] 07Reception123 synchronize pull request 03#4659: add NamespacePreload ext. (T9128) - 13https://github.com/miraheze/mw-config/pull/4659 [05:39:53] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/67f6fc732600...0f3b4238e45a [05:39:55] [02miraheze/mw-config] 07Reception123 030f3b423 - syntax [05:40:23] !log [reception@mwtask111] starting deploy of {'world': True, 'l10n': True, 'extensionlist': True} to all [05:40:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:40:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.78, 3.86, 3.89 [05:40:56] miraheze/mw-config - Reception123 the build passed. [05:42:41] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.09, 3.21, 3.65 [05:43:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:46:29] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/f4533a79dce1 [05:46:31] [02miraheze/mw-config] 07Universal-Omega 03f4533a7 - Re-enable RatePage on 1.38 [05:46:32] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [05:46:34] [02mw-config] 07Universal-Omega opened pull request 03#4660: Re-enable RatePage on 1.38 - 13https://github.com/miraheze/mw-config/pull/4660 [05:46:40] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.68, 3.46, 3.61 [05:47:35] miraheze/mw-config - Universal-Omega the build passed. [05:47:55] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_38 [+1/-0/±1] 13https://github.com/miraheze/mediawiki/compare/8a11cc4f1eba...53b54a7ceed6 [05:47:56] [02miraheze/mediawiki] 07Reception123 0353b54a7 - Install NamespacePreload (T9128) [05:48:23] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/53b54a7ceed6...6d928b29fdbf [05:48:25] [02miraheze/mediawiki] 07Reception123 036d928b2 - Update RatePage [05:48:30] [02mw-config] 07Reception123 closed pull request 03#4660: Re-enable RatePage on 1.38 - 13https://github.com/miraheze/mw-config/pull/4660 [05:48:31] [02miraheze/mw-config] 07Reception123 deleted branch 03Universal-Omega-patch-1 [05:48:33] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c2ef87dc9faa...bc6ff5e70fb2 [05:48:34] [02miraheze/mw-config] 07Universal-Omega 03bc6ff5e - Re-enable RatePage on 1.38 (#4660) [05:48:36] [02mw-config] 07Reception123 deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [05:48:40] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.16, 3.20, 3.49 [05:49:28] !log [reception@mwtask111] finished deploy of {'world': True, 'l10n': True, 'extensionlist': True} to all - SUCCESS in 545s [05:49:30] miraheze/mw-config - Reception123 the build passed. [05:49:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:24] !log [reception@test101] starting deploy of {'config': True, 'world': True, 'l10n': True} to all [05:50:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:41] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.36, 3.50 [05:51:16] PROBLEM - es121 Current Load on es121 is CRITICAL: CRITICAL - load average: 4.51, 3.75, 3.02 [05:51:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:51:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.36, 10.44, 10.03 [05:52:39] [02mw-config] 07Reception123 closed pull request 03#4659: add NamespacePreload ext. (T9128) - 13https://github.com/miraheze/mw-config/pull/4659 [05:52:41] [02miraheze/mw-config] 07Reception123 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/bc6ff5e70fb2...c5ee18c5bbd8 [05:52:42] [02miraheze/mw-config] 07Reception123 03c5ee18c - add NamespacePreload ext. (T9128) (#4659) [05:52:44] [02mw-config] 07Reception123 deleted branch 03Reception123-patch-1 - 13https://github.com/miraheze/mw-config [05:52:45] [02miraheze/mw-config] 07Reception123 deleted branch 03Reception123-patch-1 [05:52:51] !log [reception@mwtask111] starting deploy of {'config': True, 'l10n': True} to all [05:52:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:10] PROBLEM - es121 Current Load on es121 is WARNING: WARNING - load average: 3.44, 3.66, 3.08 [05:53:25] !log [@mwtask111] starting deploy of {'config': True} to all [05:53:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:35] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 9s [05:53:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:45] miraheze/mw-config - Reception123 the build passed. [05:54:25] !log [reception@mwtask111] finished deploy of {'config': True, 'l10n': True} to all - SUCCESS in 94s [05:54:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:50] !log [@test101] starting deploy of {'config': True} to all [05:54:55]