[00:00:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.62, 12.00, 12.23 [00:00:45] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.58, 3.82, 5.58 [00:02:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.98, 10.82, 11.80 [00:02:45] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.78, 5.45, 5.94 [00:03:24] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 2.31, 2.04, 1.62 [00:03:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.80, 4.65, 3.96 [00:04:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.83, 11.66, 11.95 [00:05:10] PROBLEM - cp30 Disk Space on cp30 is WARNING: DISK WARNING - free space: / 4027 MB (10% inode=96%); [00:06:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.67, 10.46, 11.90 [00:06:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.59, 10.49, 11.50 [00:07:10] RECOVERY - cp30 Disk Space on cp30 is OK: DISK OK - free space: / 10580 MB (27% inode=96%); [00:09:27] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/a8d51ec11618 [00:09:29] [02miraheze/puppet] 07Universal-Omega 03a8d51ec - mediawiki: set net.ipv4.tcp_tw_reuse [00:09:30] [02puppet] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [00:09:31] [url] Page not found · GitHub · GitHub | github.com [00:09:32] [02puppet] 07Universal-Omega opened pull request 03#2817: mediawiki: set net.ipv4.tcp_tw_reuse - 13https://github.com/miraheze/puppet/pull/2817 [00:09:32] [url] Page not found · GitHub · GitHub | github.com [00:10:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.20, 10.44, 11.40 [00:10:07] [02puppet] 07paladox closed pull request 03#2817: mediawiki: set net.ipv4.tcp_tw_reuse - 13https://github.com/miraheze/puppet/pull/2817 [00:10:07] [url] Page not found · GitHub · GitHub | github.com [00:10:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/d6fe1406af79...950cd421b090 [00:10:09] [url] Comparing d6fe1406af79...950cd421b090 · miraheze/puppet · GitHub | github.com [00:10:10] [02miraheze/puppet] 07Universal-Omega 03950cd42 - mediawiki: set net.ipv4.tcp_tw_reuse (#2817) [00:10:11] [02miraheze/puppet] 07paladox deleted branch 03Universal-Omega-patch-1 [00:12:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.53, 11.11, 11.56 [00:12:57] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/702b8e700de1 [00:12:58] [02miraheze/puppet] 07Universal-Omega 03702b8e7 - varnish: set net.ipv4.tcp_tw_reuse [00:13:00] [02puppet] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [00:13:00] [url] Page not found · GitHub · GitHub | github.com [00:13:02] [02puppet] 07Universal-Omega opened pull request 03#2818: varnish: set net.ipv4.tcp_tw_reuse - 13https://github.com/miraheze/puppet/pull/2818 [00:13:02] [url] Page not found · GitHub · GitHub | github.com [00:13:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.52, 3.69, 4.00 [00:13:46] [02puppet] 07paladox closed pull request 03#2818: varnish: set net.ipv4.tcp_tw_reuse - 13https://github.com/miraheze/puppet/pull/2818 [00:13:46] ... [00:13:47] [02miraheze/puppet] 07paladox deleted branch 03Universal-Omega-patch-1 [00:13:49] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/950cd421b090...1b6e30537af9 [00:13:49] [url] Comparing 950cd421b090...1b6e30537af9 · miraheze/puppet · GitHub | github.com [00:13:50] [02miraheze/puppet] 07Universal-Omega 031b6e305 - varnish: set net.ipv4.tcp_tw_reuse (#2818) [00:13:52] [02puppet] 07paladox deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [00:13:52] ... [00:14:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.07, 12.33, 11.88 [00:14:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.28, 10.65, 11.00 [00:16:45] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.68, 4.70, 5.70 [00:20:45] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.92, 3.11, 4.80 [00:22:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.25, 11.03, 11.37 [00:24:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.55, 10.26, 11.88 [00:24:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1b6e30537af9...29bd54370aa9 [00:24:05] [url] Comparing 1b6e30537af9...29bd54370aa9 · miraheze/puppet · GitHub | github.com [00:24:06] [02miraheze/puppet] 07paladox 0329bd543 - varnish: Increase the number of ephemeral ports [00:26:53] [02miraheze/mw-config] 07The-Voidwalker pushed 031 commit to 03The-Voidwalker-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/f3deb61ef325 [00:26:54] [02miraheze/mw-config] 07The-Voidwalker 03f3deb61 - explicitly configure $wgMessageCacheType [00:26:56] [02mw-config] 07The-Voidwalker created branch 03The-Voidwalker-patch-1 - 13https://github.com/miraheze/mw-config [00:26:56] [url] Page not found · GitHub · GitHub | github.com [00:26:57] [02mw-config] 07The-Voidwalker opened pull request 03#4891: explicitly configure $wgMessageCacheType - 13https://github.com/miraheze/mw-config/pull/4891 [00:26:58] [url] Page not found · GitHub · GitHub | github.com [00:27:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.98, 4.06, 3.84 [00:27:48] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f4ae478c4e09...9df9f29e3d2f [00:27:49] [url] Comparing f4ae478c4e09...9df9f29e3d2f · miraheze/mw-config · GitHub | github.com [00:27:50] [02miraheze/mw-config] 07Universal-Omega 039df9f29 - Set $wgMessageCacheType [00:28:03] !log [universalomega@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [00:28:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.87, 11.36, 11.80 [00:28:08] miraheze/mw-config - The-Voidwalker the build passed. [00:28:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:28:15] !log [universalomega@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 11s [00:28:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:28:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.25, 11.78, 11.42 [00:28:38] !log [@test131] starting deploy of {'config': True} to all [00:28:39] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [00:28:40] [02mw-config] 07The-Voidwalker closed pull request 03#4891: explicitly configure $wgMessageCacheType - 13https://github.com/miraheze/mw-config/pull/4891 [00:28:40] [url] Page not found · GitHub · GitHub | github.com [00:28:43] [02miraheze/mw-config] 07The-Voidwalker deleted branch 03The-Voidwalker-patch-1 [00:28:45] [02mw-config] 07The-Voidwalker deleted branch 03The-Voidwalker-patch-1 - 13https://github.com/miraheze/mw-config [00:28:45] [url] Page not found · GitHub · GitHub | github.com [00:28:47] miraheze/mw-config - Universal-Omega the build passed. [00:28:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:29:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:31:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.68, 3.72 [00:32:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.08, 11.24, 11.78 [00:32:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/29bd54370aa9...ebc6b7d8df01 [00:32:45] [url] Comparing 29bd54370aa9...ebc6b7d8df01 · miraheze/puppet · GitHub | github.com [00:32:46] [02miraheze/puppet] 07paladox 03ebc6b7d - mediawiki: raise port ranges [00:32:53] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.60, 3.37, 3.02 [00:33:42] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/9df9f29e3d2f...2c5b43450447 [00:33:43] [url] Comparing 9df9f29e3d2f...2c5b43450447 · miraheze/mw-config · GitHub | github.com [00:33:44] [02miraheze/mw-config] 07Universal-Omega 032c5b434 - Set $smwgMainCacheType to 'memcached-mem-2' [00:33:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.03, 4.65, 4.11 [00:33:48] !log [universalomega@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [00:34:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.29, 12.44, 12.17 [00:34:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:34:07] !log [universalomega@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 19s [00:34:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:34:49] miraheze/mw-config - Universal-Omega the build passed. [00:34:49] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 3.00, 3.14, 2.97 [00:35:36] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.05, 5.70, 5.06 [00:38:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.39, 11.69, 11.81 [00:39:30] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.66, 5.18, 5.02 [00:41:27] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.68, 4.58, 4.82 [00:44:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.77, 11.72, 11.60 [00:46:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.69, 10.52, 11.17 [00:50:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.49, 11.64, 11.45 [00:51:07] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 8.98, 7.31, 5.90 [00:54:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.50, 11.35, 11.44 [00:56:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.78, 12.89, 11.98 [00:57:44] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2c5b43450447...18126f7bc636 [00:57:44] [url] Comparing 2c5b43450447...18126f7bc636 · miraheze/mw-config · GitHub | github.com [00:57:45] [02miraheze/mw-config] 07Universal-Omega 0318126f7 - logging: disable LinkBatch channel [00:58:04] !log [universalomega@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [00:58:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:58:31] !log [universalomega@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 27s [00:58:34] !log [@test131] starting deploy of {'config': True} to all [00:58:35] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [00:58:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:58:53] miraheze/mw-config - Universal-Omega the build passed. [00:59:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:00:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:08:52] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 1.02, 0.21, 0.07 [01:09:24] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 0.76, 0.25, 0.09 [01:10:00] !log reboot mw121, mw122, and test131 [01:10:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.53, 3.78, 1.33 [01:10:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:10:53] PROBLEM - test131 JobRunner Service on test131 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService' [01:12:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.85, 7.93, 3.15 [01:12:21] PROBLEM - test131 Check Gluster Clients on test131 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [01:12:43] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.71, 9.25, 3.88 [01:12:53] RECOVERY - test131 JobRunner Service on test131 is OK: PROCS OK: 1 process with args 'redisJobRunnerService' [01:14:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.69, 9.96, 4.79 [01:16:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.05, 10.59, 5.65 [01:18:05] !log increase Max number of indices to 7 on graylog [01:18:08] CosmicAlpha: Voidwalker ^ [01:18:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:18:25] based on the disk space available on es* [01:18:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.36, 10.55, 6.24 [01:20:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.73, 11.41, 7.16 [01:22:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.42, 11.46, 7.66 [01:22:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.71, 11.68, 7.65 [01:24:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.52, 11.44, 8.14 [01:29:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.44, 3.95 [01:32:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.17, 11.46, 9.37 [01:35:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.22, 3.46, 3.73 [01:36:59] thanks paladox! [01:44:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.69, 11.83, 11.36 [01:50:45] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.21, 3.63, 5.99 [01:51:49] !log stop jobrunner on mw121 and mw122 [01:51:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:52:30] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/efa8ed3918aa [01:52:31] [02miraheze/puppet] 07Universal-Omega 03efa8ed3 - Update mw121.yaml [01:52:33] [02puppet] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [01:52:33] [url] Page not found · GitHub · GitHub | github.com [01:52:46] [02puppet] 07Universal-Omega opened pull request 03#2819: disable jobrunner on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2819 [01:52:46] [url] Page not found · GitHub · GitHub | github.com [01:53:24] PROBLEM - mw121 JobRunner Service on mw121 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService' [01:54:05] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/efa8ed3918aa...dade04cc0430 [01:54:05] [url] Comparing efa8ed3918aa...dade04cc0430 · miraheze/puppet · GitHub | github.com [01:54:06] [02miraheze/puppet] 07Universal-Omega 03dade04c - Update mw122.yaml [01:54:08] [02puppet] 07Universal-Omega synchronize pull request 03#2819: disable jobrunner on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2819 [01:54:08] [url] Page not found · GitHub · GitHub | github.com [01:54:12] PROBLEM - mw122 JobRunner Service on mw122 is CRITICAL: PROCS CRITICAL: 0 processes with args 'redisJobRunnerService' [01:54:31] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/dade04cc0430...d7d512302432 [01:54:31] [url] Comparing dade04cc0430...d7d512302432 · miraheze/puppet · GitHub | github.com [01:54:32] [02miraheze/puppet] 07Universal-Omega 03d7d5123 - Update mw121.yaml [01:54:34] [02puppet] 07Universal-Omega synchronize pull request 03#2819: disable jobrunner on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2819 [01:54:34] [url] Page not found · GitHub · GitHub | github.com [01:56:10] [02puppet] 07Universal-Omega closed pull request 03#2819: disable jobrunner on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2819 [01:56:11] [url] Page not found · GitHub · GitHub | github.com [01:56:12] [02miraheze/puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [01:56:13] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/ebc6b7d8df01...58191295cfa3 [01:56:14] [url] Comparing ebc6b7d8df01...58191295cfa3 · miraheze/puppet · GitHub | github.com [01:56:15] [02miraheze/puppet] 07Universal-Omega 035819129 - disable jobrunner on mw121 and mw122 (#2819) [01:56:16] [02puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [01:56:17] ... [01:58:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.36, 10.95, 10.77 [01:58:45] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.25, 4.48, 5.24 [02:00:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.90, 10.07, 10.47 [02:01:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.41, 10.45, 11.63 [02:02:37] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.27, 10.75, 10.65 [02:04:55] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03revert-2819-Universal-Omega-patch-1 [+0/-0/±2] 13https://github.com/miraheze/puppet/commit/409de620ec93 [02:04:57] [02miraheze/puppet] 07Universal-Omega 03409de62 - Revert "disable jobrunner on mw121 and mw122 (#2819)" [02:04:58] [02puppet] 07Universal-Omega created branch 03revert-2819-Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [02:04:58] [url] Page not found · GitHub · GitHub | github.com [02:05:00] [02puppet] 07Universal-Omega opened pull request 03#2820: Revert "disable jobrunner on mw121 and mw122" - 13https://github.com/miraheze/puppet/pull/2820 [02:05:00] [url] Page not found · GitHub · GitHub | github.com [02:05:43] [02puppet] 07Universal-Omega edited pull request 03#2820: Explicitly disable jobrunner on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2820 [02:05:43] ... [02:05:47] [02puppet] 07Universal-Omega edited pull request 03#2820: Explicitly disable jobrunner on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2820 [02:05:47] [url] Page not found · GitHub · GitHub | github.com [02:05:55] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.77, 11.65, 11.72 [02:05:57] [02puppet] 07Universal-Omega synchronize pull request 03#2820: Explicitly disable jobrunner on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2820 [02:05:57] ... [02:05:58] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03revert-2819-Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/409de620ec93...db75f3bea088 [02:05:58] [url] Comparing 409de620ec93...db75f3bea088 · miraheze/puppet · GitHub | github.com [02:06:00] [02miraheze/puppet] 07Universal-Omega 03db75f3b - Update mw121.yaml [02:06:07] [02puppet] 07Universal-Omega synchronize pull request 03#2820: Explicitly disable jobrunner on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2820 [02:06:07] [url] Page not found · GitHub · GitHub | github.com [02:06:08] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03revert-2819-Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/db75f3bea088...6ee67b6dba14 [02:06:09] [url] Comparing db75f3bea088...6ee67b6dba14 · miraheze/puppet · GitHub | github.com [02:06:10] [02miraheze/puppet] 07Universal-Omega 036ee67b6 - Update mw122.yaml [02:06:14] PROBLEM - puppet141 Current Load on puppet141 is CRITICAL: CRITICAL - load average: 4.41, 3.18, 2.08 [02:09:27] [02puppet] 07Universal-Omega closed pull request 03#2820: Explicitly disable jobrunner on mw121 and mw122 - 13https://github.com/miraheze/puppet/pull/2820 [02:09:27] [url] Page not found · GitHub · GitHub | github.com [02:09:29] [02miraheze/puppet] 07Universal-Omega deleted branch 03revert-2819-Universal-Omega-patch-1 [02:09:30] [02puppet] 07Universal-Omega deleted branch 03revert-2819-Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [02:09:31] [url] Page not found · GitHub · GitHub | github.com [02:09:39] !log install ndisc6 on test131 [02:09:40] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.68, 11.13, 11.04 [02:09:43] PROBLEM - puppet141 Current Load on puppet141 is WARNING: WARNING - load average: 2.55, 3.45, 2.48 [02:10:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:11:36] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.17, 1.79, 0.60 [02:11:37] PROBLEM - mw121 SSH on mw121 is CRITICAL: connect to address 2a10:6740::6:309 and port 22: No route to host [02:11:42] RECOVERY - puppet141 Current Load on puppet141 is OK: OK - load average: 1.13, 2.70, 2.33 [02:12:11] !log reboot mw121 and mw122 [02:12:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:12:58] RECOVERY - mw121 SSH on mw121 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [02:13:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.39, 3.78, 1.35 [02:13:36] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.30, 4.55, 1.64 [02:15:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.94, 7.53, 3.13 [02:16:06] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.07, 7.50, 3.26 [02:18:49] !log mount /mnt/mediawiki-static on test131 [02:18:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:18:59] RECOVERY - test131 Check Gluster Clients on test131 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [02:21:59] !log upgrade the poppler-utils, libpoppler-glib8, and libpoppler102 packages on mw*, mwtask141, and test131 [02:22:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:22:34] RECOVERY - mw142 APT on mw142 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:22:38] RECOVERY - mw121 APT on mw121 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:22:38] RECOVERY - test131 APT on test131 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:22:38] RECOVERY - mw141 APT on mw141 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:22:49] RECOVERY - mw131 APT on mw131 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:22:50] RECOVERY - mwtask141 APT on mwtask141 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:22:53] RECOVERY - mw132 APT on mw132 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:23:03] RECOVERY - mw122 APT on mw122 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [02:31:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.85, 10.35, 7.59 [02:33:40] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.90, 9.60, 7.64 [02:34:53] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.64, 10.81, 8.01 [02:36:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.32, 9.91, 8.00 [02:41:25] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.21, 11.14, 9.00 [02:41:55] PROBLEM - test131 Check Gluster Clients on test131 is CRITICAL: PROCS CRITICAL: 0 processes with args '/usr/sbin/glusterfs' [02:43:25] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.51, 9.95, 8.83 [02:47:24] !log mount /mnt/mediawiki-static on test131 [02:47:39] RECOVERY - test131 Check Gluster Clients on test131 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs' [02:47:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:53:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.72, 10.72, 9.30 [02:53:37] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:53:39] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:54:21] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/58191295cfa3...e347c63f7a17 [02:54:22] [url] Comparing 58191295cfa3...e347c63f7a17 · miraheze/puppet · GitHub | github.com [02:54:23] [02miraheze/puppet] 07paladox 03e347c63 - Update init.pp [02:55:34] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.259 second response time [02:55:36] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 204 No Content - 352 bytes in 0.415 second response time [02:56:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.04, 10.92, 9.74 [02:56:47] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e347c63f7a17...668e3e324a52 [02:56:47] [url] Comparing e347c63f7a17...668e3e324a52 · miraheze/puppet · GitHub | github.com [02:56:48] [02miraheze/puppet] 07Universal-Omega 03668e3e3 - role::mediawiki: minor cleanup [02:58:59] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.89, 10.88, 9.93 [03:00:55] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.16, 11.37, 10.22 [03:02:51] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.08, 10.46, 10.03 [03:04:47] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.19, 12.39, 10.76 [03:05:44] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.23, 9.18, 9.66 [03:06:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.93, 11.52, 10.65 [03:11:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.86, 11.04, 10.16 [03:11:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.08, 3.89 [03:13:25] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.96, 10.24, 9.98 [03:15:25] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.18, 11.49, 10.43 [03:17:25] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.01, 10.12, 10.06 [03:18:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.79, 9.82, 10.10 [03:19:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.06, 3.58, 3.71 [03:22:32] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.57, 11.44, 10.67 [03:23:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.70, 3.74 [03:24:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.34, 11.65, 10.87 [03:31:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.12, 4.24, 3.83 [03:32:32] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.11, 9.46, 10.10 [03:33:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.58, 3.93, 3.76 [03:41:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 3.93, 3.76 [03:42:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.07, 10.63, 10.11 [03:43:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.43, 3.48, 3.62 [03:44:27] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.00, 9.79, 9.87 [03:47:48] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.96, 2.89, 3.37 [03:57:47] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 5.98, 4.47, 6.00 [03:59:47] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 11.86, 6.88, 6.68 [04:05:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.20, 1.55, 1.93 [04:07:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.37, 10.54, 9.38 [04:07:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.56, 1.96, 2.04 [04:09:28] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.69, 11.36, 9.77 [04:11:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.59, 10.40, 9.60 [04:11:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.55, 1.85, 1.99 [04:11:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.85, 3.88, 3.43 [04:12:12] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.34, 10.86, 9.46 [04:13:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.03, 9.72, 9.46 [04:14:07] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.99, 9.43, 9.11 [04:15:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.84, 3.36, 3.32 [04:19:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.98, 2.60, 2.15 [04:21:47] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.89, 11.04, 9.66 [04:23:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.68, 9.43, 9.24 [04:27:30] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.96, 4.43, 3.78 [04:35:07] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.16, 3.99, 3.88 [04:40:50] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.26, 4.02, 3.92 [04:42:45] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.17, 3.72, 3.82 [04:52:17] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.88, 2.72, 3.33 [05:03:50] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.86, 1.36, 1.89 [05:05:51] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.08, 1.66, 1.94 [05:07:51] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.23, 1.54, 1.86 [05:09:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.06, 1.41, 1.89 [05:11:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.01, 1.55, 1.87 [05:13:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.25, 1.42, 1.79 [05:15:51] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.90, 1.34, 1.64 [05:17:47] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.09, 4.59, 5.74 [05:19:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.74, 1.91, 1.88 [05:21:48] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 3.55, 3.75, 5.10 [05:21:51] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.39, 2.00, 1.81 [05:23:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.99, 1.75, 1.85 [05:25:52] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.00, 1.76, 1.78 [05:27:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.81, 4.61, 3.43 [05:29:47] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.29, 6.41, 5.69 [05:29:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.99, 2.04, 1.95 [05:31:47] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.24, 4.84, 5.20 [05:31:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.25, 3.71, 3.39 [05:31:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.39, 1.78, 1.86 [05:31:52] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.06, 2.02, 1.88 [05:33:47] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.23, 5.85, 5.55 [05:33:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.97, 2.21, 2.00 [05:35:48] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.12, 3.36, 3.31 [05:37:47] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.72, 5.49, 5.54 [05:37:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.65, 1.96, 1.97 [05:39:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.07, 2.15, 2.04 [05:41:47] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.58, 4.19, 5.01 [05:41:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.39, 1.86, 1.95 [05:43:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.54, 2.24, 2.08 [05:45:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.70, 1.99, 2.00 [05:47:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.06, 2.31, 2.11 [05:49:47] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 11.69, 7.38, 5.81 [05:52:09] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.74, 3.60, 3.24 [06:03:21] PROBLEM - wiki.jkrstudios.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.jkrstudios.org' expires in 15 day(s) (Mon 26 Sep 2022 05:51:00 GMT +0000). [06:07:39] PROBLEM - microworldwiki.ga - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'microworldwiki.ga' expires in 15 day(s) (Mon 26 Sep 2022 05:41:37 GMT +0000). [06:09:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/8b1dae8759a3...ad98a91e8d96 [06:09:25] [url] Comparing 8b1dae8759a3...ad98a91e8d96 · miraheze/ssl · GitHub | github.com [06:09:26] [02miraheze/ssl] 07MirahezeSSLBot 03ad98a91 - Bot: Update SSL cert for wiki.jkrstudios.org [06:09:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.00, 3.63, 3.79 [06:11:05] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/ad98a91e8d96...768ffda5e0a4 [06:11:05] [url] Comparing ad98a91e8d96...768ffda5e0a4 · miraheze/ssl · GitHub | github.com [06:11:06] [02miraheze/ssl] 07MirahezeSSLBot 03768ffda - Bot: Update SSL cert for microworldwiki.ga [06:23:48] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.10, 3.01, 3.36 [06:28:09] PROBLEM - nottingham.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'nottingham.wiki' expires in 15 day(s) (Mon 26 Sep 2022 06:16:48 GMT +0000). [06:32:25] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/768ffda5e0a4...6b9f9a0ec629 [06:32:25] [url] Comparing 768ffda5e0a4...6b9f9a0ec629 · miraheze/ssl · GitHub | github.com [06:32:26] [02miraheze/ssl] 07MirahezeSSLBot 036b9f9a0 - Bot: Update SSL cert for nottingham.wiki [06:33:09] RECOVERY - wiki.jkrstudios.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.jkrstudios.org' will expire on Fri 09 Dec 2022 05:09:18 GMT +0000. [06:35:49] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [06:37:02] RECOVERY - microworldwiki.ga - LetsEncrypt on sslhost is OK: OK - Certificate 'microworldwiki.ga' will expire on Fri 09 Dec 2022 05:10:59 GMT +0000. [06:37:46] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [06:39:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.20, 1.62, 1.99 [06:45:50] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.66, 1.11, 1.66 [06:46:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.24, 3.99, 3.33 [06:47:13] PROBLEM - wiki.wilderyogi.eu - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.wilderyogi.eu' expires in 15 day(s) (Mon 26 Sep 2022 06:35:10 GMT +0000). [06:48:50] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.36, 3.89, 3.38 [06:49:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.74, 2.25, 1.99 [06:51:03] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/6b9f9a0ec629...210789e68e27 [06:51:04] [url] Comparing 6b9f9a0ec629...210789e68e27 · miraheze/ssl · GitHub | github.com [06:51:05] [02miraheze/ssl] 07MirahezeSSLBot 03210789e - Bot: Update SSL cert for wiki.wilderyogi.eu [06:51:47] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.21, 4.71, 5.75 [06:52:39] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.88, 3.01, 3.14 [06:55:47] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.04, 5.09, 5.59 [06:55:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.31, 1.77, 1.88 [06:57:47] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.00, 4.05, 5.14 [06:57:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.16, 1.96, 1.93 [06:58:04] RECOVERY - nottingham.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'nottingham.wiki' will expire on Fri 09 Dec 2022 05:32:19 GMT +0000. [06:59:47] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.47, 3.62, 4.85 [06:59:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.86, 1.58, 1.80 [07:01:56] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.90, 1.56, 1.96 [07:03:57] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.42, 1.95, 2.06 [07:05:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.46, 3.13, 3.04 [07:07:54] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.27, 2.70, 2.89 [07:07:57] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.98, 1.64, 1.93 [07:13:50] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.20, 1.42, 1.62 [07:15:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.26, 1.41, 1.69 [07:18:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.48, 3.96 [07:19:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.71, 1.71, 1.70 [07:20:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.36, 3.89, 4.02 [07:23:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.91, 2.13, 1.86 [07:23:58] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.73, 2.14, 1.88 [07:25:37] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 6.09, 7.27, 5.39 [07:25:48] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.13, 3.90, 3.09 [07:27:35] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.60, 5.62, 5.02 [07:27:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.47, 1.91, 1.85 [07:27:58] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.76, 1.61, 1.73 [07:29:34] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.83, 4.41, 4.64 [07:29:58] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.40, 1.58, 1.70 [07:30:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.74, 3.26, 3.90 [07:31:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.14, 1.71, 1.75 [07:33:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.67, 1.62, 1.71 [07:35:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.50, 3.71, 3.52 [07:35:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.12, 1.79, 1.76 [07:35:58] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.58, 1.92, 1.78 [07:36:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.00, 2.51, 3.36 [07:37:48] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.75, 3.32, 3.39 [07:41:50] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.51, 1.98, 1.88 [07:42:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.83, 3.36, 3.45 [07:43:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.51, 3.85, 3.58 [07:44:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.30, 3.55, 3.50 [07:45:13] RECOVERY - wiki.wilderyogi.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wilderyogi.eu' will expire on Fri 09 Dec 2022 05:50:57 GMT +0000. [07:48:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.60, 3.87, 3.66 [07:49:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.48, 3.77, 3.73 [07:49:50] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.66, 2.04, 1.90 [07:53:48]