[00:00:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.17, 9.90, 10.92 [00:02:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.43, 3.99, 3.67 [00:02:55] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.88, 3.56, 3.48 [00:03:18] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.68, 3.54, 3.57 [00:04:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.45, 3.32, 3.45 [00:04:10] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 3.04, 7.28, 9.74 [00:04:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.63, 3.83, 3.21 [00:04:52] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.25, 3.01, 3.28 [00:05:01] !log update description on github:miraheze/ManageWiki to replace "wiki founders" with "wiki bureaucrats" [00:05:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:05:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.55, 2.93, 3.34 [00:06:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.92, 2.95, 3.31 [00:06:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.30, 2.96, 2.96 [00:06:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 1.93, 3.10, 3.95 [00:07:15] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.49, 3.05, 2.29 [00:09:11] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.22, 2.79, 2.28 [00:09:48] !log [@mwtask141] starting deploy of {'config': True} to all [00:09:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:09:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 1.87, 2.92, 3.97 [00:10:00] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 12s [00:10:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:14:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.26, 3.68, 3.72 [00:15:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.71, 3.90, 4.02 [00:17:02] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.45, 3.76, 3.37 [00:17:03] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1903888881 secs [00:18:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.39, 3.78, 3.76 [00:20:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.35, 3.37, 3.07 [00:20:58] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.35, 3.58, 3.41 [00:22:09] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.15, 3.77, 3.27 [00:22:51] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.99, 3.05, 2.98 [00:23:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.47, 3.65, 3.94 [00:24:08] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.07, 3.34, 3.18 [00:24:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.91, 2.74, 3.32 [00:24:54] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.87, 2.85, 3.16 [00:25:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.66, 4.38, 4.16 [00:27:20] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.70, 4.92, 3.29 [00:27:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.60, 3.58, 3.89 [00:28:15] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.24, 3.91, 3.45 [00:33:03] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.60, 3.44, 3.20 [00:34:58] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.97, 2.59, 2.91 [00:35:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.68, 2.76, 3.31 [00:36:08] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.97, 3.71, 3.67 [00:39:51] !log [@mwtask141] starting deploy of {'config': True} to all [00:39:58] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [00:39:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:40:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:40:08] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.68, 2.60, 3.22 [00:41:03] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.08762747049 secs [00:53:20] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.10, 2.82 [00:54:51] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.86, 3.77, 3.55 [00:55:18] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.77, 2.72, 2.72 [00:56:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.28, 3.26, 2.71 [00:56:09] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.63, 3.54, 3.03 [00:57:43] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 7.15, 4.43, 3.44 [00:58:12] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.78, 4.13, 3.43 [01:00:03] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.32, 3.20, 3.04 [01:00:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.56, 3.15, 2.81 [01:00:07] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.67, 3.44, 3.26 [01:00:40] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.14, 2.88, 3.24 [01:01:24] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.nj.cn.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:01:36] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.63, 3.65, 3.36 [01:03:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 7.56, 4.45, 3.63 [01:05:30] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 7.08, 4.92, 3.88 [01:05:53] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 6.59, 4.78, 3.63 [01:06:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.66, 4.74, 3.52 [01:06:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 6.01, 4.22, 2.48 [01:07:19] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 11.58, 11.48, 7.94 [01:07:50] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.83, 3.93, 3.46 [01:08:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.59, 3.24, 2.34 [01:08:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.54, 3.68, 2.39 [01:09:17] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 5.84, 9.51, 7.66 [01:09:31] !log [@mwtask141] starting deploy of {'config': True} to all [01:09:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:09:40] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [01:09:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:09:48] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.10, 3.82, 3.46 [01:10:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.28, 3.33, 2.42 [01:13:12] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 21.93, 15.00, 10.21 [01:14:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 6.74, 4.83, 3.22 [01:17:08] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 4.45, 10.52, 9.55 [01:17:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 0.93, 3.06, 2.89 [01:19:06] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.69, 7.84, 8.68 [01:19:35] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 1.64, 3.54, 3.89 [01:20:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 1.80, 3.27, 3.74 [01:23:30] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 1.23, 2.36, 3.33 [01:23:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.31, 2.87, 3.98 [01:24:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.26, 2.65, 3.36 [01:24:55] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.35, 2.96, 3.97 [01:27:00] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.34, 4.31, 2.77 [01:28:54] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.57, 3.48, 2.64 [01:29:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.47, 2.14, 3.30 [01:30:49] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.30, 2.75, 2.47 [01:30:50] RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK [01:32:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.79, 2.36, 3.31 [01:40:25] !log [@mwtask141] starting deploy of {'config': True} to all [01:40:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:40:33] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [01:40:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:46:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.40, 3.07, 3.87 [01:50:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.62, 4.03, 4.06 [01:52:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.10, 3.40, 3.83 [01:54:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.74, 4.77, 4.30 [01:56:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.44, 3.44, 3.86 [01:56:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.87, 5.79, 3.34 [01:57:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 0.88, 2.67, 3.80 [02:00:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.01, 1.97, 3.14 [02:00:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.04, 3.40, 2.89 [02:01:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.81, 1.83, 3.17 [02:05:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 6.00, 5.07, 4.20 [02:07:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cparchiveswiki --missing (END - exit=65280) [02:07:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:10:29] !log [@mwtask141] starting deploy of {'config': True} to all [02:10:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:10:40] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 11s [02:10:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:14:50] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/a7330507f934 [02:14:53] [02miraheze/mw-config] 07paladox 03a733050 - Switch wikis beginning with r to swift [02:14:55] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [02:14:55] [url] Page not found · GitHub · GitHub | github.com [02:14:57] [02mw-config] 07paladox opened pull request 03#5004: Switch wikis beginning with r to swift - 13https://github.com/miraheze/mw-config/pull/5004 [02:14:57] ... [02:15:00] [02mw-config] 07paladox closed pull request 03#5004: Switch wikis beginning with r to swift - 13https://github.com/miraheze/mw-config/pull/5004 [02:15:00] ... [02:15:03] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [02:15:04] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/8c65e9cdb313...77cca37e4753 [02:15:05] [url] Comparing 8c65e9cdb313...77cca37e4753 · miraheze/mw-config · GitHub | github.com [02:15:05] [02miraheze/mw-config] 07paladox 0377cca37 - Switch wikis beginning with r to swift (#5004) [02:15:06] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [02:15:06] [url] Page not found · GitHub · GitHub | github.com [02:15:19] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [02:15:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:15:27] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [02:15:33] !log [paladox@mwtask141] starting deploy of {'config': True} to all [02:15:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:15:40] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [02:15:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:15:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:15:56] miraheze/mw-config - paladox the build passed. [02:16:02] miraheze/mw-config - paladox the build passed. [02:24:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.92, 4.20, 3.59 [02:25:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cpfanonwiki --missing (END - exit=65280) [02:25:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:25:43] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to test131 [02:25:44] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to test131 - SUCCESS in 1s [02:25:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:25:49] !log [paladox@test131] starting deploy of {'config': True} to test131 [02:25:50] !log [paladox@test131] finished deploy of {'config': True} to test131 - SUCCESS in 0s [02:25:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:25:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:26:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:28:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.55, 3.22, 3.37 [02:32:03] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.14, 3.58, 2.74 [02:34:01] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.12, 3.02, 2.64 [02:34:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.34, 4.42, 3.80 [02:38:55] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.50, 6.98, 3.94 [02:39:42] !log [@mwtask141] starting deploy of {'config': True} to all [02:39:54] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 12s [02:39:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:40:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:42:47] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.76, 3.74, 3.29 [02:44:43] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.76, 2.84, 3.02 [02:53:14] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.24, 3.59, 3.19 [02:54:10] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 23.89, 14.60, 9.12 [02:56:37] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=creepypastawiki --missing (END - exit=256) [02:56:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:56:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=crestwiki --missing (END - exit=256) [02:57:01] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.97, 3.88, 3.32 [02:57:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=crickipediawiki --missing (END - exit=256) [02:57:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=crimsoningotwiki --missing (END - exit=256) [02:57:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=crisiswiki --missing (END - exit=256) [02:57:19] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=criticalrolewiki --missing (END - exit=256) [02:57:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=crmnlyonwiki --missing (END - exit=256) [02:57:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:58:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:58:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.63, 3.57, 3.29 [02:59:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.88, 3.32, 3.28 [03:01:03] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=csaladtortenetwiki --missing (END - exit=256) [03:01:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=csawiki --missing (END - exit=256) [03:01:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=csswiki --missing (END - exit=256) [03:01:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:01:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:01:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:01:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ct777wiki --missing (END - exit=256) [03:01:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:02:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ctswiki --missing (END - exit=256) [03:02:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cubashianswiki --missing (END - exit=256) [03:02:09] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cubashwiki --missing (END - exit=256) [03:02:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:02:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cubiversewikiwiki --missing (END - exit=256) [03:02:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:02:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:02:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:02:37] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=culturevisionwiki --missing (END - exit=256) [03:02:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:02:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cupcakkescwiki --missing (END - exit=256) [03:02:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:02:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cursedarmorwiki --missing (END - exit=256) [03:02:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cursedcruisewiki --missing (END - exit=256) [03:03:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=customcountryhumanswiki --missing (END - exit=256) [03:03:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:03:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:03:22] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 16.16, 8.42, 4.45 [03:03:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:03:34] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cwarswiki --missing (END - exit=256) [03:03:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:04:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cyberiaprojectwiki --missing (END - exit=256) [03:04:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cyberlawwiki --missing (END - exit=256) [03:04:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cycwiki --missing (END - exit=256) [03:04:04] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cylitmwiki --missing (END - exit=256) [03:04:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cyphersupremacywiki --missing (END - exit=256) [03:04:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:04:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cztheotownwiki --missing (END - exit=256) [03:04:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:04:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=cztournamentwiki --missing (END - exit=256) [03:04:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:04:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:04:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=dalarwiki --missing (END - exit=256) [03:04:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:04:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:04:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:04:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:05:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=danganreloadedwiki --missing (END - exit=256) [03:05:03] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.2879631221 secs [03:05:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=danielwikiwiki --missing (END - exit=256) [03:05:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:05:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:05:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=daotfwikiwiki --missing (END - exit=256) [03:05:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:06:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=darklinguniversewiki --missing (END - exit=256) [03:06:19] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=darklord494tomewiki --missing (END - exit=256) [03:06:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=darkroomswiki --missing (END - exit=256) [03:06:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:06:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=darkwitchwiki --missing (END - exit=256) [03:06:38] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.18, 3.37, 3.31 [03:06:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:06:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:07:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:07:02] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.99, 5.16, 3.32 [03:09:05] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.98, 3.35, 3.41 [03:09:43] !log [@mwtask141] starting deploy of {'config': True} to all [03:09:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:09:52] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [03:09:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:10:54] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.18, 3.41, 3.00 [03:10:59] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.28, 3.04, 3.29 [03:11:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=decodedocdigitizewiki --missing (END - exit=65280) [03:11:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:12:50] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.40, 2.71, 2.79 [03:13:53] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=degreesoflewditywiki --missing (END - exit=256) [03:13:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:14:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.52, 9.17, 11.55 [03:16:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=diamondlegacywiki --missing (END - exit=256) [03:16:17] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.36, 4.01, 3.56 [03:16:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:17:03] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.0532182157 secs [03:17:35] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.47, 3.33, 3.11 [03:18:10] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 3.87, 6.89, 10.11 [03:18:12] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.60, 3.87, 3.57 [03:19:32] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.44, 3.82, 3.29 [03:20:08] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.64, 4.18, 3.71 [03:20:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.57, 6.88, 4.33 [03:22:05] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.93, 4.31, 3.47 [03:22:36] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 6.78, 5.89, 3.31 [03:29:01] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 9.86, 10.07, 10.23 [03:30:59] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 16.29, 11.67, 10.74 [03:40:35] !log [@mwtask141] starting deploy of {'config': True} to all [03:40:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:40:57] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 22s [03:41:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:46:44] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 8.26, 10.17, 11.56 [03:48:42] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 20.84, 13.92, 12.73 [03:52:08] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.65, 3.04, 2.66 [03:56:08] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.20, 2.68, 2.67 [04:00:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=eznirwiki --missing (END - exit=256) [04:00:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ezserwercomunitywiki --missing (END - exit=256) [04:00:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:00:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:01:04] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=faerunwiki --missing (END - exit=256) [04:01:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fairplayalliancewiki --missing (END - exit=256) [04:01:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:01:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:01:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fakeescwiki --missing (END - exit=256) [04:01:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:02:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=familiojwiki --missing (END - exit=256) [04:02:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=familyguywiki --missing (END - exit=256) [04:02:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:02:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:02:29] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 5.55, 8.65, 11.71 [04:02:39] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fanonkpopuwiki --missing (END - exit=256) [04:02:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:02:52] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fanonvillainsandherowiki --missing (END - exit=256) [04:02:53] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fanonworldwiki --missing (END - exit=256) [04:02:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:03:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:03:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fantamortowiki --missing (END - exit=256) [04:03:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:06:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.45, 3.29, 3.97 [04:09:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=finalfantasywiki --missing (END - exit=256) [04:09:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:10:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=finnwiki --missing (END - exit=256) [04:10:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:10:21] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 6.23, 7.24, 9.92 [04:10:31] !log [@mwtask141] starting deploy of {'config': True} to all [04:10:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=firestar464mapswiki --missing (END - exit=256) [04:10:38] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [04:10:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:10:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:11:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:11:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fivoaranaworldwiki --missing (END - exit=256) [04:11:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fixpediajpwiki --missing (END - exit=256) [04:11:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:11:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:13:09] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fnafheadcanonauwiki --missing (END - exit=256) [04:13:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:14:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.38, 2.26, 3.25 [04:16:30] PROBLEM - www.pornwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'en.pornwiki.org' expires in 15 day(s) (Tue 20 Dec 2022 04:08:50 GMT +0000). [04:17:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.52, 2.97, 3.85 [04:18:07] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 0.86, 2.02, 3.67 [04:21:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.77, 3.88, 3.96 [04:22:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.82, 3.22, 3.73 [04:22:10] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 14.30, 10.08, 9.24 [04:25:37] PROBLEM - en.pornwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'en.pornwiki.org' expires in 15 day(s) (Tue 20 Dec 2022 04:08:50 GMT +0000). [04:25:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.76, 3.68, 3.89 [04:26:10] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 7.83, 9.95, 9.48 [04:28:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.58, 3.53, 3.92 [04:32:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.33, 3.56, 3.99 [04:33:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.10, 3.42, 3.62 [04:34:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.70, 2.33, 3.23 [04:35:10] PROBLEM - pornwiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'en.pornwiki.org' expires in 15 day(s) (Tue 20 Dec 2022 04:08:50 GMT +0000). [04:35:41] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/56055dc0c10b...51b71436209b [04:35:42] [url] Comparing 56055dc0c10b...51b71436209b · miraheze/ssl · GitHub | github.com [04:35:44] [02miraheze/ssl] 07MirahezeSSLBot 0351b7143 - Bot: Update SSL cert for pornwiki.org [04:35:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.11, 2.22, 3.34 [04:37:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.14, 3.46, 3.61 [04:39:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.91, 6.03, 3.60 [04:39:54] !log [@mwtask141] starting deploy of {'config': True} to all [04:40:11] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 17s [04:40:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:40:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:40:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.13, 2.39, 3.93 [04:41:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.62, 3.04, 3.39 [04:45:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.61, 3.25, 3.09 [04:48:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=fohsarchivewiki --missing (END - exit=65280) [04:48:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:48:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.71, 3.62, 3.22 [04:48:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.95, 3.45, 3.70 [04:50:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.68, 3.75, 3.33 [04:50:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.01, 3.28, 3.61 [04:54:51] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.96, 2.90, 3.36 [04:56:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.45, 3.08, 3.18 [05:05:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.47, 2.83, 2.80 [05:06:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.72, 3.62, 2.79 [05:06:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.09, 4.08, 3.50 [05:08:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.97, 3.55, 2.86 [05:08:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.04, 4.53, 2.99 [05:09:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.74, 3.82, 3.20 [05:10:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=funkgmodwikiwiki --missing (END - exit=256) [05:10:47] !log [@mwtask141] starting deploy of {'config': True} to all [05:10:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:10:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.42, 3.40, 3.25 [05:10:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.57, 3.83, 3.56 [05:11:14] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 26s [05:11:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:11:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:11:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=futurologywiki --missing (END - exit=256) [05:11:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:11:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.67, 3.45, 3.14 [05:12:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.60, 2.91, 2.80 [05:12:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.96, 3.18, 2.85 [05:12:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=galaxyinwarwiki --missing (END - exit=256) [05:12:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:12:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=galizalaboralwiki --missing (END - exit=256) [05:12:45] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=gamebaikeshuwikiwiki --missing (END - exit=256) [05:12:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:12:51] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.86, 3.34, 3.40 [05:13:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:13:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.56, 3.16, 3.07 [05:14:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.95, 2.74, 3.01 [05:17:56] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=gesdocumentswiki --missing (END - exit=256) [05:18:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:20:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.52, 3.90, 3.57 [05:22:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.05, 3.60, 3.51 [05:22:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=glitcheswiki --missing (END - exit=256) [05:23:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:23:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=globalvisionwiki --missing (END - exit=256) [05:23:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:24:33] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=godherjawiki --missing (END - exit=256) [05:24:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:24:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.14, 3.27, 3.10 [05:24:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.23, 3.46, 3.44 [05:25:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=gomowiki --missing (END - exit=256) [05:25:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=goncharovwiki --missing (END - exit=256) [05:25:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:25:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:25:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=googologyforkidswiki --missing (END - exit=256) [05:25:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=googologywiki --missing (END - exit=256) [05:25:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:25:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:09] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=gppdue2p1cmwiki --missing (END - exit=256) [05:26:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=gpwwiki --missing (END - exit=256) [05:26:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=granadawiki --missing (END - exit=256) [05:26:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=grandlibraryofthetowerwiki --missing (END - exit=256) [05:26:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=gratisdatawiki --missing (END - exit=256) [05:26:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:34] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=gravityfallsrpgwiki --missing (END - exit=256) [05:26:37] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=grayhawkwiki --missing (END - exit=256) [05:26:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:42] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 30.66, 12.78, 5.71 [05:26:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:26:50] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.39, 3.37, 3.16 [05:26:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:27:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=greatestmovieswiki --missing (END - exit=256) [05:27:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=greenarchiveswiki --missing (END - exit=256) [05:27:45] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=greytotalitywiki --missing (END - exit=256) [05:28:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:28:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:28:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:28:42] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=gscwebwiki --missing (END - exit=256) [05:28:51] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 11.11, 10.86, 8.50 [05:28:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:29:17] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=guayoyophysicswiki --missing (END - exit=256) [05:29:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:29:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.62, 3.50, 3.12 [05:30:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 3.82, 3.69, 2.62 [05:30:49] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 5.43, 8.89, 8.07 [05:30:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.84, 3.68, 3.34 [05:31:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.52, 3.66, 3.21 [05:32:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.90, 3.36, 3.27 [05:33:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.87, 3.30, 3.13 [05:34:30] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 2.52, 3.19, 2.69 [05:34:57] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.53, 3.98, 3.20 [05:36:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 1.71, 3.60, 3.83 [05:37:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hitnrunwiki --missing (END - exit=256) [05:37:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hivearchiveswiki --missing (END - exit=256) [05:37:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:37:25] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hkbibbenwiki --missing (END - exit=256) [05:37:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:37:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:37:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hkrailwiki --missing (END - exit=256) [05:37:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:38:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.12, 3.76, 3.85 [05:39:59] !log [@mwtask141] starting deploy of {'config': True} to all [05:40:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:40:10] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 11s [05:40:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:40:50] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.60, 3.72, 3.39 [05:40:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.62, 3.29, 3.67 [05:41:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hotdsmoddingwiki --missing (END - exit=256) [05:41:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:42:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hrfwiki2wiki --missing (END - exit=256) [05:42:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:42:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=huaxiapediawiki --missing (END - exit=256) [05:42:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:42:48] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.12, 3.66, 3.39 [05:43:35] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hunalwiki --missing (END - exit=256) [05:43:39] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=huntersmoonwiki --missing (END - exit=256) [05:43:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=huntingpatrolswiki --missing (END - exit=256) [05:43:42] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hurdawiki --missing (END - exit=256) [05:43:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:43:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=husgswiki --missing (END - exit=256) [05:43:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:43:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=huskypediawiki --missing (END - exit=256) [05:43:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hwotswiki --missing (END - exit=256) [05:43:52] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hwshstudywiki --missing (END - exit=256) [05:43:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:43:53] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hydrowikiwiki --missing (END - exit=256) [05:43:54] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hylormcwiki --missing (END - exit=256) [05:43:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hyperbolicawiki --missing (END - exit=256) [05:43:56] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hypercanewiki --missing (END - exit=256) [05:43:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hypmicarbwiki --missing (END - exit=256) [05:43:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:43:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hypopediawiki --missing (END - exit=256) [05:43:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hypotheticalsevereweatherwiki --missing (END - exit=256) [05:44:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hypotheticalwikiwiki --missing (END - exit=256) [05:44:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=hyratewiki --missing (END - exit=256) [05:44:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ianyinwiki --missing (END - exit=256) [05:44:03] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=icarlyfanonwiki --missing (END - exit=256) [05:44:04] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=icarlywiki --missing (END - exit=256) [05:44:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=icclopediawiki --missing (END - exit=256) [05:44:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iccwiki --missing (END - exit=256) [05:44:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iceriawiki --missing (END - exit=256) [05:44:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iconswiki --missing (END - exit=256) [05:44:09] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ics3wiki --missing (END - exit=256) [05:44:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=idcwiki --missing (END - exit=256) [05:44:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ideaswiki --missing (END - exit=256) [05:44:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ideologistheavenwiki --missing (END - exit=256) [05:44:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ideologywiki --missing (END - exit=256) [05:44:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=idiomaswiki --missing (END - exit=256) [05:44:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=idiotentruppdndwiki --missing (END - exit=256) [05:44:16] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=idlecraftwiki --missing (END - exit=256) [05:44:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:17] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=idleonwiki --missing (END - exit=256) [05:44:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=idolish7wiki --missing (END - exit=256) [05:44:19] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=idwbwiki --missing (END - exit=256) [05:44:20] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iediwiki --missing (END - exit=256) [05:44:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ifswwiki --missing (END - exit=256) [05:44:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=igeniawiki --missing (END - exit=256) [05:44:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ignwiki --missing (END - exit=256) [05:44:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=igrovyesistemywiki --missing (END - exit=256) [05:44:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:25] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iitgnwiki --missing (END - exit=256) [05:44:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ikgrossegruppenwiki --missing (END - exit=256) [05:44:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ikhiwiki --missing (END - exit=256) [05:44:28] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iliyawikiwiki --missing (END - exit=256) [05:44:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=illanuriumwiki --missing (END - exit=256) [05:44:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=illidanstormrageapswiki --missing (END - exit=256) [05:44:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=illunwiki --missing (END - exit=256) [05:44:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ilvandorwiki --missing (END - exit=256) [05:44:33] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imagewiki --missing (END - exit=256) [05:44:34] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imaginaryhistorywiki --missing (END - exit=256) [05:44:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:35] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imaginarypediawiki --missing (END - exit=256) [05:44:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imaginatewiki --missing (END - exit=256) [05:44:37] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imaginationlandwiki --missing (END - exit=256) [05:44:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imagineerwiki --missing (END - exit=256) [05:44:39] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imagiworldswiki --missing (END - exit=256) [05:44:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imlathwiki --missing (END - exit=256) [05:44:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=immanuellewiki --missing (END - exit=256) [05:44:42] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=immortallifewiki --missing (END - exit=256) [05:44:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=immortaltaoistswiki --missing (END - exit=256) [05:44:44] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=immunosystemswiki --missing (END - exit=256) [05:44:45] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=impactwiki --missing (END - exit=256) [05:44:46] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.96, 2.96, 3.16 [05:44:46] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imperfectionwiki --missing (END - exit=256) [05:44:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imperiosperdidoswiki --missing (END - exit=256) [05:44:48] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=impytowiki --missing (END - exit=256) [05:44:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=imtwiki --missing (END - exit=256) [05:44:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=inanimateinsanitywiki --missing (END - exit=256) [05:44:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=incredibleobjectshowswiki --missing (END - exit=256) [05:44:51] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.48, 2.70, 3.33 [05:44:52] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=incubatorwiki --missing (END - exit=256) [05:44:53] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=indiefilmswiki --missing (END - exit=256) [05:44:54] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=indus2103wiki --missing (END - exit=256) [05:44:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=industrialroboticswiki --missing (END - exit=256) [05:44:56] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=inextwiki --missing (END - exit=256) [05:44:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infectopedwiki --missing (END - exit=256) [05:44:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=inferiorrtrainswiki --missing (END - exit=256) [05:44:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=inferno13wiki --missing (END - exit=256) [05:45:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infiniterealmswiki --missing (END - exit=256) [05:45:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infinitycupwiki --missing (END - exit=256) [05:45:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infinityislandwiki --missing (END - exit=256) [05:45:03] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infinitykyokiwiki --missing (END - exit=256) [05:45:04] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infiversewikiwiki --missing (END - exit=256) [05:45:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=info4stevewiki --missing (END - exit=256) [05:45:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infomediawiki --missing (END - exit=256) [05:45:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=inforevivalwiki --missing (END - exit=256) [05:45:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=informaticosexclusivoswiki --missing (END - exit=256) [05:45:09] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=informationsbankenwiki --missing (END - exit=256) [05:45:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infprojekt1awiki --missing (END - exit=256) [05:45:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infraredwiki --missing (END - exit=256) [05:45:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=infrawikiwiki --missing (END - exit=256) [05:45:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ingamewiki --missing (END - exit=256) [05:45:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ingentionarywiki --missing (END - exit=256) [05:45:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ingenwiki --missing (END - exit=256) [05:45:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:45:16] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=inginfoundavwiki --missing (END - exit=256) [05:45:17] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ingredientswiki --missing (END - exit=256) [05:45:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=inlimbowiki --missing (END - exit=256) [05:45:20] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=inmcnwiki --missing (END - exit=256) [05:45:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=inourownwordswiki --missing (END - exit=256) [05:45:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:45:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:45:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:45:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:45:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.14, 3.77, 3.33 [05:45:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=internationaliseringwiki --missing (END - exit=256) [05:45:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=internetcrasherswiki --missing (END - exit=256) [05:45:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=internetspacetest10wiki --missing (END - exit=256) [05:46:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=interpediawiki --missing (END - exit=256) [05:46:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=intersectionalaiwiki --missing (END - exit=256) [05:46:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=interviewdatabasewiki --missing (END - exit=256) [05:46:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 0.85, 1.96, 3.69 [05:46:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:37] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=intothewoodswiki --missing (END - exit=256) [05:46:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iotiawiki --missing (END - exit=256) [05:46:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iowikiwiki --missing (END - exit=256) [05:46:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:46:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ipaperclipwiki --missing (END - exit=256) [05:47:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ipchwiki --missing (END - exit=256) [05:47:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:47:03] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ipkm2122wiki --missing (END - exit=256) [05:47:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:47:09] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ipolywiki --missing (END - exit=256) [05:47:25] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iraqwikiwiki --missing (END - exit=256) [05:47:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:47:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iridiawiki --missing (END - exit=256) [05:47:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:47:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:47:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=irlgroupwiki --missing (END - exit=256) [05:47:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:47:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.20, 3.57, 3.32 [05:48:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:48:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:48:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=irwikiwiki --missing (END - exit=256) [05:48:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:48:30] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 26.18, 13.20, 8.79 RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.80, 1.61, 3.35 [05:48:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:48:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:48:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=islamiclibrarywiki --missing (END - exit=256) [05:49:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=islamikoshwiki --missing (END - exit=256) [05:49:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=islamipediawiki --missing (END - exit=256) [05:49:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:20] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=islamwikiwiki --missing (END - exit=256) [05:49:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=islasreinalditowiki --missing (END - exit=256) [05:49:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=isowrwiki --missing (END - exit=256) [05:49:33] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=isvwiki --missing (END - exit=256) [05:49:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=itabcwiki --missing (END - exit=256) [05:49:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=italywiki --missing (END - exit=256) [05:49:42] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=itangrysignswiki --missing (END - exit=256) [05:49:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=itcwikiwiki --missing (END - exit=256) [05:49:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=itmlwiki --missing (END - exit=256) [05:49:52] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=itorawiki --missing (END - exit=256) [05:49:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:49:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.30, 3.04, 3.14 [05:49:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=itreferencewiki --missing (END - exit=256) [05:49:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=itrtgwiki --missing (END - exit=256) [05:50:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=iuwikiwiki --missing (END - exit=256) [05:50:16] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=izanagiwiki --missing (END - exit=256) [05:50:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=izzyxvibeswiki --missing (END - exit=256) [05:50:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=jaberwokwiki --missing (END - exit=256) [05:50:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=jacobnetworkwiki --missing (END - exit=256) [05:50:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=jadtechwiki --missing (END - exit=256) [05:50:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=jafipediawiki --missing (END - exit=256) [05:50:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:33] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=jagseapatrolwiki --missing (END - exit=256) [05:50:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:50:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.09, 3.50, 3.50 [05:50:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:51:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:52:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.07, 4.09, 3.71 [05:53:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:53:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:54:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kabupediawiki --missing (END - exit=256) [05:56:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kachowwiki --missing (END - exit=256) [05:56:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kaeriawiki --missing (END - exit=256) [05:56:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kagakuwiki --missing (END - exit=256) [05:56:28] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kaigenwiki --missing (END - exit=256) [05:56:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kaiwiki --missing (END - exit=256) [05:56:30] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.36, 3.49, 3.40 [05:56:34] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kakukokkawiki --missing (END - exit=256) [05:56:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:52] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.56, 3.66, 3.63 [05:57:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:57:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:57:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kansascityokwiki --missing (END - exit=256) [05:57:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:57:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kaohsiungwiki --missing (END - exit=256) [05:57:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kaoruhanawarintosakuwiki --missing (END - exit=256) [05:57:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:57:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kapswiki --missing (END - exit=256) [05:57:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:57:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:58:31] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.59, 2.69, 3.11 [05:58:51] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 1.85, 2.95, 3.37 [05:59:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:59:20] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kayfamilywiki --missing (END - exit=256) [05:59:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:59:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kaylaandrachelwiki --missing (END - exit=256) [05:59:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:59:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:59:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:00:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:00:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:00:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:00:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:00:19] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 12.28, 10.02, 6.84 [06:00:20] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 5.06, 11.47, 11.62 [06:00:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:00:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:00:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:00:49] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 12.85, 10.44, 6.94 [06:00:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kesmaiwiki --missing (END - exit=256) [06:01:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:01:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:02:15] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 5.35, 8.13, 6.52 [06:02:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:02:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:02:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:02:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:02:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:02:49] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 6.20, 8.54, 6.65 [06:02:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:02:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:03:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:03:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:03:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:03:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:03:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:03:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:16] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 4.25, 8.03, 10.20 [06:04:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:04:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=korczakwiki --missing (END - exit=256) [06:07:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=koreacompositionwiki --missing (END - exit=256) [06:07:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=koreadongyowiki --missing (END - exit=256) [06:07:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=koreanbetawikiwiki --missing (END - exit=256) [06:07:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=koreavisionwiki --missing (END - exit=256) [06:07:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kormitsresultswiki --missing (END - exit=256) [06:07:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:35] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kotswiki --missing (END - exit=256) [06:07:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kourouklideswiki --missing (END - exit=256) [06:07:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=koywiki --missing (END - exit=256) [06:07:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kranditriwiki --missing (END - exit=256) [06:07:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:07:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=krisenvorsorgewiki --missing (END - exit=256) [06:07:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kronologoswiki --missing (END - exit=256) [06:08:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:08:03] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ksmwikiwiki --missing (END - exit=256) [06:08:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ksongcontestwiki --missing (END - exit=256) [06:08:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ktkijuwiki --missing (END - exit=256) [06:08:23] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.21, 3.77, 2.48 [06:08:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kubawiki --missing (END - exit=256) [06:08:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:08:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kugelnio2wiki --missing (END - exit=256) [06:08:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kugelniowiki --missing (END - exit=256) [06:08:28] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kunwokwiki --missing (END - exit=256) [06:08:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kurakonwiki --missing (END - exit=256) [06:08:33] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kurchatovwiki --missing (END - exit=256) [06:08:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kuroiwamedakawiki --missing (END - exit=256) [06:08:39] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kurtlarvadisiwiki --missing (END - exit=256) [06:08:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:08:48] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=kwiki --missing (END - exit=256) [06:08:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:08:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ky5wiki --missing (END - exit=256) [06:09:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=l2x9wiki --missing (END - exit=256) [06:09:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lab612wiki --missing (END - exit=256) [06:09:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:09:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=labcdelsaberwiki --missing (END - exit=256) [06:09:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=labernyekwiki --missing (END - exit=256) [06:09:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:09:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=labirintiedraghiwiki --missing (END - exit=256) [06:09:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=labwikiqhewiki --missing (END - exit=256) [06:09:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lacserpentwiki --missing (END - exit=256) [06:09:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lakehubwiki --missing (END - exit=256) [06:09:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lamaisniedaltbergwiki --missing (END - exit=256) [06:09:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:09:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lamevawikiwiki --missing (END - exit=256) [06:09:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lamostwiki --missing (END - exit=256) [06:09:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:09:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:09:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lanainternationalcontestwiki --missing (END - exit=256) [06:09:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=landofliberoswiki --missing (END - exit=256) [06:09:44] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=landsunknownwiki --missing (END - exit=256) [06:09:45] !log [@mwtask141] starting deploy of {'config': True} to all [06:09:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=langwikiwiki --missing (END - exit=256) [06:09:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=laptopswiki --missing (END - exit=256) [06:09:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:09:52] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=laraniemarywiki --missing (END - exit=256) [06:09:53] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [06:09:54] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=laraniemwiki --missing (END - exit=256) [06:09:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=largeduwiki --missing (END - exit=256) [06:10:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:10:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=laserfusionwiki --missing (END - exit=256) [06:10:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=laseriedefranciscowikiwiki --missing (END - exit=256) [06:10:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=latigrewiki --missing (END - exit=256) [06:10:10] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 97.37, 47.65, 24.49 [06:10:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:10:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=latinosineflexionewiki --missing (END - exit=256) [06:10:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=latunnelswiki --missing (END - exit=256) [06:10:20] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lavoniawiki --missing (END - exit=256) [06:10:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.66, 3.02, 2.36 [06:10:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lawwiki --missing (END - exit=256) [06:10:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lazytownencyclopediawikiwiki --missing (END - exit=256) [06:10:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lcaeentertainmentwiki --missing (END - exit=256) [06:10:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:10:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lcfssbwiki --missing (END - exit=256) [06:10:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lcmcproincwikiawiki --missing (END - exit=256) [06:10:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ldapwikiwiki --missing (END - exit=256) [06:10:39] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=lde2wiki --missing (END - exit=256) [06:10:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:10:46] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=leacontestwiki --missing (END - exit=256) [06:10:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:10:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=leafgeometrywiki --missing (END - exit=256) [06:10:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=leagueofnationwiki --missing (END - exit=256) [06:11:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=leahtherapywiki --missing (END - exit=256) [06:11:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:11:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=learnerwiki --missing (END - exit=256) [06:11:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=learningwiki --missing (END - exit=256) [06:11:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:11:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=learnwiki --missing (END - exit=256) [06:11:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:11:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:11:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:11:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:11:45] PROBLEM - cloud11 Current Load on cloud11 is CRITICAL: CRITICAL - load average: 72.38, 50.90, 33.56 [06:11:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:11:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:11:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:12:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:13:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:13:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:13:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:13:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:13:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:14:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:14:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:14:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:15:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:15:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:15:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:15:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:15:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:15:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:16:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:19:45] RECOVERY - cloud11 Current Load on cloud11 is OK: OK - load average: 17.27, 39.02, 37.62 [06:19:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.44, 2.92, 2.61 [06:21:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.21, 2.82, 2.60 [06:34:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.42, 2.99, 4.00 [06:36:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.02, 3.79, 4.16 [06:38:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=mergenymphswiki --missing (END - exit=256) [06:38:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:39:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=metalwiki --missing (END - exit=256) [06:39:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:39:33] !log [@mwtask141] starting deploy of {'config': True} to all [06:39:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:39:45] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 11s [06:39:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=metroidwiki --missing (END - exit=256) [06:39:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:40:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:40:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=mettswikiwiki --missing (END - exit=256) [06:40:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:40:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=mgwwiki --missing (END - exit=256) [06:40:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:41:35] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=microvaultwiki --missing (END - exit=256) [06:41:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:41:56] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=miernaswiki --missing (END - exit=256) [06:42:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:44:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 4.38, 5.09, 11.40 [06:48:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.06, 3.45, 3.90 [06:48:10] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 3.26, 4.22, 9.60 [06:50:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 8.09, 4.67, 4.25 [06:53:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.89, 3.47, 3.05 [06:55:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.26, 3.28, 3.02 [06:58:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.67, 3.36, 2.78 [06:59:20] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 13.21, 6.60, 3.60 [07:02:51] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 1.68, 3.03, 2.84 [07:03:09] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.03, 3.78, 3.12 [07:05:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.86, 2.93, 2.89 [07:06:43] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.54, 3.74, 3.26 [07:09:42] !log [@mwtask141] starting deploy of {'config': True} to all [07:09:48] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [07:09:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:09:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:10:34] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.11, 3.47, 3.26 [07:12:30] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.90, 3.21, 3.18 [07:18:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.77, 3.23, 3.97 [07:30:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.24, 3.45, 3.54 [07:35:59] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.78, 3.16, 2.83 [07:37:56] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.84, 2.96, 2.80 [07:38:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.79, 3.53, 1.99 [07:39:50] !log [@mwtask141] starting deploy of {'config': True} to all [07:39:58] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [07:40:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:40:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:50:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.50, 3.67, 3.60 [07:52:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.08, 3.05, 3.84 [07:52:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.84, 2.70, 3.25 [07:55:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.18, 2.41, 3.92 [07:56:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.81, 3.65, 3.88 [07:58:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.29, 2.68, 3.49 [07:58:30] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.84, 5.10, 2.59 [08:00:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 0.55, 2.01, 3.15 [08:02:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.49, 3.60, 2.58 [08:04:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.79, 2.63, 2.35 [08:05:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.03, 3.14, 3.59 [08:07:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.20, 2.77, 3.40 [08:10:09] !log [@mwtask141] starting deploy of {'config': True} to all [08:10:28] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 18s [08:10:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:10:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:11:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.45, 3.99, 3.81 [08:15:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 7.02, 5.98, 4.66 [08:22:41] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.02, 3.79, 3.23 [08:24:34] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.49, 3.26, 3.10 [08:31:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.88, 3.19, 3.87 [08:33:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 7.26, 4.17, 4.11 [08:38:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.66, 4.44, 3.47 [08:40:19] !log [@mwtask141] starting deploy of {'config': True} to all [08:40:30] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 11s [08:40:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:40:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:46:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.82, 3.49, 3.53 [08:50:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.79, 4.03, 3.71 [08:52:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.72, 3.67, 3.63 [08:54:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 0.86, 2.69, 3.28 [09:01:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.23, 3.33, 2.71 [09:02:30] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.32, 3.55, 2.86 [09:03:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.24, 3.20, 3.96 [09:03:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.49, 2.87, 2.62 [09:04:27] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.60, 3.18, 2.81 [09:04:36] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.104231894 secs [09:05:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 12.84, 5.29, 4.54 [09:09:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.20, 3.23, 3.90 [09:09:40] !log [@mwtask141] starting deploy of {'config': True} to all [09:09:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:09:46] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [09:10:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:12:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.16, 4.21, 2.43 [09:14:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.27, 3.03, 2.21 [09:15:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.05, 4.04, 4.01 [09:17:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.52, 3.34, 3.75 [09:21:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.90, 2.60, 3.34 [09:32:36] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09352216125 secs [09:33:22] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=aerosteonwiki --no-updates --username-prefix=mh:aerosteon /home/reception/ImportDump/aerosteonwiki-20221203222604.xml (START) [09:33:26] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=aerosteonwiki --no-updates --username-prefix=mh:aerosteon /home/reception/ImportDump/aerosteonwiki-20221203222604.xml (END - exit=0) [09:33:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:33:27] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=aerosteonwiki (START) [09:33:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:33:31] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=aerosteonwiki (END - exit=0) [09:33:32] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=aerosteonwiki --active --update (END - exit=0) [09:33:33] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=monolithwiki --no-updates --username-prefix=mh:monolith /home/reception/ImportDump/monolithwiki-20221203224923.xml (START) [09:33:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:33:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:33:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:33:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:34:10] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=theredpionnerwiki --no-updates /home/reception/ImportDump/theredpionnerwiki-20221204084120.xml (START) [09:34:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:34:48] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=theredpionnerwiki --no-updates /home/reception/ImportDump/theredpionnerwiki-20221204084120.xml (END - exit=0) [09:34:49] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=theredpionnerwiki (START) [09:34:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:35:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:37:47] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.30, 3.00, 2.94 [09:38:07] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=monolithwiki --no-updates --username-prefix=mh:monolith /home/reception/ImportDump/monolithwiki-20221203224923.xml (END - exit=0) [09:38:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=monolithwiki (START) [09:38:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:38:15] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.19, 4.30, 3.34 [09:38:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:39:41] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.93, 3.14, 3.01 [09:40:09] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.02, 3.35, 3.10 [09:40:13] !log [@mwtask141] starting deploy of {'config': True} to all [09:40:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:40:20] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [09:40:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:41:02] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=monolithwiki (END - exit=0) [09:41:03] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=monolithwiki --active --update (END - exit=0) [09:41:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:41:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:45:37] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 6.85, 4.31, 2.74 [09:53:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.57, 3.58, 3.10 [09:57:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.27, 4.06, 3.38 [09:58:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.94, 2.80, 1.69 [10:00:31] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.69, 3.18, 2.00 [10:03:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 0.85, 2.85, 3.19 [10:10:40] !log [@mwtask141] starting deploy of {'config': True} to all [10:10:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:10:47] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [10:10:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:14:52] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=theredpionnerwiki (END - exit=0) [10:14:53] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=theredpionnerwiki --active --update (END - exit=0) [10:14:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:15:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:31:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1217154562 secs [10:31:37] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.69, 1.77, 3.80 [10:34:28] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.81, 3.28, 2.01 [10:35:37] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.57, 1.65, 3.28 [10:36:29] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 6.21, 4.17, 2.48 [10:38:28] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.50, 3.71, 2.54 [10:39:36] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.0770445466 secs [10:40:12] !log [@mwtask141] starting deploy of {'config': True} to all [10:40:18] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [10:40:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.80, 3.48, 2.07 [10:40:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:40:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:40:28] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.98, 2.78, 2.34 [10:41:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.40, 4.19, 2.60 [10:43:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.47, 3.13, 2.40 [10:44:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.52, 3.34, 2.43 [11:10:25] !log [@mwtask141] starting deploy of {'config': True} to all [11:10:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:10:30] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [11:10:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:25:41] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.66, 3.83, 2.86 [11:27:35] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.12, 3.37, 2.82 [11:29:02] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.65, 3.33, 2.74 [11:30:57] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.88, 3.20, 2.77 [11:40:05] !log [@mwtask141] starting deploy of {'config': True} to all [11:40:16] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 10s [11:40:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:40:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:45:35] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 6.18, 5.76, 3.97 [11:49:23] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 0.76, 3.10, 3.27 [11:55:04] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 2.24, 4.08, 3.75 [11:59:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 0.94, 3.06, 3.48 [12:02:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=mrjaroslavikwiki --missing (END - exit=256) [12:02:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:03:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 0.85, 2.41, 3.16 [12:09:48] !log [@mwtask141] starting deploy of {'config': True} to all [12:09:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:09:56] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [12:10:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=nrescwiki --missing (END - exit=256) [12:23:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=nscreatopiawiki --missing (END - exit=256) [12:23:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=nspbcanonwiki --missing (END - exit=256) [12:23:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=nugridwiki --missing (END - exit=256) [12:23:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.27, 3.91, 2.38 [12:24:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=nutlingswiki --missing (END - exit=256) [12:24:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:54] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=nymphiawiki --missing (END - exit=256) [12:24:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:25:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=nynthidbwiki --missing (END - exit=256) [12:25:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:25:16] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.62, 2.88, 2.49 [12:25:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=occultlibrarywiki --missing (END - exit=256) [12:26:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:26:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=oceanvillewiki --missing (END - exit=256) [12:26:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ocesamwiki --missing (END - exit=256) [12:26:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:26:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:26:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.75, 2.82, 1.66 [12:28:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=officialmusicianfanbasewiki --missing (END - exit=256) [12:28:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:28:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.26, 2.79, 1.81 [12:29:04] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 3.02, 3.16, 2.74 [12:30:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.70, 3.32, 2.69 [12:33:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.29, 3.94, 3.14 [12:37:35] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.325172931 secs [12:39:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.58, 3.70, 3.46 [12:39:39] !log [@mwtask141] starting deploy of {'config': True} to all [12:39:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:39:45] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [12:39:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:41:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.78, 2.95, 3.20 [12:45:06] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1013435125 secs [12:53:35] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.008511990309 secs [12:59:03] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08070802689 secs [13:08:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.92, 3.25, 1.87 [13:09:25] !log [@mwtask141] starting deploy of {'config': True} to all [13:09:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:09:52] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 26s [13:09:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:16:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.55, 3.23, 3.01 [13:21:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.96, 3.15, 2.70 [13:23:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.94, 2.53, 2.52 [13:27:12] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.83, 3.53, 2.46 [13:29:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.23, 3.36, 2.55 [13:36:40] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.72, 4.20, 3.16 [13:40:22] !log [@mwtask141] starting deploy of {'config': True} to all [13:40:28] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.84, 3.52, 3.16 [13:40:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:40:30] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [13:40:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:42:21] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.84, 3.02, 3.02 [13:43:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.28, 3.35, 2.92 [13:45:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.18, 2.86, 2.79 [13:45:36] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [13:49:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 9.05, 4.89, 3.56 [13:52:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.35, 4.25, 3.49 [13:53:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.49, 3.48, 3.32 [13:54:17] PROBLEM - bankerpedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for bankerpedia.com could not be found [13:55:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 7.35, 4.21, 3.56 [13:57:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.56, 3.66, 3.45 [13:57:16] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/77cca37e4753...bdec04d8e6e6 [13:57:17] [url] Comparing 77cca37e4753...bdec04d8e6e6 · miraheze/mw-config · GitHub | github.com [13:57:18] [02miraheze/mw-config] 07paladox 03bdec04d - Switch wikis beginning with p to swift [13:57:30] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [13:57:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:57:37] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [13:57:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:57:54] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [13:57:56] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [13:58:01] !log [paladox@test131] starting deploy of {'config': True} to all [13:58:02] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [13:58:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.32, 3.90, 3.65 [13:58:08] !log [paladox@mwtask141] starting deploy of {'config': True} to all [13:58:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:58:13] miraheze/mw-config - paladox the build passed. [13:58:14] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [13:58:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:58:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:58:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:58:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:58:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:59:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.20, 2.89, 3.20 [13:59:48] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/bdec04d8e6e6...52601a3dc9fb [13:59:49] [url] Comparing bdec04d8e6e6...52601a3dc9fb · miraheze/mw-config · GitHub | github.com [13:59:49] [02miraheze/mw-config] 07paladox 0352601a3 - Switch wikis beginning with s to swift [13:59:50] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [13:59:53] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [13:59:54] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 0s [13:59:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:59:56] !log [paladox@test131] starting deploy of {'config': True} to all [13:59:57] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [13:59:58] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 6s [13:59:59] !log [paladox@mwtask141] starting deploy of {'config': True} to all [14:00:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:00:04] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [14:00:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:00:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.50, 3.13, 3.40 [14:00:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:00:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:00:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:00:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:00:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:00:44] miraheze/mw-config - paladox the build passed. [14:00:59] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/52601a3dc9fb...7607c22c40bc [14:01:00] [url] Comparing 52601a3dc9fb...7607c22c40bc · miraheze/mw-config · GitHub | github.com [14:01:01] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [14:01:02] [02miraheze/mw-config] 07paladox 037607c22 - Switch wikis beginning with t to swift [14:01:04] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [14:01:05] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [14:01:07] !log [paladox@test131] starting deploy of {'config': True} to all [14:01:08] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [14:01:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:01:11] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 10s [14:01:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:01:13] !log [paladox@mwtask141] starting deploy of {'config': True} to all [14:01:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:01:28] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 14s [14:01:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:01:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:01:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:01:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:01:59] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7607c22c40bc...58c71db4b82e [14:01:59] [url] Comparing 7607c22c40bc...58c71db4b82e · miraheze/mw-config · GitHub | github.com [14:02:00] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [14:02:01] [02miraheze/mw-config] 07paladox 0358c71db - Switching wikis beginning with u to swift [14:02:02] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [14:02:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:03] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [14:02:04] !log [paladox@test131] starting deploy of {'config': True} to all [14:02:05] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [14:02:08] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [14:02:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:10] !log [paladox@mwtask141] starting deploy of {'config': True} to all [14:02:10] miraheze/mw-config - paladox the build passed. [14:02:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:14] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 4s [14:02:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:59] miraheze/mw-config - paladox the build passed. [14:03:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 4.00, 3.78, 2.90 [14:04:53] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.41, 3.53, 2.94 [14:05:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.84, 4.31, 3.21 [14:05:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.59, 10.56, 8.10 [14:07:54] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.22, 9.81, 8.15 [14:08:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.94, 3.99, 3.28 [14:10:00] PROBLEM - bankerpedia.com - LetsEncrypt on sslhost is CRITICAL: connect to address bankerpedia.com and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [14:10:33] !log [@mwtask141] starting deploy of {'config': True} to all [14:10:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:10:42] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [14:10:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:10:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.04, 4.41, 3.49 [14:10:52] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.92, 3.91, 2.97 [14:11:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.21, 3.08, 2.85 [14:13:00] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.36, 2.79, 2.77 [14:13:48] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.88, 3.33, 2.67 [14:14:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.98, 3.59, 3.28 [14:15:46] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.22, 3.87, 2.92 [14:15:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.65, 3.34, 2.19 [14:17:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 8.00, 6.38, 4.26 [14:18:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.87, 5.07, 3.91 [14:24:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.06, 3.48, 3.67 [14:25:34] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.28, 3.91, 3.63 [14:25:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 1.55, 3.54, 3.36 [14:27:47] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 2.26, 3.11, 3.22 [14:29:30] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.38, 4.25, 3.80 [14:30:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.03, 4.15, 3.82 [14:33:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 6.25, 4.73, 3.85 [14:36:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.78, 3.40, 3.67 [14:39:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 1.74, 3.86, 3.91 [14:40:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.15, 3.59, 3.70 [14:40:42] !log [@mwtask141] starting deploy of {'config': True} to all [14:40:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:40:48] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [14:41:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:41:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.20, 3.77, 3.85 [14:43:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.56, 3.18, 3.62 [14:45:42] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 13.94, 10.74, 8.57 [14:46:08] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.48, 3.06, 2.04 [14:47:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.62, 3.53, 3.63 [14:48:08] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.28, 2.38, 1.91 [14:49:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 3.64, 3.68, 3.69 [14:52:08] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.87, 3.62, 2.50 [14:53:47] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 3.25, 3.05, 3.39 [14:56:08] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 2.22, 3.52, 2.74 [14:58:08] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.56, 3.08, 2.67 [15:01:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.10, 4.56, 3.90 [15:02:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballanarchywiki --missing (END - exit=65280) [15:02:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:03:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballwiki --missing (END - exit=65280) [15:03:25] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 4.00, 9.75, 11.80 [15:03:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 1.71, 3.49, 3.59 [15:04:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:09:19] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 6.03, 6.81, 9.77 [15:10:19] !log [@mwtask141] starting deploy of {'config': True} to all [15:10:29] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 9s [15:10:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:10:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:13:47] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.63, 2.73, 3.21 [15:13:54] ugochimobi: hi, see your DMs on Discord when you can :) [15:17:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.93, 7.17, 4.84 [15:17:59] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=twistedwonderlandwiki --missing (START) [15:18:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:19:38] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/58c71db4b82e...3488a320549c [15:19:39] [url] Comparing 58c71db4b82e...3488a320549c · miraheze/mw-config · GitHub | github.com [15:19:41] [02miraheze/mw-config] 07paladox 033488a32 - Switching wikis beginning with x to swift [15:19:44] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [15:19:46] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [15:19:48] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [15:19:49] !log [paladox@test131] starting deploy of {'config': True} to all [15:19:50] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [15:19:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:19:54] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s [15:19:55] !log [paladox@mwtask141] starting deploy of {'config': True} to all [15:19:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:20:00] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 4s [15:20:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:20:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:20:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:20:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:20:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:20:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:20:52] miraheze/mw-config - paladox the build passed. [15:25:01] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 10.51, 9.85, 9.71 [15:26:59] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 12.81, 11.25, 10.26 [15:29:31] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.93, 3.44, 2.78 [15:30:39] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.73, 1.61, 1.21 [15:30:55] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 9.92, 11.73, 10.77 [15:31:28] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.66, 3.13, 2.74 [15:32:39] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.60, 1.67, 1.29 [15:34:51] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 14.22, 12.14, 11.07 [15:36:50] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 9.91, 11.05, 10.78 [15:38:25] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.27, 5.03, 2.87 [15:40:23] !log [@mwtask141] starting deploy of {'config': True} to all [15:40:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:40:35] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 12s [15:40:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:40:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=remyvallcareerstatisticswiki --missing (END - exit=256) [15:40:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=renryuuwiki --missing (END - exit=256) [15:41:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=rent2022wiki --missing (END - exit=256) [15:41:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:41:09] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=renyakaduskwiki --missing (END - exit=256) [15:41:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:41:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:41:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:41:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=repositorimatematicwiki --missing (END - exit=256) [15:41:28] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=republicofcalluriswiki --missing (END - exit=256) [15:41:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:41:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=resistancebandswiki --missing (END - exit=256) [15:41:42] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=resistancecampaignwiki --missing (END - exit=256) [15:41:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=respectfullanguagewiki --missing (END - exit=256) [15:41:44] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=responsivecodexwiki --missing (END - exit=256) [15:41:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:41:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:41:54] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=respublicawiki --missing (END - exit=256) [15:41:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:42:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:42:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:42:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:42:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=retributionroleplaywiki --missing (END - exit=256) [15:42:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:42:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=reverseawfulmovieswiki --missing (END - exit=256) [15:42:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:42:37] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=reversebestshowsandepisodeswiki --missing (END - exit=256) [15:42:39] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=reverseloathsomecharacterswiki --missing (END - exit=256) [15:42:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=reverseterribleshowsandepisodeswiki --missing (END - exit=256) [15:42:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:42:44] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 15.18, 11.79, 11.00 [15:42:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=reviewsbyyearswiki --missing (END - exit=256) [15:42:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:42:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=revisioncatmaiowiki --missing (END - exit=256) [15:42:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:43:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:43:03] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=reviwiki --missing (END - exit=256) [15:43:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:43:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=rewikiwiki --missing (END - exit=256) [15:43:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:43:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=rfckwiki --missing (END - exit=256) [15:43:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:43:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:43:39] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=rhmoddingwiki --missing (END - exit=256) [15:43:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:43:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=riacontestswiki --missing (END - exit=256) [15:44:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:44:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=riptowiki --missing (END - exit=256) [15:44:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=riseofagonwiki --missing (END - exit=256) [15:44:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:44:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:44:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=risingbeatwiki --missing (END - exit=256) [15:44:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:44:48] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=rivapuppywiki --missing (END - exit=256) [15:45:04] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=riverbornwiki --missing (END - exit=256) [15:45:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:45:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=rmawiki --missing (END - exit=256) [15:45:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:46:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:46:40] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 9.38, 11.20, 10.97 [15:48:02] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.25, 3.53, 2.04 [15:48:38] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 16.32, 12.05, 11.23 [15:50:01] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.03, 2.49, 1.83 [15:52:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.05, 3.16, 3.95 [15:56:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.18, 2.10, 3.32 [16:00:27] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 7.46, 10.60, 11.76 [16:01:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=seccdxwiki --missing (END - exit=256) [16:01:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:01:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=secosawikiwiki --missing (END - exit=256) [16:01:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:02:25] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 12.47, 10.92, 11.70 [16:02:28] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.08, 3.10, 1.95 [16:02:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=selectedworldswiki --missing (END - exit=256) [16:02:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=selfishsocietywiki --missing (END - exit=256) [16:03:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=senhoresdoabismowiki --missing (END - exit=256) [16:03:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sentinelswiki --missing (END - exit=256) [16:03:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:03:21] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=twistedwonderlandwiki --missing (END - exit=65280) [16:03:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=septemwiki --missing (END - exit=256) [16:03:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:03:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:03:34] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=servrikwiki --missing (END - exit=256) [16:03:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:03:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:03:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:03:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=seventhmirrorwiki --missing (END - exit=256) [16:03:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:04:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=severedsunswiki --missing (END - exit=256) [16:04:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:04:03] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sewiki --missing (END - exit=256) [16:04:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:04:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:04:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sfacgnwiki --missing (END - exit=256) [16:04:23] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 9.36, 10.51, 11.47 [16:04:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sfmwiki --missing (END - exit=256) [16:04:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:04:28] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=shadawiki --missing (END - exit=256) [16:04:28] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 2.51, 3.32, 2.20 [16:04:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:04:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:08:58] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sifumoddingwiki --missing (END - exit=256) [16:09:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:09:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=silphaversewiki --missing (END - exit=256) [16:09:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:09:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=silverionewscenterwiki --missing (END - exit=256) [16:09:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:09:31] !log [@mwtask141] starting deploy of {'config': True} to all [16:09:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:09:45] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 14s [16:09:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:10:17] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 6.02, 7.77, 9.95 [16:10:36] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.109281987 secs [16:10:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=simswiki --missing (END - exit=256) [16:10:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:15:30] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=twistedwonderlandwiki --missing (START) [16:16:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:16:08] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.93, 3.02, 2.22 [16:20:08] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.55, 2.45, 2.18 [16:22:36] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09949621558 secs [16:24:17] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.97, 10.12, 8.46 [16:26:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 11.29, 11.00, 10.37 [16:26:15] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.67, 8.74, 8.16 [16:28:10] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 30.80, 17.22, 12.63 [16:31:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=stiffwiki --missing (END - exit=256) [16:31:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:31:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=stilsilotwiki --missing (END - exit=256) [16:31:42] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=stiltjackwiki --missing (END - exit=256) [16:32:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:32:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:32:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=storieswiki --missing (END - exit=256) [16:32:44] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=storygamewiki --missing (END - exit=256) [16:32:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=storytimewiki --missing (END - exit=256) [16:32:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:33:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:33:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:33:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=streetracketwiki --missing (END - exit=256) [16:33:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:33:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=strefawiki --missing (END - exit=256) [16:33:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=strigidwiki --missing (END - exit=256) [16:33:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:33:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:34:17] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=stupididiotcafewiki --missing (END - exit=256) [16:34:19] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=stuvisionwiki --missing (END - exit=256) [16:34:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=stygianscwiki --missing (END - exit=256) [16:34:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:34:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=subconsciousimpactwiki --missing (END - exit=256) [16:34:25] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=subdivisionwiki --missing (END - exit=256) [16:34:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sucaraiwiki --missing (END - exit=256) [16:34:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sufiwikiwiki --missing (END - exit=256) [16:34:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:34:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:34:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:34:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:34:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sulungawiki --missing (END - exit=256) [16:35:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sunfallcomicwiki --missing (END - exit=256) [16:35:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=sunrisewikiwiki --missing (END - exit=256) [16:35:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:35:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=supershortfilmswiki --missing (END - exit=256) [16:35:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=supersmashflashwiki --missing (END - exit=256) [16:36:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:36:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:40:28] !log [@mwtask141] starting deploy of {'config': True} to all [16:40:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:40:37] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [16:40:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:43:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 11.73, 5.00, 3.43 [16:46:08] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.59, 3.39, 2.44 [16:48:08] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.55, 2.69, 2.30 [16:49:50] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.30, 3.52, 3.49 [16:50:31] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.78, 3.45, 2.93 [16:51:48] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.05, 3.03, 3.30 [16:52:28] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.51, 3.19, 2.91 [16:53:53] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=terrewiki --missing (END - exit=256) [16:53:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:54:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tesminadventureswiki --missing (END - exit=256) [16:54:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=testopediawiki --missing (END - exit=256) [16:54:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:54:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tetriswiki --missing (END - exit=256) [16:54:44] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=textilewikiwiki --missing (END - exit=256) [16:55:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tfsceneswiki --missing (END - exit=256) [16:55:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:55:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tgecmwiki --missing (END - exit=256) [16:55:34] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tgfwiki --missing (END - exit=256) [16:55:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:55:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thaeciawiki --missing (END - exit=256) [16:55:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:55:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:55:53] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thanzeuswiki --missing (END - exit=256) [16:56:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:56:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=theaternachhaltigwiki --missing (END - exit=256) [16:56:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thebackroomswiki --missing (END - exit=256) [16:56:16] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thebackroomzwiki --missing (END - exit=256) [16:56:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:56:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thebaronieswiki --missing (END - exit=256) [16:56:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:56:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thebattleofmarswiki --missing (END - exit=256) [16:56:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thebeachleswiki --missing (END - exit=256) [16:56:31] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thebigskywiki --missing (END - exit=256) [16:56:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thechatpeoplewiki --missing (END - exit=256) [16:57:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thecirclewiki --missing (END - exit=256) [16:57:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:57:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thecontinentwiki --missing (END - exit=256) [16:57:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thecscwiki --missing (END - exit=256) [16:57:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:58:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:58:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:58:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:58:33] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=theexperiencewiki --missing (END - exit=256) [16:58:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:58:48] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thefinalrumblewiki --missing (END - exit=256) [16:58:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:59:12] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.07, 3.96, 2.67 [17:01:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.25, 2.98, 2.46 [17:06:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 8.30, 8.10, 11.59 [17:09:02] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3488a320549c...d439ddb06d9d [17:09:03] [url] Comparing 3488a320549c...d439ddb06d9d · miraheze/mw-config · GitHub | github.com [17:09:04] [02miraheze/mw-config] 07Universal-Omega 03d439ddb - Remove non-Swift support from polcomwiki [17:09:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thiudiskwiki --missing (END - exit=256) [17:09:36] !log [@mwtask141] starting deploy of {'config': True} to all [17:09:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:09:51] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 14s [17:10:04] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=throneofsiriswiki --missing (END - exit=256) [17:10:05] miraheze/mw-config - Universal-Omega the build passed. [17:10:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:10:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:10:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:10:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=thwiki --missing (END - exit=256) [17:11:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:11:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tiandiwiki --missing (END - exit=256) [17:11:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:11:37] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/1742ff52a723 [17:11:40] [02miraheze/mw-config] 07Universal-Omega 031742ff5 - Remove non-Swift support from `$wmgEnableSharedUploads` [17:11:41] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [17:11:41] [url] Page not found · GitHub · GitHub | github.com [17:11:42] [02mw-config] 07Universal-Omega opened pull request 03#5005: Remove non-Swift support from `$wmgEnableSharedUploads` - 13https://github.com/miraheze/mw-config/pull/5005 [17:11:42] [url] Page not found · GitHub · GitHub | github.com [17:12:10] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 5.92, 7.21, 10.12 [17:12:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tinkrworkswiki --missing (END - exit=256) [17:12:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:12:47] miraheze/mw-config - Universal-Omega the build passed. [17:12:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tinyd10wiki --missing (END - exit=256) [17:12:51] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.2615250051 secs [17:12:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:12:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tippingpointwiki --missing (END - exit=256) [17:13:09] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=titanlandwiki --missing (END - exit=256) [17:13:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:13:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:16:09] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/d439ddb06d9d...49fffaf679a7 [17:16:10] [url] Comparing d439ddb06d9d...49fffaf679a7 · miraheze/mw-config · GitHub | github.com [17:16:12] [02miraheze/mw-config] 07Universal-Omega 0349fffaf - Remove direct check on staffwiki for shouldEnableSwift() [17:17:09] miraheze/mw-config - Universal-Omega the build passed. [17:17:18] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 2.58, 4.49, 3.53 [17:18:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 10.62, 9.88, 10.31 [17:19:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.80, 3.61, 3.32 [17:20:10] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 10.04, 9.75, 10.20 [17:21:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.05, 2.75, 3.04 [17:21:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tshewiki --missing (END - exit=256) [17:21:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tslwiki --missing (END - exit=256) [17:22:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tsorcwiki --missing (END - exit=256) [17:22:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:23:12] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5796 bytes in 0.009 second response time [17:24:22] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 2 backends are down. mw131 mw141 [17:25:01] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 4.56, 3.83, 3.29 [17:25:05] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 19.01, 15.32, 9.81 [17:25:13] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:25:43] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5796 bytes in 0.011 second response time [17:25:49] PROBLEM - mw132 MediaWiki Rendering on mw132 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:26:32] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5796 bytes in 0.009 second response time [17:26:39] PROBLEM - cp23 Varnish Backends on cp23 is CRITICAL: 3 backends are down. mw131 mw132 mw142 [17:26:40] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 2 backends are down. mw121 mw131 [17:26:51] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.01191946864 secs [17:27:00] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 3.12, 10.56, 8.71 [17:27:12] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.246 second response time [17:27:18] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=twistedwonderlandwiki --missing (END - exit=0) [17:27:18] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 3.437 second response time [17:27:21] !log [@test131] starting deploy of {'config': True} to all [17:27:22] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [17:27:39] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.273 second response time [17:27:46] RECOVERY - mw132 MediaWiki Rendering on mw132 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.289 second response time [17:27:57] PROBLEM - cp22 Varnish Backends on cp22 is CRITICAL: 3 backends are down. mw131 mw132 mw142 [17:28:14] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 9.78, 10.86, 7.99 [17:28:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tszwiki --missing (END - exit=256) [17:28:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ttrpgsolitairewiki --missing (END - exit=256) [17:28:45] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ttskrwiki --missing (END - exit=256) [17:28:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tubnetwiki --missing (END - exit=256) [17:28:55] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 5.08, 8.39, 8.10 [17:28:56] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tulipversewiki --missing (END - exit=256) [17:29:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=tundracorpwiki --missing (END - exit=256) [17:29:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=turkey1930wiki --missing (END - exit=256) [17:29:48] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=turkishsportwiki --missing (END - exit=256) [17:29:57] RECOVERY - cp22 Varnish Backends on cp22 is OK: All 14 backends are healthy [17:30:14] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 5.40, 8.78, 7.57 [17:30:21] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [17:30:34] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.331 second response time [17:30:39] RECOVERY - cp23 Varnish Backends on cp23 is OK: All 14 backends are healthy [17:30:53] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.60, 3.83, 3.50 [17:31:28] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=twistedwonderlandwiki --missing (END - exit=256) [17:31:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:31:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=twplantwikiwiki --missing (END - exit=256) [17:31:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:32:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=ucroniaswiki --missing (END - exit=256) [17:32:40] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [17:32:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:32:50] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.29, 3.40, 3.39 [17:39:33] !log [@mwtask141] starting deploy of {'config': True} to all [17:39:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:39:40] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [17:39:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:45:36] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [17:45:36] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [17:45:41] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 21.66, 13.10, 9.53 [17:45:51] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 18.37, 11.02, 7.26 [17:46:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.83, 2.33, 3.89 [17:46:14] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 18.36, 12.83, 8.97 [17:46:47] PROBLEM - cloud12 Current Load on cloud12 is WARNING: WARNING - load average: 41.50, 39.77, 25.83 [17:47:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.29, 11.44, 9.49 [17:47:32] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.226 second response time [17:47:51] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 7.70, 9.43, 7.14 [17:48:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.12, 3.19, 3.94 [17:48:14] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 5.94, 10.09, 8.44 [17:48:47] RECOVERY - cloud12 Current Load on cloud12 is OK: OK - load average: 16.96, 30.93, 24.28 [17:49:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.16, 9.47, 9.01 [17:49:37] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.81, 10.68, 9.44 [17:50:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.23, 3.50, 3.96 [17:51:35] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.11, 9.57, 9.21 [17:52:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.79, 2.07, 3.24 [18:00:47] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.64, 3.85, 3.57 [18:02:40] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.95, 3.17, 3.35 [18:05:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 1.82, 2.88, 3.87 [18:08:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.35, 4.34, 2.69 [18:09:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 3.95, 3.84, 4.07 [18:10:34] !log [@mwtask141] starting deploy of {'config': True} to all [18:10:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:10:43] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [18:10:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:11:15] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=weastwardlandswiki --missing (END - exit=256) [18:11:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:11:37] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.79, 2.98, 2.36 [18:12:09] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.71, 3.57, 3.34 [18:12:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.53, 3.39, 2.76 [18:13:37] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.87, 2.97, 2.44 [18:13:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.31, 3.36, 3.84 [18:14:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.12, 3.30, 3.28 [18:15:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 5.71, 4.17, 4.07 [18:17:26] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.89, 3.02, 1.71 [18:17:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.25, 3.51, 3.85 [18:19:26] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.64, 2.54, 1.70 [18:20:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.94, 10.68, 9.45 [18:21:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.95, 10.38, 9.29 [18:22:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.98, 3.27, 3.86 [18:22:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.58, 9.95, 9.34 [18:23:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.84, 3.55, 3.68 [18:23:54] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.56, 10.07, 9.31 [18:24:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.29, 3.82, 3.97 [18:24:31] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.59, 2.64, 1.97 [18:25:47] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.60, 3.35, 3.61 [18:26:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.00, 3.27, 2.27 [18:26:45] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/49fffaf679a7...fb670e339688 [18:26:46] [url] Comparing 49fffaf679a7...fb670e339688 · miraheze/mw-config · GitHub | github.com [18:26:48] [02miraheze/mw-config] 07paladox 03fb670e3 - Switching wikis begins with z to swift [18:26:52] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [18:26:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:01] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [18:27:03] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [18:27:04] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [18:27:10] !log [paladox@test131] starting deploy of {'config': True} to all [18:27:11] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [18:27:12] !log [paladox@mwtask141] starting deploy of {'config': True} to all [18:27:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:24] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 12s [18:27:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:47] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.39, 2.77, 3.37 [18:27:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:50] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/fb670e339688...7f41c441a523 [18:27:50] [url] Comparing fb670e339688...7f41c441a523 · miraheze/mw-config · GitHub | github.com [18:27:51] [02miraheze/mw-config] 07paladox 037f41c44 - Switching wikis beginning with y to swift [18:27:54] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [18:27:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:27:56] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [18:27:57] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 0s [18:27:59] !log [paladox@test131] starting deploy of {'config': True} to all [18:27:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:00] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [18:28:03] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [18:28:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.40, 3.43, 3.80 [18:28:04] !log [paladox@mwtask141] starting deploy of {'config': True} to all [18:28:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:07] miraheze/mw-config - paladox the build passed. [18:28:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:16] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 11s [18:28:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.84, 3.34, 2.44 [18:28:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:50] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7f41c441a523...0cd2d34a46bb [18:28:50] [url] Comparing 7f41c441a523...0cd2d34a46bb · miraheze/mw-config · GitHub | github.com [18:28:51] [02miraheze/mw-config] 07paladox 030cd2d34 - Switching wikis beginning with v to swift [18:28:52] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [18:28:55] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [18:28:56] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [18:28:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:28:56] miraheze/mw-config - paladox the build passed. [18:28:57] !log [paladox@test131] starting deploy of {'config': True} to all [18:28:58] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [18:29:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:29:19] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 26s [18:29:22] !log [paladox@mwtask141] starting deploy of {'config': True} to all [18:29:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:29:31] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [18:29:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:29:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:29:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:29:49] miraheze/mw-config - paladox the build passed. [18:29:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:29:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:30:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:34:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 14.82, 6.82, 4.81 [18:34:52] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.59, 10.59, 9.56 [18:36:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 5.53, 5.85, 4.46 [18:36:51] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.40, 10.84, 9.77 [18:37:42] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 12.04, 10.47, 8.20 [18:38:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 7.45, 4.46, 3.58 [18:38:49] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.33, 9.33, 9.36 [18:39:40] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 10.85, 10.68, 8.54 [18:40:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.96, 3.99, 3.53 [18:40:11] !log [@mwtask141] starting deploy of {'config': True} to all [18:40:17] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [18:40:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:40:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:40:42] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 1.67, 3.65, 3.87 [18:41:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.33, 8.35, 4.87 [18:42:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.26, 4.13, 3.63 [18:43:36] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 13.49, 11.93, 9.51 [18:46:16] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.93, 3.91, 2.76 [18:47:08] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 0.94, 3.41, 3.73 [18:47:32] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 6.97, 10.77, 9.70 [18:48:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.06, 3.46, 2.73 [18:48:38] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.77, 2.79, 3.38 [18:49:30] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 6.70, 9.70, 9.45 [18:50:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.50, 3.14, 2.70 [18:51:00] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.73, 2.10, 3.14 [18:51:26] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.29, 10.94, 9.57 [18:52:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.41, 3.56, 3.94 [18:53:25] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.85, 10.97, 9.73 [18:54:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.06, 2.76, 3.92 [18:54:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.35, 5.02, 3.17 [18:56:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.55, 3.30, 3.96 [18:56:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.11, 3.87, 2.97 [18:58:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.06, 3.15, 3.83 [18:58:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.73, 2.58, 3.38 [18:58:31] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.90, 3.12, 2.80 [19:01:18] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.17, 9.41, 9.64 [19:02:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.44, 4.05, 4.01 [19:02:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 14.41, 6.19, 4.46 [19:05:13] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 19.72, 15.99, 11.75 [19:06:28] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.79, 3.10, 2.71 [19:06:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.27, 3.96, 3.10 [19:07:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.08, 10.31, 9.56 [19:08:25] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.50, 2.85, 2.67 [19:09:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 10.13, 9.97, 9.50 [19:09:44] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.25, 1.74, 1.42 [19:10:11] !log [@mwtask141] starting deploy of {'config': True} to all [19:10:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:10:22] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 11s [19:10:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:10:51] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1163284779 secs [19:13:06] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.14, 9.47, 9.17 [19:13:37] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 0.89, 1.51, 1.42 [19:14:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.94, 3.54, 3.45 [19:16:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.47, 2.86, 3.21 [19:16:22] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.65, 3.96, 3.32 [19:17:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.66, 8.85, 9.09 [19:18:21] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 5.14, 4.29, 3.50 [19:21:39] PROBLEM - wiki.worlduniversityandschool.org - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.405035734176636 seconds [19:22:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.27, 3.49, 3.40 [19:24:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.83, 3.54, 4.00 [19:24:18] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 0.87, 2.56, 3.06 [19:26:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 3.70, 3.88, 4.08 [19:26:31] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.07, 5.07, 2.98 [19:28:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.28, 3.58, 3.94 [19:30:16] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.30, 4.54, 3.11 [19:32:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.37, 3.60, 2.94 [19:32:58] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.08724111319 secs [19:34:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.34, 2.75, 2.70 [19:34:45] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 6.14, 8.03, 11.38 [19:35:52] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.30, 11.35, 9.77 [19:36:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.84, 3.69, 3.85 [19:37:50] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.47, 10.77, 9.76 [19:39:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.61, 4.08, 2.95 [19:39:47] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.61, 10.62, 9.22 [19:39:49] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.89, 9.24, 9.34 [19:40:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.37, 3.76, 3.67 [19:40:31] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.06, 2.18, 3.19 [19:40:33] !log [@mwtask141] starting deploy of {'config': True} to all [19:40:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:39] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 21.86, 10.31, 10.93 [19:40:45] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 11s [19:40:54] PROBLEM - phab121 Current Load on phab121 is CRITICAL: CRITICAL - load average: 2.03, 1.73, 1.36 [19:40:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:45] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.15, 11.09, 9.58 [19:42:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.48, 3.40, 3.56 [19:42:37] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 7.74, 8.65, 10.25 [19:42:51] RECOVERY - phab121 Current Load on phab121 is OK: OK - load average: 1.40, 1.53, 1.33 [19:43:07] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.40, 3.32, 2.95 [19:44:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.73, 4.36, 3.89 [19:44:35] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 12.10, 9.73, 10.42 [19:45:42] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.23, 9.21, 9.18 [19:46:33] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 6.65, 8.84, 10.04 [19:51:36] RECOVERY - wiki.worlduniversityandschool.org - reverse DNS on sslhost is OK: SSL OK - wiki.worlduniversityandschool.org reverse DNS resolves to cp23.miraheze.org - CNAME OK [19:53:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.01, 3.53, 2.94 [19:56:22] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 34.01, 17.18, 11.92 [19:57:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.56, 3.81, 3.25 [19:58:59] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 2.07, 3.18, 3.08 [20:02:56] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 3.45, 3.75, 3.37 [20:05:24] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.46, 10.22, 9.42 [20:06:54] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 3.69, 4.05, 3.60 [20:07:23] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.59, 9.50, 9.27 [20:08:53] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 3.33, 3.96, 3.63 [20:10:08] !log [@mwtask141] starting deploy of {'config': True} to all [20:10:18] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 17.78, 14.15, 8.64 [20:10:20] PROBLEM - mw141 MediaWiki Rendering on mw141 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 8191 bytes in 3.342 second response time [20:10:27] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [20:10:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:41] !log [@mwtask141] DEPLOY ABORTED: Canary check failed for publictestwiki.com@mw141.miraheze.org [20:10:49] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 9.34, 11.59, 8.29 [20:10:59] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 6.59, 4.03, 2.97 [20:11:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:18] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.60, 13.71, 11.11 [20:11:51] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 8.77, 11.10, 8.32 [20:12:14] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 5.77, 10.96, 8.13 [20:12:19] PROBLEM - mw141 nutcracker process on mw141 is CRITICAL: PROCS CRITICAL: 0 processes with UID = 115 (nutcracker), command name 'nutcracker' [20:12:21] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 1 backends are down. mw131 [20:12:43] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 1 backends are down. mw131 [20:12:49] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 3.97, 8.88, 7.70 [20:12:51] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.66, 2.97, 3.30 [20:13:51] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 6.32, 9.32, 8.00 [20:14:14] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 4.85, 8.87, 7.71 [20:14:21] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [20:14:31] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.260 second response time [20:14:41] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [20:15:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.92, 11.27, 10.69 [20:16:11] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.32, 10.31, 9.70 [20:17:13] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.17, 9.75, 10.20 [20:18:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.86, 3.70, 3.98 [20:18:09] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.03, 9.86, 9.60 [20:18:43] !log restart nutcracker on mw141 [20:18:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 6.85, 4.70, 4.30 [20:20:08] RECOVERY - mw141 MediaWiki Rendering on mw141 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.312 second response time [20:20:19] RECOVERY - mw141 nutcracker process on mw141 is OK: PROCS OK: 1 process with UID = 115 (nutcracker), command name 'nutcracker' [20:22:43] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.16, 3.62, 3.66 [20:24:44] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.65, 3.65, 3.20 [20:26:37] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.10, 2.97, 3.40 [20:26:43] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.82, 3.42, 3.17 [20:28:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.41, 3.52, 3.91 [20:28:42] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.67, 2.86, 3.01 [20:29:21] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.46, 4.68, 3.13 [20:30:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.22, 3.91, 4.01 [20:33:10] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.82, 3.71, 3.13 [20:35:04] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.37, 2.99, 2.94 [20:36:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.05, 3.20, 2.47 [20:36:37] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 5.29, 4.09, 3.40 [20:38:25] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.51, 2.49, 2.29 [20:38:35] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.96, 3.73, 3.36 [20:39:53] !log [@mwtask141] starting deploy of {'config': True} to all [20:39:59] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [20:40:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:34] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.93, 3.26, 3.24 [20:41:12] PROBLEM - cp22 APT on cp22 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [20:43:12] PROBLEM - cp22 APT on cp22 is CRITICAL: APT CRITICAL: 35 packages available for upgrade (26 critical updates). [20:46:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.94, 3.51, 3.99 [20:46:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 7.33, 8.68, 11.96 [20:52:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.75, 4.00, 3.92 [20:58:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.20, 3.79, 3.92 [20:58:10] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 7.96, 8.64, 10.12 [21:03:20] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 3.19, 3.54, 3.22 [21:04:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.17, 3.97, 3.93 [21:05:19] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 2.41, 3.34, 3.20 [21:06:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.83, 3.60, 3.81 [21:06:36] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1472655237 secs [21:09:07] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.70, 3.38, 2.48 [21:09:43] !log [@mwtask141] starting deploy of {'config': True} to all [21:09:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:09:51] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [21:09:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:10:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.01, 3.73, 3.79 [21:11:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.18, 3.49, 2.65 [21:12:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.62, 3.49, 3.68 [21:12:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 1.98, 3.01, 3.91 [21:12:59] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.32, 2.63, 2.42 [21:14:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.60, 3.71, 3.72 [21:14:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.19, 3.29, 3.89 [21:16:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.48, 3.29, 3.57 [21:16:52] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.05, 3.24, 3.80 [21:18:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.97, 3.59, 3.63 [21:18:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.44, 4.95, 4.31 [21:20:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.93, 3.85, 3.73 [21:21:03] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 12.93, 8.95, 7.82 [21:21:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.16, 3.85, 3.10 [21:23:01] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 10.97, 9.11, 7.98 [21:23:02] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:23:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 3.85, 3.74, 3.14 [21:24:59] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 6.52, 8.00, 7.72 [21:25:08] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 2.94, 3.29, 3.03 [21:26:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.32, 4.07, 3.80 [21:26:35] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 11.31, 7.61, 4.46 [21:26:58] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:27:06] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.532 second response time [21:28:49] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 8.94, 12.80, 9.07 [21:28:54] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.890 second response time [21:29:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 5.71, 5.00, 3.81 [21:30:49] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 6.78, 10.65, 8.73 [21:32:24] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.71, 3.48, 3.56 [21:32:36] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.05227443576 secs [21:32:49] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 5.54, 8.87, 8.31 [21:34:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.38, 4.17, 3.77 [21:36:24] !log [paladox@test131] starting deploy of {'config': True} to all [21:36:25] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [21:36:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:36:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:38:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.95, 3.69, 3.68 [21:39:39] !log [@mwtask141] starting deploy of {'config': True} to all [21:39:40] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 17.95, 10.50, 8.94 [21:39:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:39:49] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 10s [21:39:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:40:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.36, 2.85, 3.37 [21:42:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.58, 3.70, 3.97 [21:44:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 3.79, 3.99, 4.05 [21:45:36] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [21:47:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/76da0be3b669 [21:47:16] [02miraheze/puppet] 07paladox 0376da0be - mediawiki: stop mount /mnt/mediawiki-static and also move static-new to static [21:47:18] [02puppet] 07paladox created branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [21:47:19] [url] Page not found · GitHub · GitHub | github.com [21:47:21] [02puppet] 07paladox opened pull request 03#3047: mediawiki: stop mount /mnt/mediawiki-static and also move static-new to static - 13https://github.com/miraheze/puppet/pull/3047 [21:47:22] [url] Page not found · GitHub · GitHub | github.com [21:48:08] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/76da0be3b669...c0b6de7c5d2d [21:48:09] [url] Comparing 76da0be3b669...c0b6de7c5d2d · miraheze/puppet · GitHub | github.com [21:48:11] [02miraheze/puppet] 07paladox 03c0b6de7 - Update mediawiki.conf.erb [21:48:12] [02puppet] 07paladox synchronize pull request 03#3047: mediawiki: stop mount /mnt/mediawiki-static and also move static-new to static - 13https://github.com/miraheze/puppet/pull/3047 [21:48:12] [url] Page not found · GitHub · GitHub | github.com [21:49:28] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/c0b6de7c5d2d...24f5eca067ac [21:49:29] [url] Comparing c0b6de7c5d2d...24f5eca067ac · miraheze/puppet · GitHub | github.com [21:49:30] [02miraheze/puppet] 07paladox 0324f5eca - Update default.vcl [21:49:33] [02puppet] 07paladox synchronize pull request 03#3047: mediawiki: stop mount /mnt/mediawiki-static and also move static-new to static - 13https://github.com/miraheze/puppet/pull/3047 [21:49:33] [url] Page not found · GitHub · GitHub | github.com [21:49:58] [02puppet] 07paladox synchronize pull request 03#3047: mediawiki: stop mount /mnt/mediawiki-static and also move static-new to static - 13https://github.com/miraheze/puppet/pull/3047 [21:49:59] [url] Page not found · GitHub · GitHub | github.com [21:50:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/24f5eca067ac...7fdda487106a [21:50:02] [url] Comparing 24f5eca067ac...7fdda487106a · miraheze/puppet · GitHub | github.com [21:50:03] [02miraheze/puppet] 07paladox 037fdda48 - Update default.vcl [21:50:32] [02puppet] 07paladox synchronize pull request 03#3047: mediawiki: stop mount /mnt/mediawiki-static and also move static-new to static - 13https://github.com/miraheze/puppet/pull/3047 [21:50:33] ... [21:50:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/7fdda487106a...0db8f3ab7b01 [21:50:35] [url] Comparing 7fdda487106a...0db8f3ab7b01 · miraheze/puppet · GitHub | github.com [21:50:36] [02miraheze/puppet] 07paladox 030db8f3a - Update default.vcl [21:51:29] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 7.42, 10.80, 11.17 [21:52:30] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/2060985c3bee [21:52:31] [02miraheze/mw-config] 07paladox 032060985 - Move static-new to static [21:52:33] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [21:52:33] [url] Page not found · GitHub · GitHub | github.com [21:52:35] [02mw-config] 07paladox opened pull request 03#5006: Move static-new to static - 13https://github.com/miraheze/mw-config/pull/5006 [21:52:35] [url] Page not found · GitHub · GitHub | github.com [21:52:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/1742ff52a723...5207d0e5ae48 [21:52:50] [url] Comparing 1742ff52a723...5207d0e5ae48 · miraheze/mw-config · GitHub | github.com [21:52:50] [02miraheze/mw-config] 07Universal-Omega 035207d0e - Update LocalWiki.php [21:52:52] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support from `$wmgEnableSharedUploads` - 13https://github.com/miraheze/mw-config/pull/5005 [21:52:52] [url] Page not found · GitHub · GitHub | github.com [21:53:03] [02mw-config] 07Universal-Omega edited pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [21:53:03] [url] Page not found · GitHub · GitHub | github.com [21:53:31] miraheze/mw-config - paladox the build passed. [21:53:53] miraheze/mw-config - Universal-Omega the build passed. [21:54:10] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2060985c3bee...f7428d6351a8 [21:54:11] [url] Comparing 2060985c3bee...f7428d6351a8 · miraheze/mw-config · GitHub | github.com [21:54:11] [02miraheze/mw-config] 07paladox 03f7428d6 - Update GlobalSettings.php [21:54:14] [02mw-config] 07paladox synchronize pull request 03#5006: Move static-new to static - 13https://github.com/miraheze/mw-config/pull/5006 [21:54:15] [url] Page not found · GitHub · GitHub | github.com [21:54:34] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.18, 4.60, 3.01 [21:54:58] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/5207d0e5ae48...07404749cd8f [21:54:59] [url] Comparing 5207d0e5ae48...07404749cd8f · miraheze/mw-config · GitHub | github.com [21:55:00] [02miraheze/mw-config] 07Universal-Omega 030740474 - Update FileBackend.php [21:55:03] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [21:55:04] ... [21:55:21] miraheze/mw-config - paladox the build passed. [21:55:21] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f7428d6351a8...f1686552f580 [21:55:22] [url] Comparing f7428d6351a8...f1686552f580 · miraheze/mw-config · GitHub | github.com [21:55:24] [02miraheze/mw-config] 07paladox 03f168655 - Update FileBackend.php [21:55:25] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 4.50, 8.03, 10.01 [21:55:26] [02mw-config] 07paladox synchronize pull request 03#5006: Move static-new to static - 13https://github.com/miraheze/mw-config/pull/5006 [21:55:27] [url] Page not found · GitHub · GitHub | github.com [21:55:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/07404749cd8f...2a8571cec6c6 [21:55:50] [url] Comparing 07404749cd8f...2a8571cec6c6 · miraheze/mw-config · GitHub | github.com [21:55:52] [02miraheze/mw-config] 07Universal-Omega 032a8571c - Update Wikibase.php [21:55:56] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [21:55:56] [url] Page not found · GitHub · GitHub | github.com [21:56:01] miraheze/mw-config - Universal-Omega the build passed. [21:56:21] miraheze/mw-config - paladox the build passed. [21:57:06] miraheze/mw-config - Universal-Omega the build passed. [21:57:29] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f1686552f580...0c372753f789 [21:57:30] [url] Comparing f1686552f580...0c372753f789 · miraheze/mw-config · GitHub | github.com [21:57:30] [02miraheze/mw-config] 07paladox 030c37275 - Update Sitenotice.php [21:57:31] [02mw-config] 07paladox synchronize pull request 03#5006: Move static-new to static - 13https://github.com/miraheze/mw-config/pull/5006 [21:57:32] [url] Page not found · GitHub · GitHub | github.com [21:57:58] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0c372753f789...c04b87b29091 [21:57:59] [url] Comparing 0c372753f789...c04b87b29091 · miraheze/mw-config · GitHub | github.com [21:58:01] [02miraheze/mw-config] 07paladox 03c04b87b - Update LocalWiki.php [21:58:04] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2a8571cec6c6...983adef4a7cb [21:58:05] [url] Comparing 2a8571cec6c6...983adef4a7cb · miraheze/mw-config · GitHub | github.com [21:58:05] [02miraheze/mw-config] 07Universal-Omega 03983adef - Update GlobalSettings.php [21:58:08] [02mw-config] 07paladox synchronize pull request 03#5006: Move static-new to static - 13https://github.com/miraheze/mw-config/pull/5006 [21:58:09] [url] Page not found · GitHub · GitHub | github.com [21:58:10] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [21:58:11] [url] Page not found · GitHub · GitHub | github.com [21:58:18] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c04b87b29091...3700b03ca2d5 [21:58:18] [url] Comparing c04b87b29091...3700b03ca2d5 · miraheze/mw-config · GitHub | github.com [21:58:20] [02miraheze/mw-config] 07paladox 033700b03 - Update Wikibase.php [21:58:22] [02mw-config] 07paladox synchronize pull request 03#5006: Move static-new to static - 13https://github.com/miraheze/mw-config/pull/5006 [21:58:22] [url] Page not found · GitHub · GitHub | github.com [21:58:26] miraheze/mw-config - paladox the build passed. [21:58:39] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3700b03ca2d5...d3c223a63a53 [21:58:39] [url] Comparing 3700b03ca2d5...d3c223a63a53 · miraheze/mw-config · GitHub | github.com [21:58:40] [02miraheze/mw-config] 07paladox 03d3c223a - Update GlobalSettings.php [21:58:41] [02mw-config] 07paladox synchronize pull request 03#5006: Move static-new to static - 13https://github.com/miraheze/mw-config/pull/5006 [21:58:41] [url] Page not found · GitHub · GitHub | github.com [21:58:59] miraheze/mw-config - Universal-Omega the build passed. [21:59:02] miraheze/mw-config - paladox the build passed. [21:59:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/0db8f3ab7b01...65add3db8622 [21:59:14] [url] Comparing 0db8f3ab7b01...65add3db8622 · miraheze/puppet · GitHub | github.com [21:59:15] [02miraheze/puppet] 07paladox 0365add3d - Update proxy-server.conf.erb [21:59:16] [02puppet] 07paladox synchronize pull request 03#3047: mediawiki: stop mount /mnt/mediawiki-static and also move static-new to static - 13https://github.com/miraheze/puppet/pull/3047 [21:59:16] [url] Page not found · GitHub · GitHub | github.com [21:59:22] miraheze/mw-config - paladox the build passed. [21:59:46] miraheze/mw-config - paladox the build passed. [22:00:15] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/983adef4a7cb...55d044857af5 [22:00:15] [url] Comparing 983adef4a7cb...55d044857af5 · miraheze/mw-config · GitHub | github.com [22:00:18] [02miraheze/mw-config] 07Universal-Omega 0355d0448 - Update LocalSettings.php [22:00:21] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [22:00:21] [url] Page not found · GitHub · GitHub | github.com [22:00:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.12, 3.33, 2.98 [22:00:52] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/55d044857af5...5d1291f7641b [22:00:53] [url] Comparing 55d044857af5...5d1291f7641b · miraheze/mw-config · GitHub | github.com [22:00:55] [02miraheze/mw-config] 07Universal-Omega 035d1291f - Update Sitenotice.php [22:00:57] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [22:00:58] [url] Page not found · GitHub · GitHub | github.com [22:01:59] [02miraheze/mw-config] 07Universal-Omega pushed 035 commits to 03Universal-Omega-patch-2 [+0/-0/±4] 13https://github.com/miraheze/mw-config/compare/5d1291f7641b...c011559edafe [22:02:00] [url] Comparing 5d1291f7641b...c011559edafe · miraheze/mw-config · GitHub | github.com [22:02:00] [02miraheze/mw-config] 07Universal-Omega 03c011559 - Merge branch 'master' into Universal-Omega-patch-2 [22:02:01] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [22:02:02] [url] Page not found · GitHub · GitHub | github.com [22:02:57] miraheze/mw-config - Universal-Omega the build passed. [22:03:51] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 14.84, 11.87, 8.20 [22:04:04] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.45, 3.65, 4.00 [22:05:04] [02mw-config] 07paladox commented on pull request 03#5006: Move static-new to static - 13https://github.com/miraheze/mw-config/pull/5006#issuecomment-1336529114 [22:05:05] [url] Move static-new to static by paladox · Pull Request #5006 · miraheze/mw-config · GitHub | github.com [22:05:06] [02mw-config] 07paladox closed pull request 03#5006: Move static-new to static - 13https://github.com/miraheze/mw-config/pull/5006 [22:05:07] [url] Page not found · GitHub · GitHub | github.com [22:05:07] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [22:05:08] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [22:05:09] [url] Page not found · GitHub · GitHub | github.com [22:05:49] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ErrorPages/commit/55d90cc4514f [22:05:51] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 6.67, 9.71, 7.85 [22:05:51] [02miraheze/ErrorPages] 07Universal-Omega 0355d90cc - 404: use static.miraheze.org [22:05:54] [02ErrorPages] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ErrorPages [22:05:54] ... [22:05:56] [02ErrorPages] 07Universal-Omega opened pull request 03#22: 404: use static.miraheze.org - 13https://github.com/miraheze/ErrorPages/pull/22 [22:05:56] [url] Page not found · GitHub · GitHub | github.com [22:06:42] miraheze/ErrorPages - Universal-Omega the build passed. [22:06:45] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 1.55, 2.75, 3.95 [22:06:59] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.48, 3.32, 2.85 [22:07:21] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/commit/08ad76c0e393 [22:07:24] [02miraheze/landing] 07Universal-Omega 0308ad76c - Switch to use static.miraheze.org [22:07:26] [02landing] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/landing [22:07:26] ... [22:07:28] [02landing] 07Universal-Omega opened pull request 03#110: Switch to use static.miraheze.org - 13https://github.com/miraheze/landing/pull/110 [22:07:28] [url] Page not found · GitHub · GitHub | github.com [22:07:50] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/08ad76c0e393...7fea93e027f4 [22:07:50] [url] Comparing 08ad76c0e393...7fea93e027f4 · miraheze/landing · GitHub | github.com [22:07:51] [02miraheze/landing] 07Universal-Omega 037fea93e - Update sitenotice.php [22:07:53] [02landing] 07Universal-Omega synchronize pull request 03#110: Switch to use static.miraheze.org - 13https://github.com/miraheze/landing/pull/110 [22:07:53] [url] Page not found · GitHub · GitHub | github.com [22:08:08] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/7fea93e027f4...591d59663fb4 [22:08:08] [url] Comparing 7fea93e027f4...591d59663fb4 · miraheze/landing · GitHub | github.com [22:08:09] [02miraheze/landing] 07Universal-Omega 03591d596 - Update head.php [22:08:12] [02landing] 07Universal-Omega synchronize pull request 03#110: Switch to use static.miraheze.org - 13https://github.com/miraheze/landing/pull/110 [22:08:12] [url] Page not found · GitHub · GitHub | github.com [22:08:16] miraheze/landing - Universal-Omega the build passed. [22:08:36] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/591d59663fb4...eb7f48f6d9c4 [22:08:37] [url] Comparing 591d59663fb4...eb7f48f6d9c4 · miraheze/landing · GitHub | github.com [22:08:37] [02miraheze/landing] 07Universal-Omega 03eb7f48f - Update index.php [22:08:40] [02landing] 07Universal-Omega synchronize pull request 03#110: Switch to use static.miraheze.org - 13https://github.com/miraheze/landing/pull/110 [22:08:41] [url] Page not found · GitHub · GitHub | github.com [22:08:52] miraheze/landing - Universal-Omega the build passed. [22:09:01] miraheze/landing - Universal-Omega the build passed. [22:09:07] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/eb7f48f6d9c4...0d2d8c8d88e4 [22:09:08] [url] Comparing eb7f48f6d9c4...0d2d8c8d88e4 · miraheze/landing · GitHub | github.com [22:09:09] [02miraheze/landing] 07Universal-Omega 030d2d8c8 - Update styles.css [22:09:10] [02landing] 07Universal-Omega synchronize pull request 03#110: Switch to use static.miraheze.org - 13https://github.com/miraheze/landing/pull/110 [22:09:11] [url] Page not found · GitHub · GitHub | github.com [22:09:34] [02miraheze/landing] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/landing/compare/0d2d8c8d88e4...e3bf81139a73 [22:09:35] [url] Comparing 0d2d8c8d88e4...e3bf81139a73 · miraheze/landing · GitHub | github.com [22:09:37] [02miraheze/landing] 07Universal-Omega 03e3bf811 - Update styles.min.css [22:09:37] miraheze/landing - Universal-Omega the build passed. [22:09:40] [02landing] 07Universal-Omega synchronize pull request 03#110: Switch to use static.miraheze.org - 13https://github.com/miraheze/landing/pull/110 [22:09:41] [url] Page not found · GitHub · GitHub | github.com [22:10:03] !log [@mwtask141] starting deploy of {'config': True} to all [22:10:06] miraheze/landing - Universal-Omega the build passed. [22:10:32] miraheze/landing - Universal-Omega the build passed. [22:10:43] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 0.98, 2.00, 3.38 [22:10:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:10:56] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.44, 3.81, 3.14 [22:11:54] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 111s [22:12:04] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.01, 2.61, 3.37 [22:12:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:12:52] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.63, 3.67, 3.20 [22:13:50] PROBLEM - mw142 Current Load on mw142 is WARNING: WARNING - load average: 7.77, 10.45, 8.80 [22:14:14] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 7.70, 10.27, 7.62 [22:14:48] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.28, 3.22, 3.09 [22:15:51] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 6.10, 8.78, 8.38 [22:16:14] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 4.99, 8.39, 7.25 [22:16:24] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c011559edafe...a7ae93d78fee [22:16:25] [url] Comparing c011559edafe...a7ae93d78fee · miraheze/mw-config · GitHub | github.com [22:16:26] [02miraheze/mw-config] 07Universal-Omega 03a7ae93d - Update LocalSettings.php [22:16:27] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [22:16:28] [url] Page not found · GitHub · GitHub | github.com [22:17:35] miraheze/mw-config - Universal-Omega the build passed. [22:21:49] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [22:23:50] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [22:23:51] [url] Page not found · GitHub · GitHub | github.com [22:23:52] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a7ae93d78fee...0f52f7d57041 [22:23:53] [url] Comparing a7ae93d78fee...0f52f7d57041 · miraheze/mw-config · GitHub | github.com [22:23:53] [02miraheze/mw-config] 07Universal-Omega 030f52f7d - Update GlobalSettings.php [22:24:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.85, 3.14, 3.94 [22:24:56] miraheze/mw-config - Universal-Omega the build passed. [22:25:49] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [22:28:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.29, 3.03, 3.88 [22:29:41] [02puppet] 07paladox synchronize pull request 03#3047: mediawiki: stop mount /mnt/mediawiki-static and also move static-new to static - 13https://github.com/miraheze/puppet/pull/3047 [22:29:42] [url] Page not found · GitHub · GitHub | github.com [22:29:43] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-9 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/65add3db8622...4a1a6a6fbbab [22:29:44] [url] Comparing 65add3db8622...4a1a6a6fbbab · miraheze/puppet · GitHub | github.com [22:29:46] [02miraheze/puppet] 07paladox 034a1a6a6 - Update mediawiki.pp [22:30:51] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 1.73, 2.41, 3.37 [22:31:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.34, 3.82, 2.95 [22:31:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.81, 3.08, 3.99 [22:33:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.65, 3.06, 2.77 [22:34:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.90, 3.33, 3.96 [22:34:46] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.06, 3.52, 3.14 [22:35:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.32, 3.77, 4.03 [22:36:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.97, 3.96, 3.11 [22:36:44] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.82, 3.42, 3.16 [22:38:40] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0cd2d34a46bb...fa549564e575 [22:38:40] [url] Comparing 0cd2d34a46bb...fa549564e575 · miraheze/mw-config · GitHub | github.com [22:38:42] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.20, 2.94, 3.02 [22:38:42] [02miraheze/mw-config] 07paladox 03fa54956 - Switch wikis beginning with w to swift [22:38:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.28, 2.74, 3.37 [22:38:51] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.53, 3.64, 3.52 [22:39:17] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [22:39:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:25] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [22:39:26] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [22:39:27] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 0s [22:39:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:35] [02miraheze/mw-config] 07Universal-Omega pushed 032 commits to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0f52f7d57041...ca37f33f83ff [22:39:36] [url] Comparing 0f52f7d57041...ca37f33f83ff · miraheze/mw-config · GitHub | github.com [22:39:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:37] !log [paladox@test131] starting deploy of {'config': True} to all [22:39:38] [02miraheze/mw-config] 07Universal-Omega 03ca37f33 - Merge branch 'master' into Universal-Omega-patch-2 [22:39:38] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [22:39:39] !log [paladox@mwtask141] starting deploy of {'config': True} to all [22:39:41] [02mw-config] 07Universal-Omega synchronize pull request 03#5005: Remove non-Swift support - 13https://github.com/miraheze/mw-config/pull/5005 [22:39:42] [url] Page not found · GitHub · GitHub | github.com [22:39:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:44] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 5s [22:39:45] miraheze/mw-config - paladox the build passed. [22:39:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.53, 3.31, 3.79 [22:39:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:06] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 0.89, 2.02, 3.17 [22:40:23] !log [@mwtask141] starting deploy of {'config': True} to all [22:40:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:29] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [22:40:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:49] miraheze/mw-config - Universal-Omega the build passed. [22:40:51] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.06, 2.99, 3.29 [22:43:03] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1435012817 secs [22:46:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 7.69, 4.74, 3.83 [22:46:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.48, 3.78, 3.94 [22:49:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.81, 4.47, 3.98 [22:50:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.46, 3.97, 3.56 [22:52:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.00, 2.37, 3.24 [22:54:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.07, 3.62, 3.54 [22:57:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.91, 3.83, 3.92 [22:58:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.92, 2.80, 3.23 [23:02:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.81, 5.83, 4.27 [23:02:26] [discord] My OAuth2 application is running into an HTTP 500 error when trying to get an access token. [23:02:47] [discord] > The authorization server encountered an unexpected condition which prevented it from fulfilling the request: Key cannot be empty [23:03:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.82, 2.97, 3.95 [23:03:03] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.08140826225 secs [23:03:16] @MarkusRost will see if I can find anything in our logs [23:04:09] [discord] Happens on the `rest.php/oauth2/access_token` request. This worked previously and the consumers are still listed on the wiki. Happens for all my consumers. Working fine from Wikimedia [23:04:27] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.48, 3.21, 3.00 [23:05:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 3.49, 3.54, 4.07 [23:05:39] @MarkusRost I think I found why one minute [23:06:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.96, 3.77, 3.77 [23:06:32] InvalidKeyProvided error? [23:07:06] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.59, 3.45, 2.90 [23:07:23] [discord] no idea, all I get is what I send above [23:08:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.72, 3.09, 3.86 [23:08:22] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.97, 3.21, 3.07 [23:08:29] [discord] {"error":"server_error","error_description":"The authorization server encountered an unexpected condition which prevented it from fulfilling the request: Key cannot be empty","message":"The authorization server encountered an unexpected condition which prevented it from fulfilling the request: Key cannot be empty"} [23:08:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.83, 3.37, 3.27 [23:09:00] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.45, 3.59, 3.98 [23:09:03] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.62, 3.57, 3.02 [23:09:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.37, 9.66, 8.27 [23:09:31] [discord] I mean, InvalidKeyProvided sounds like a fitting error code for "Key cannot be empty" but as it's on server side I don't see it during my requests [23:09:52] !log [@mwtask141] starting deploy of {'config': True} to all [23:09:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.41, 3.61, 3.59 [23:09:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:10:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.31, 2.79, 3.34 [23:11:00] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 13.61, 7.25, 5.24 [23:11:01] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.14, 3.14, 2.93 [23:11:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.12, 8.74, 8.09 [23:11:18] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 86s [23:11:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:11:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.60, 3.16, 3.42 [23:12:06] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 7.64, 5.46, 4.59 [23:12:14] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.13, 3.54, 3.28 [23:13:56] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.04, 3.16, 3.39 [23:14:11] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.16, 3.16, 3.17 [23:14:51] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.79, 3.15, 3.22 [23:20:10] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 12.46, 11.55, 8.12 [23:20:27] https://phabricator.wikimedia.org/T318480 / https://phabricator.wikimedia.org/T321160 @MarkusRost -- is the same issue but it seems to be affecting us on 1.38 as well, I think somewhere our package version in composer might have accidentally got bumped somewhere or something... [23:20:28] [url] ⚓ T318480 OAuth test failure on REL1_39 | phabricator.wikimedia.org [23:20:29] [url] ⚓ T321160 Lcobucci\JWT\Signer\InvalidKeyProvided: Key cannot be empty | phabricator.wikimedia.org [23:21:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.03, 4.42, 3.78 [23:22:09] Yeah... we seem to be on version 4.2.1 of lcobucci/jwt but should be on 4.1.5 [23:23:06] This might have been upstream or something and then when composer got ran for a deployment it upgraded... [23:24:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 7.18, 11.84, 9.24 [23:24:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.06, 3.77, 3.50 [23:26:10] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 16.28, 14.44, 10.57 [23:26:20] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.52, 3.94, 3.21 [23:27:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.87, 3.84, 3.79 [23:28:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.87, 3.66, 3.47 [23:30:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.36, 3.45, 3.41 [23:31:56] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.79, 4.22, 3.90 [23:34:00] [discord] Ah interesting. I assume it will work again once the version has been downgraded. Let me know if I need to do anything on my end once the version has been changed. Thanks for the fast help. [23:34:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 8.66, 11.75, 10.95 [23:34:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.08, 4.33, 3.72 [23:35:39] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.88, 3.30, 3.04 [23:36:10] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 20.27, 13.69, 11.66 [23:36:28] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.76, 4.86, 3.73 [23:39:34] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.14, 3.48, 3.15 [23:40:10] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 7.40, 11.09, 11.14 [23:40:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.35, 3.56, 2.75 [23:40:20] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.11, 3.20, 3.63 [23:40:32] !log [@mwtask141] starting deploy of {'config': True} to all [23:40:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:43] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 10s [23:40:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.18, 3.01, 2.65 [23:43:28] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 2.58, 3.46, 3.25 [23:44:10] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 4.71, 7.82, 9.82 [23:44:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.12, 3.83, 3.91 [23:44:20] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.71, 2.61, 3.31 [23:45:26] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.54, 3.21, 3.18 [23:50:12] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 1.75, 2.41, 3.24 [23:55:57] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=wendellmasswiki --missing (END - exit=256) [23:56:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:56:06] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.38, 1.98, 3.74 [23:56:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.68, 3.53, 3.96 [23:57:28] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=whimsicaliawiki --missing (END - exit=256) [23:57:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:57:45] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=whiteleafwiki --missing (END - exit=256) [23:57:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:57:54] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=whobasewiki --missing (END - exit=256) [23:57:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:58:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=widdershinswiki --missing (END - exit=256) [23:58:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:58:51] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.29, 3.97, 4.08 [23:59:56] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=wikibiginowiki --missing (END - exit=256)