[00:00:32] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 7.19, 5.26, 4.51 [00:02:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 5.10, 4.27, 3.41 [00:02:48] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.19, 3.28, 3.24 [00:04:35] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 1.68, 3.31, 3.16 [00:06:22] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.88, 2.94, 3.17 [00:08:32] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 1.75, 3.09, 3.82 [00:13:01] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 7.77, 4.56, 2.14 [00:15:01] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.69, 3.79, 2.16 [00:17:01] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.73, 2.72, 1.97 [00:20:32] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.86, 2.66, 3.31 [00:37:04] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.32, 3.19, 2.69 [00:39:04] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.29, 2.72, 2.58 [00:52:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=65280) [00:52:07] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=65280) [00:52:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:52:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:16:35] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.79, 3.06, 2.83 [01:18:33] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.25, 3.04, 2.84 [01:23:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [01:23:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [01:23:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:23:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:30:02] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c7ad89f15047...6a05049ecf67 [01:30:03] [url] Comparing c7ad89f15047...6a05049ecf67 · miraheze/ssl · GitHub | github.com [01:30:04] [02miraheze/ssl] 07Universal-Omega 036a05049 - Fix [01:32:45] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.89, 3.87, 3.22 [01:34:41] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.48, 4.76, 3.62 [01:36:37] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.82, 3.93, 3.45 [01:38:33] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.51, 3.35, 3.28 [01:46:32] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.88, 3.55, 3.41 [01:48:22] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.35, 3.40, 3.96 [01:48:32] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.22, 3.15, 3.29 [01:52:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 10.25, 5.74, 4.68 [02:04:15] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.56, 3.23, 3.84 [02:15:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-11 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/911d61f7ddff [02:15:07] [02miraheze/puppet] 07paladox 03911d61f - base::monitoring: lower critical/warning threshold for Disk Space [02:15:08] [02puppet] 07paladox created branch 03paladox-patch-11 - 13https://github.com/miraheze/puppet [02:15:08] [url] Page not found · GitHub · GitHub | github.com [02:15:10] [02puppet] 07paladox opened pull request 03#3040: base::monitoring: lower critical/warning threshold for Disk Space - 13https://github.com/miraheze/puppet/pull/3040 [02:15:10] [url] Page not found · GitHub · GitHub | github.com [02:16:07] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.87, 5.00, 4.30 [02:39:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 8.56, 12.48, 6.39 [02:47:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.72, 3.72, 3.05 [02:47:47] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.95, 3.33, 3.97 [02:49:16] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.56, 3.28, 2.97 [02:49:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.48, 2.84, 3.94 [02:55:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.98, 1.77, 3.11 [02:57:40] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.81, 4.02, 3.90 [03:00:31] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.86, 3.66, 2.90 [03:02:31] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.65, 3.36, 2.89 [03:02:37] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.45, 3.48, 2.75 [03:04:36] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.23, 2.93, 2.63 [03:29:16] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.3231655955 secs [03:35:16] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.02227127552 secs [04:07:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.21, 2.51, 3.89 [04:07:42] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:07:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 29.65, 15.89, 8.85 [04:08:05] PROBLEM - mw142 Current Load on mw142 is CRITICAL: CRITICAL - load average: 19.55, 12.01, 7.45 [04:08:30] PROBLEM - mw141 Current Load on mw141 is CRITICAL: CRITICAL - load average: 14.10, 13.29, 8.04 [04:08:30] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [04:08:58] PROBLEM - mw131 Current Load on mw131 is CRITICAL: CRITICAL - load average: 28.86, 19.59, 10.77 [04:09:33] PROBLEM - mw132 Current Load on mw132 is CRITICAL: CRITICAL - load average: 12.39, 13.48, 8.69 [04:09:36] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.289 second response time [04:10:01] RECOVERY - mw142 Current Load on mw142 is OK: OK - load average: 6.15, 9.48, 7.08 [04:10:27] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 5.57, 10.47, 7.63 [04:10:28] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.201 second response time [04:11:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.82, 3.79, 4.08 [04:11:34] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 4.62, 10.09, 8.02 [04:11:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 4.91, 10.05, 8.08 [04:12:25] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 3.76, 8.21, 7.15 [04:12:50] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 5.67, 11.83, 9.57 [04:14:47] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 4.59, 9.46, 8.97 [04:23:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=65280) [04:23:37] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=65280) [04:23:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:23:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:25:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.97, 3.59, 3.96 [04:27:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.26, 3.89, 4.02 [04:29:18] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [04:29:23] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [04:29:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:29:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.57, 3.43, 3.83 [04:29:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:29:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.22, 2.89, 3.79 [04:33:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 6.86, 4.81, 4.32 [04:36:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=65280) [04:36:52] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=65280) [04:36:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:37:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:39:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.65, 4.17, 3.91 [04:43:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.52, 3.75, 3.84 [04:49:29] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.98, 2.60, 3.28 [04:53:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.59, 3.14, 3.33 [04:55:29] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 3.08, 3.27, 3.37 [04:59:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.21, 4.16, 3.69 [05:08:25] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.2014022171 secs [05:16:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [05:16:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:19:13] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=unitedbookwiki --no-updates --username-prefix=mh:unitedbook /home/reception/ImportDump/unitedbookwiki-20221201001950.xml (START) [05:19:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:23:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=65280) [05:24:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:24:25] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset -0.0108640492 secs [05:25:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [05:25:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:28:06] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=unitedbookwiki --no-updates --username-prefix=mh:unitedbook /home/reception/ImportDump/unitedbookwiki-20221201001950.xml (END - exit=0) [05:28:07] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=unitedbookwiki (START) [05:28:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:28:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:32:34] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=unitedbookwiki (END - exit=0) [05:32:35] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=unitedbookwiki --active --update (END - exit=0) [05:32:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:32:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:36:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=65280) [05:36:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:44:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [05:44:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:45:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [05:45:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:47:00] ^ I just ran that a bunch of times using && now, since it keeps failing, I just did it a bunch of times to auto restart... [05:55:37] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=twistedwonderlandwiki --no-updates --username-prefix=mh:twistedwonderland /home/reception/wiki-twistedwonderlandmirahezeorg_w/twistedwonderlandmirahezeorg_w-20220626-history.xml (START) [05:55:39] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=twistedwonderlandwiki --no-updates --username-prefix=mh:twistedwonderland /home/reception/wiki-twistedwonderlandmirahezeorg_w/twistedwonderlandmirahezeorg_w-20220626-history.xml (END - exit=256) [05:55:40] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=twistedwonderlandwiki (START) [05:55:41] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=twistedwonderlandwiki (END - exit=256) [05:55:42] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=twistedwonderlandwiki --active --update (END - exit=256) [05:55:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:52] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=twistedwonderlandwiki --no-updates --username-prefix=mh:twistedwonderland /home/reception/wiki-twistedwonderlandmirahezeorg_w/twistedwonderlandmirahezeorg_w-20220626-history.xml (START) [05:55:53] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=twistedwonderlandwiki --no-updates --username-prefix=mh:twistedwonderland /home/reception/wiki-twistedwonderlandmirahezeorg_w/twistedwonderlandmirahezeorg_w-20220626-history.xml (END - exit=256) [05:55:54] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=twistedwonderlandwiki (START) [05:55:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:55:55] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=twistedwonderlandwiki (END - exit=256) [05:55:56] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=twistedwonderlandwiki --active --update (END - exit=256) [05:55:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:57:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:57:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:57:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:05:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.91, 2.65, 3.91 [06:06:23] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.58, 3.92, 3.29 [06:07:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.01, 3.17, 3.94 [06:10:21] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.55, 3.24, 3.16 [06:21:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.43, 3.26, 3.94 [06:23:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.64, 3.90, 4.08 [06:36:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=65280) [06:36:52] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [06:36:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:37:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:44:33] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*removededmsongswiki* on mw*, test131, and mwtask141 [06:44:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='removededmsongswiki' [06:44:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='removededmsongswiki' [06:44:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='removededmsongswiki' [06:44:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:44:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:45:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='removededmsongswiki' [06:45:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:45:07] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='removededmsongswiki' [06:45:14] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='removededmsongswiki' [06:45:21] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='removededmsongswiki' [06:45:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:45:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:45:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:46:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:47:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:01:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.52, 3.14, 3.97 [07:05:16] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.128857106 secs [07:05:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.44, 3.39, 3.85 [07:16:38] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.07, 3.52, 2.53 [07:18:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.44, 2.82, 2.40 [07:21:16] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08777692914 secs [07:33:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 0.97, 1.97, 3.91 [07:37:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.48, 3.01, 3.85 [07:39:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.31, 2.98, 3.74 [07:41:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 7.43, 4.46, 4.18 [07:45:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.74, 3.77, 3.98 [07:47:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.53, 4.18, 4.11 [08:06:41] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.56, 5.93, 2.96 [08:07:54] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:07:55] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:08:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:08:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:10:41] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.29, 2.87, 2.38 [08:10:42] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:10:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:10:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:10:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:11:35] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:11:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:11:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:12:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:12:25] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:12:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:12:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:12:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:13:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:13:14] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:13:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:13:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:14:05] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:14:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:14:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:14:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:14:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:15:00] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:15:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:15:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:15:20] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.99, 3.75, 2.97 [08:15:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:15:48] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:15:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:16:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:16:43] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:16:44] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:16:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:16:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:17:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.16, 3.42, 3.97 [08:17:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:17:33] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (START) [08:17:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:17:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:18:17] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcomwiki --missing (END - exit=0) [08:18:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:19:18] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.14, 3.39, 3.05 [08:19:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.32, 3.52, 3.92 [08:23:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.98, 2.66, 3.77 [08:25:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 6.33, 3.90, 4.08 [08:29:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.91, 3.66, 3.94 [08:33:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.59, 3.44, 3.74 [08:45:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.85, 3.31, 3.95 [08:55:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.66, 3.51, 3.63 [08:59:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.05, 3.37, 3.56 [09:03:58] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.05, 2.88, 3.33 [09:09:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.14, 3.33, 3.47 [09:11:58] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.44, 3.00, 3.32 [09:17:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 6.15, 5.25, 4.13 [09:22:01] PROBLEM - cloud13 Puppet on cloud13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [09:27:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.65, 3.70, 3.89 [09:29:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.39, 4.00, 3.97 [09:31:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.34, 3.36, 3.74 [09:35:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.15, 3.75, 3.79 [09:41:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.64, 3.63, 3.83 [09:43:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.87, 3.74, 3.95 [09:45:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.10, 4.17, 3.99 [09:47:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.07, 3.94, 3.99 [09:49:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.84, 3.10, 3.67 [09:52:01] RECOVERY - cloud13 Puppet on cloud13 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [09:55:29] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.88, 2.90, 3.40 [09:59:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 8.51, 4.94, 4.07 [10:09:23] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.69, 2.93, 2.60 [10:11:22] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.51, 3.61, 2.87 [10:11:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.63, 3.26, 2.72 [10:13:20] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.73, 3.18, 2.80 [10:15:22] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.62, 3.05, 2.77 [10:15:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.57, 2.83, 3.98 [10:17:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.57, 4.32, 4.44 [10:19:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.77, 3.51, 3.97 [10:23:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.93, 3.92, 3.97 [10:25:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.25, 3.46, 3.79 [10:27:17] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1191459298 secs [10:31:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.07, 3.65, 3.74 [10:33:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.93, 3.15, 3.54 [10:35:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.51, 2.77, 3.71 [10:37:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.60, 4.47, 3.99 [10:39:58] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.98, 2.50, 3.36 [10:43:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.30, 3.91, 3.93 [10:43:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.89, 4.19, 3.83 [10:45:16] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.02578616142 secs [10:47:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.26, 4.25, 4.05 [10:47:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.94, 3.88, 3.83 [10:51:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.45, 3.85, 3.97 [10:53:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 8.15, 5.70, 4.64 [10:59:58] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 1.68, 2.65, 3.27 [11:09:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.61, 3.37, 3.86 [11:10:44] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 3.91, 4.38, 3.82 [11:11:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.05, 3.69, 3.89 [11:12:42] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.77, 3.76, 3.65 [11:14:40] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.55, 4.97, 4.14 [11:15:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.12, 3.50, 3.82 [11:19:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.01, 3.97, 3.91 [11:25:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.41, 3.92, 3.95 [11:27:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.04, 4.37, 4.11 [11:33:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.92, 3.67, 3.92 [11:35:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.62, 4.22, 4.07 [11:42:17] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=removededmsongswiki --no-updates --username-prefix=mh:removededmsongs /home/reception/ImportDump/removededmsongswiki-20221201073734.xml (START) [11:42:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:42:47] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=polcompballanarchywiki --no-updates --username-prefix=mh:polcompballanarchy /home/reception/ImportDump/polcompballanarchywiki-20221201053454.xml (START) [11:42:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:53:06] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=removededmsongswiki --no-updates --username-prefix=mh:removededmsongs /home/reception/ImportDump/removededmsongswiki-20221201073734.xml (END - exit=0) [11:53:07] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=removededmsongswiki (START) [11:53:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:53:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:01:03] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=polcompballanarchywiki --no-updates --username-prefix=mh:polcompballanarchy /home/reception/ImportDump/polcompballanarchywiki-20221201053454.xml (END - exit=0) [12:01:04] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=polcompballanarchywiki (START) [12:01:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:01:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:03:34] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=removededmsongswiki (END - exit=0) [12:03:35] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=removededmsongswiki --active --update (END - exit=0) [12:03:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:03:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:09:58] [02miraheze/ErrorPages] 07translatewiki pushed 031 commit to 03master [+1/-0/±6] 13https://github.com/miraheze/ErrorPages/compare/b8933a8206e3...09aab2b7e00b [12:09:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.48, 2.35, 3.81 [12:09:59] [url] Comparing b8933a8206e3...09aab2b7e00b · miraheze/ErrorPages · GitHub | github.com [12:09:59] [02miraheze/ErrorPages] 07translatewiki 0309aab2b - Localisation updates from https://translatewiki.net. [12:09:59] [url] Main page - translatewiki.net | translatewiki.net [12:10:00] [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/6f6519e285e1...c791b62d5d05 [12:10:01] [url] Comparing 6f6519e285e1...c791b62d5d05 · miraheze/CreateWiki · GitHub | github.com [12:10:02] [02miraheze/CreateWiki] 07translatewiki 03c791b62 - Localisation updates from https://translatewiki.net. [12:10:02] [url] Main page - translatewiki.net | translatewiki.net [12:10:05] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/landing/compare/e8c74e027901...709cc7517318 [12:10:05] [url] Comparing e8c74e027901...709cc7517318 · miraheze/landing · GitHub | github.com [12:10:08] [02miraheze/landing] 07translatewiki 03709cc75 - Localisation updates from https://translatewiki.net. [12:10:08] [url] Main page - translatewiki.net | translatewiki.net [12:10:10] [02miraheze/MatomoAnalytics] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/MatomoAnalytics/compare/054d0094c14a...d361b9d17e86 [12:10:10] [url] Comparing 054d0094c14a...d361b9d17e86 · miraheze/MatomoAnalytics · GitHub | github.com [12:10:12] [02miraheze/MatomoAnalytics] 07translatewiki 03d361b9d - Localisation updates from https://translatewiki.net. [12:10:12] [url] Main page - translatewiki.net | translatewiki.net [12:10:13] [02miraheze/DataDump] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/DataDump/compare/d4e1cbb4cbba...0f7c91110222 [12:10:13] [url] Comparing d4e1cbb4cbba...0f7c91110222 · miraheze/DataDump · GitHub | github.com [12:10:14] [02miraheze/DataDump] 07translatewiki 030f7c911 - Localisation updates from https://translatewiki.net. [12:10:14] [url] Main page - translatewiki.net | translatewiki.net [12:10:17] [02miraheze/SpriteSheet] 07translatewiki pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/SpriteSheet/compare/7b41bb8c291e...f2d8a211e6fd [12:10:17] [url] Comparing 7b41bb8c291e...f2d8a211e6fd · miraheze/SpriteSheet · GitHub | github.com [12:10:18] [02miraheze/SpriteSheet] 07translatewiki 03f2d8a21 - Localisation updates from https://translatewiki.net. [12:10:18] [url] Main page - translatewiki.net | translatewiki.net [12:10:20] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ad9fad21436b...889f26d20737 [12:10:20] [url] Comparing ad9fad21436b...889f26d20737 · miraheze/MirahezeMagic · GitHub | github.com [12:10:23] [02miraheze/MirahezeMagic] 07translatewiki 03889f26d - Localisation updates from https://translatewiki.net. [12:10:23] [url] Main page - translatewiki.net | translatewiki.net [12:12:57] miraheze/ErrorPages - translatewiki the build passed. [12:13:13] miraheze/landing - translatewiki the build passed. [12:15:22] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.92, 3.76, 3.12 [12:17:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 5.75, 5.22, 4.49 [12:19:20] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.63, 3.31, 3.09 [12:21:11] miraheze/CreateWiki - translatewiki the build passed. [12:21:34] miraheze/DataDump - translatewiki the build passed. [12:21:46] miraheze/MatomoAnalytics - translatewiki the build passed. [12:21:56] miraheze/SpriteSheet - translatewiki the build passed. [12:25:16] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.41, 3.73, 3.28 [12:26:49] miraheze/MirahezeMagic - translatewiki the build passed. [12:27:15] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.84, 3.68, 3.31 [12:29:15] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.51, 3.15, 3.16 [12:31:11] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 3 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[Landing Sync],Exec[ErrorPages Sync] [12:37:10] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.58, 3.25, 3.15 [12:39:09] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.48, 2.97, 3.06 [12:59:10] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:16:51] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.53, 4.00, 3.08 [13:18:50] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.50, 3.37, 2.97 [13:19:24] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:19:25] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:19:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:19:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:25:21] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:25:22] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:25:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:25:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:26:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:26:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:26:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:26:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:27:39] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:27:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:27:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:27:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:27:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.06, 3.03, 3.97 [13:28:46] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:28:47] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:28:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:29:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:29:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:29:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:29:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:29:58] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.41, 3.80, 4.15 [13:30:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:31:02] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:31:03] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:31:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:31:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:32:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:32:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:32:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:32:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:33:28] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:33:29] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:33:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:33:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:34:44] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:34:45] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:34:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:34:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:35:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.16, 2.99, 3.91 [13:35:49] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:35:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (START) [13:35:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:36:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:37:08] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polandballwiki --missing (END - exit=0) [13:37:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:37:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.82, 3.52, 3.97 [13:39:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.68, 2.70, 3.62 [13:41:29]