[00:12:12] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5796 bytes in 0.013 second response time [00:14:08] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.571 second response time [00:14:12] PROBLEM - mw142 MediaWiki Rendering on mw142 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5796 bytes in 0.014 second response time [00:14:47] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 5796 bytes in 0.516 second response time [00:16:10] RECOVERY - mw142 MediaWiki Rendering on mw142 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.217 second response time [00:16:43] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.177 second response time [00:17:16] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1519435942 secs [00:33:16] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.06310641766 secs [00:45:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.97, 2.88, 3.91 [00:55:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.15, 3.41, 3.66 [00:57:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.29, 3.79, 3.81 [01:01:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.19, 3.64, 3.68 [01:03:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.74, 3.27, 3.54 [01:07:16] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.1152084172 secs [01:07:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.49, 3.85, 3.70 [01:09:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.88, 3.91, 3.75 [01:11:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.98, 4.11, 3.82 [01:15:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.14, 3.53, 3.70 [01:21:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.33, 4.11, 3.81 [01:25:16] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.08833408356 secs [01:27:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.88, 3.97, 3.85 [01:30:12] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.87, 4.75, 2.92 [01:30:59] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.69, 2.82, 1.89 [01:31:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.81, 3.88, 3.78 [01:32:09] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.42, 3.80, 2.79 [01:32:58] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.10, 2.21, 1.78 [01:33:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.60, 3.38, 3.60 [01:34:05] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.54, 3.06, 2.64 [01:37:29] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.82, 2.88, 3.36 [01:43:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.88, 3.60, 3.51 [01:47:29] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.95, 3.00, 3.31 [01:51:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.93, 3.39, 3.38 [01:53:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.97, 3.63, 3.45 [01:55:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.28, 3.61, 3.47 [01:59:29] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.63, 2.97, 3.28 [02:00:58] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.46, 3.13, 1.62 [02:02:58] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.54, 2.50, 1.58 [02:03:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.29, 4.52, 3.86 [02:05:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.38, 3.74, 3.66 [02:09:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 8.13, 4.39, 3.81 [02:17:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.55, 3.94, 3.85 [02:21:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.32, 4.10, 3.87 [02:25:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.35, 3.54, 3.71 [02:29:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.17, 3.40, 3.56 [02:30:04] PROBLEM - tot.wiki - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns1.digitalocean.com.', 'ns3.digitalocean.com.', 'ns2.digitalocean.com.'], 'CNAME': None} [02:33:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.90, 3.97, 3.83 [02:38:10] [02ssl] 07Pix1234 opened pull request 03#618: Remove tot.wiki as it no longer points to Miraheze - 13https://github.com/miraheze/ssl/pull/618 [02:38:10] [url] Page not found · GitHub · GitHub | github.com [02:41:29] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.02, 2.90, 3.39 [02:44:18] PROBLEM - tot.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address tot.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [02:45:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.58, 3.83, 3.68 [02:47:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.69, 3.16, 3.46 [02:51:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 8.09, 4.70, 3.96 [02:57:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.51, 3.71, 3.77 [03:01:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.03, 3.45, 3.59 [03:03:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.52, 3.91, 3.77 [03:05:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 6.56, 4.57, 4.00 [03:13:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.75, 3.58, 3.75 [03:19:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.34, 3.90, 3.77 [03:30:25] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.2152833343 secs [03:37:21] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.92, 3.02, 1.93 [03:39:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.78, 2.55, 1.89 [03:56:25] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset -0.007325917482 secs [04:03:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.25, 3.20, 3.86 [04:09:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 8.79, 4.65, 4.12 [04:19:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.25, 3.46, 3.91 [04:21:29] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.71, 3.60, 3.88 [04:23:29] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.58, 3.53, 3.85 [04:27:29] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 1.24, 2.42, 3.32 [04:44:19] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.79, 4.43, 3.63 [04:50:15] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.55, 4.00, 3.74 [04:54:12] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.52, 3.02, 3.36 [04:59:12] PROBLEM - mw121 MediaWiki Rendering on mw121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [05:00:07] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 3.44, 4.38, 3.91 [05:01:08] RECOVERY - mw121 MediaWiki Rendering on mw121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.363 second response time [05:01:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.70, 6.15, 3.16 [05:04:04] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.95, 3.59, 3.70 [05:05:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.36, 3.34, 2.67 [05:08:00] [02miraheze/puppet] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/91d95ae2c870...84053cedbd80 [05:08:01] [url] Comparing 91d95ae2c870...84053cedbd80 · miraheze/puppet · GitHub | github.com [05:08:02] [02miraheze/puppet] 07Universal-Omega 0384053ce - iaupload: just use date [05:08:02] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 7.19, 4.55, 3.99 [05:13:58] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 2.12, 3.61, 3.82 [05:15:57] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.48, 4.48, 4.14 [05:17:55] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.31, 3.84, 3.93 [05:27:49] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 2.05, 2.82, 3.39 [06:02:22] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.64, 3.87, 3.15 [06:04:21] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.14, 3.60, 3.14 [06:06:19] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 4.29, 3.84, 3.28 [06:14:14] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 0.96, 2.97, 3.26 [06:35:27] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.30, 3.51, 2.28 [06:35:39] PROBLEM - mw131 MediaWiki Rendering on mw131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [06:36:37] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 7.83, 4.54, 2.78 [06:37:35] RECOVERY - mw131 MediaWiki Rendering on mw131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.213 second response time [06:38:36] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 1.84, 3.44, 2.60 [06:38:56] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 8.50, 5.40, 3.77 [06:39:09] PROBLEM - cp33 Varnish Backends on cp33 is CRITICAL: 1 backends are down. mw131 [06:39:24] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.91, 3.28, 2.53 [06:40:18] PROBLEM - cp32 Varnish Backends on cp32 is CRITICAL: 1 backends are down. mw131 [06:40:35] PROBLEM - gluster102 Current Load on gluster102 is CRITICAL: CRITICAL - load average: 4.74, 3.71, 2.77 [06:41:09] RECOVERY - cp33 Varnish Backends on cp33 is OK: All 14 backends are healthy [06:42:18] RECOVERY - cp32 Varnish Backends on cp32 is OK: All 14 backends are healthy [06:42:34] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 1.67, 2.92, 2.59 [06:42:54] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 0.96, 3.15, 3.24 [06:53:58] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 0.83, 1.14, 3.84 [06:57:58] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 0.41, 0.77, 3.07 [07:02:08] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.45, 3.33, 2.67 [07:06:04] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.16, 3.00, 2.72 [07:10:00] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.29, 3.33, 2.67 [07:12:31] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.47, 3.21, 2.54 [07:13:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.61, 3.90, 3.08 [07:14:31] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.15, 3.28, 2.63 [07:16:31] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.49, 2.91, 2.58 [07:19:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.98, 3.91, 3.28 [07:20:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.63, 3.32, 2.45 [07:21:47] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.00, 4.35, 3.57 [07:21:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.81, 3.51, 3.22 [07:22:21] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.45, 2.90, 2.40 [07:25:59] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.84, 3.27, 3.20 [07:27:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.62, 3.76, 3.55 [07:29:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.64, 3.90, 3.52 [07:31:37] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 3.34, 4.09, 3.77 [07:31:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.07, 4.15, 3.62 [07:33:35] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.86, 3.89, 3.75 [07:33:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.67, 3.54, 3.47 [07:35:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.72, 3.96, 3.62 [07:37:59] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.27, 3.32, 3.43 [07:41:59] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.56, 2.98, 3.27 [07:43:25] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.21, 2.93, 3.36 [07:52:15] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.93, 3.09, 2.50 [07:54:14] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 2.15, 2.70, 2.43 [08:02:51] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.21, 3.74, 3.25 [08:04:08] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.53, 3.75, 3.35 [08:04:50] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.36, 3.26, 3.14 [08:06:06] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.13, 3.54, 3.33 [08:08:04] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.01, 2.93, 3.13 [08:17:52] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 2.84, 3.45, 3.32 [08:19:50] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 1.96, 2.99, 3.17 [08:27:41] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.52, 3.50, 3.33 [08:29:39] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.36, 3.11, 3.21 [08:35:35] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.37, 3.60, 3.17 [08:37:30] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.82, 3.40, 3.23 [08:37:34] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.89, 3.40, 3.16 [08:39:28] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.22, 3.27, 3.20 [12:08:13] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=polandballwiki (START) [12:08:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:18:33] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=alethustriawiki --no-updates --username-prefix=mh:alethustria /home/reception/ImportDump/alethustriawiki-20221201205101.xml (START) [12:18:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:19:29] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=accessiawiki --no-updates /home/reception/ImportDump/accessiawiki-20221202074050.xml (START) [12:19:30] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=accessiawiki --no-updates /home/reception/ImportDump/accessiawiki-20221202074050.xml (END - exit=256) [12:19:31] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=accessiawiki (START) [12:19:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:19:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:19:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:19:48] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=accessiawiki (END - exit=0) [12:19:49] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=accessiawiki --active --update (END - exit=0) [12:19:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:19:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:20:07] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=alethustriawiki --no-updates --username-prefix=mh:alethustria /home/reception/ImportDump/alethustriawiki-20221201205101.xml (END - exit=0) [12:20:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=alethustriawiki (START) [12:20:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:20:15] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=fohsarchivewiki --no-updates --username-prefix=mh:fohsarchive /home/reception/ImportDump/fohsarchivewiki-20221202063242.xml (START) [12:20:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:20:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:20:28] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=alethustriawiki (END - exit=0) [12:20:29] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=alethustriawiki --active --update (END - exit=0) [12:20:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:20:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:54:06] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=fohsarchivewiki --no-updates --username-prefix=mh:fohsarchive /home/reception/ImportDump/fohsarchivewiki-20221202063242.xml (END - exit=0) [12:54:07] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=fohsarchivewiki (START) [12:54:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:54:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:21:16] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1285695136 secs [13:30:19] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=fohsarchivewiki (END - exit=0) [13:30:20] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=fohsarchivewiki --active --update (END - exit=0) [13:30:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:30:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:39:16] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.07371774316 secs [13:51:14] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.82, 10.21, 7.70 [13:51:33] PROBLEM - mw132 Current Load on mw132 is WARNING: WARNING - load average: 9.18, 11.48, 8.02 [13:53:14] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.19, 7.91, 7.16 [13:53:34] RECOVERY - mw132 Current Load on mw132 is OK: OK - load average: 4.25, 9.04, 7.56 [14:32:25] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.1018151045 secs [14:34:25] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.07683235407 secs [14:37:23] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.22, 3.72, 2.37 [14:39:21] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.53, 3.39, 2.41 [15:12:05] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/935679110139 [15:12:07] [02miraheze/dns] 07paladox 039356791 - Remove gluster121 from load balancing [15:12:10] [02dns] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [15:12:11] [url] Page not found · GitHub · GitHub | github.com [15:12:11] [02dns] 07paladox opened pull request 03#374: Remove gluster121 from load balancing - 13https://github.com/miraheze/dns/pull/374 [15:12:12] ... [15:12:26] [02dns] 07paladox closed pull request 03#374: Remove gluster121 from load balancing - 13https://github.com/miraheze/dns/pull/374 [15:12:26] [url] Page not found · GitHub · GitHub | github.com [15:12:27] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/0d48d652774a...6b95657909ee [15:12:27] [url] Comparing 0d48d652774a...6b95657909ee · miraheze/dns · GitHub | github.com [15:12:30] [02miraheze/dns] 07paladox 036b95657 - Remove gluster121 from load balancing (#374) [15:12:32] [02dns] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/dns [15:12:32] [url] Page not found · GitHub · GitHub | github.com [15:12:33] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-1 [15:50:47] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.46, 3.65, 2.97 [15:52:46] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 3.05, 3.33, 2.92 [17:02:48] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 1.88, 3.58, 2.22 [17:04:48] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 0.94, 2.62, 2.03 [17:05:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.53, 3.16, 2.77 [17:07:16] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.98, 3.07, 2.78 [17:17:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=polandballwiki (END - exit=35072) [17:17:03] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.12, 3.77, 3.11 [17:17:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:17:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=polandballwiki --active --update (END - exit=0) [17:17:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [17:21:01] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 2.37, 3.27, 3.08 [17:46:00] [discord] CosmicAlpha: Can you run the image rebuild script for `polcompballanarchywiki`? [17:53:14] @Agent when I am at PC, sure. Not around it right now. [17:54:03] [discord] Thanks! [18:18:25] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.280636102 secs [18:21:35] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.138245374 secs [18:29:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.17, 3.16, 2.75 [18:30:25] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.0378973186 secs [18:31:16] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 3.30, 3.22, 2.81 [18:47:16] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.65, 3.32, 2.89 [18:49:16] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.41, 2.96, 2.81 [18:53:35] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08877405524 secs [19:00:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballanarchywiki --missing (START) [19:00:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:19] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*twistedwonderlandwiki* on mw*, test131, and mwtask141 [19:02:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='twistedwonderlandwiki' [19:02:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='twistedwonderlandwiki' [19:02:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:40] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='twistedwonderlandwiki' [19:02:46] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='twistedwonderlandwiki' [19:02:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:02:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='twistedwonderlandwiki' [19:03:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='twistedwonderlandwiki' [19:03:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:11] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='twistedwonderlandwiki' [19:03:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:47] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*elsaversewiki* on mw*, test131, and mwtask141 [19:03:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:52] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='elsaversewiki' [19:03:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:03:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='elsaversewiki' [19:04:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:04:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='elsaversewiki' [19:04:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:04:10] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='elsaversewiki' [19:04:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:04:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='elsaversewiki' [19:04:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:04:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='elsaversewiki' [19:04:29] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='elsaversewiki' [19:04:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:04:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:20] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*mockelectionswiki* on mw*, test131, and mwtask141 [19:06:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:27] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='mockelectionswiki' [19:06:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:34] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='mockelectionswiki' [19:06:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='mockelectionswiki' [19:06:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='mockelectionswiki' [19:06:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='mockelectionswiki' [19:07:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='mockelectionswiki' [19:07:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:09] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='mockelectionswiki' [19:07:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballanarchywiki --missing (END - exit=65280) [19:07:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:08:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballanarchywiki --missing (START) [19:08:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:09:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballanarchywiki --missing (END - exit=65280) [19:09:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:10:32] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballanarchywiki --missing (START) [19:10:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:10:57] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*mspecwiki* on mw*, test131, and mwtask141 [19:11:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='mspecwiki' [19:11:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:11] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='mspecwiki' [19:11:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='mspecwiki' [19:11:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:25] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='mspecwiki' [19:11:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='mspecwiki' [19:11:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='mspecwiki' [19:11:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:44] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='mspecwiki' [19:11:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:06] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*chinozowikiwiki* on mw*, test131, and mwtask141 [19:13:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='chinozowikiwiki' [19:13:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:19] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='chinozowikiwiki' [19:13:25] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='chinozowikiwiki' [19:13:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='chinozowikiwiki' [19:13:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:37] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='chinozowikiwiki' [19:13:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:43] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='chinozowikiwiki' [19:13:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:50] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='chinozowikiwiki' [19:13:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:14:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:20:55] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*elysiamcwiki* on mw*, test131, and mwtask141 [19:21:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='elysiamcwiki' [19:21:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='elysiamcwiki' [19:21:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:14] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='elysiamcwiki' [19:21:20] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='elysiamcwiki' [19:21:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='elysiamcwiki' [19:21:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:33] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='elysiamcwiki' [19:21:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:39] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='elysiamcwiki' [19:21:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:47] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.24, 3.66, 3.10 [19:22:25] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*aerosteonwiki* on mw*, test131, and mwtask141 [19:22:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='aerosteonwiki' [19:22:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:22:36] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='aerosteonwiki' [19:22:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:22:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='aerosteonwiki' [19:22:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:22:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='aerosteonwiki' [19:22:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:22:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='aerosteonwiki' [19:22:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='aerosteonwiki' [19:23:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:07] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='aerosteonwiki' [19:23:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:23:45] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 2.17, 3.04, 2.94 [19:24:07] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*gfd7dt36wwiki* on mw*, test131, and mwtask141 [19:24:14] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='gfd7dt36wwiki' [19:24:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='gfd7dt36wwiki' [19:24:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:27] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='gfd7dt36wwiki' [19:24:33] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='gfd7dt36wwiki' [19:24:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='gfd7dt36wwiki' [19:24:45] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='gfd7dt36wwiki' [19:24:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:52] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='gfd7dt36wwiki' [19:25:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:11] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*ted52wiki* on mw*, test131, and mwtask141 [19:26:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='ted52wiki' [19:26:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:25] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='ted52wiki' [19:26:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:33] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='ted52wiki' [19:26:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:40] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='ted52wiki' [19:26:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:46] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='ted52wiki' [19:26:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='ted52wiki' [19:26:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:00] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='ted52wiki' [19:27:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:42] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*haakwiki* on mw*, test131, and mwtask141 [19:29:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='haakwiki' [19:29:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:29:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='haakwiki' [19:29:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:30:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='haakwiki' [19:30:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:30:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='haakwiki' [19:30:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:30:14] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='haakwiki' [19:30:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:30:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='haakwiki' [19:30:29] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='haakwiki' [19:30:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:30:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:32:10] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*angelstoyswiki* on mw*, test131, and mwtask141 [19:32:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:32:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='angelstoyswiki' [19:32:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:32:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='angelstoyswiki' [19:32:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:32:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='angelstoyswiki' [19:32:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:32:36] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='angelstoyswiki' [19:32:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:32:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='angelstoyswiki' [19:32:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:32:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='angelstoyswiki' [19:32:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:32:55] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='angelstoyswiki' [19:33:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:33:33] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*wikihoodwiki* on mw*, test131, and mwtask141 [19:33:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:33:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='wikihoodwiki' [19:33:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:33:46] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='wikihoodwiki' [19:33:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:33:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='wikihoodwiki' [19:33:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:34:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='wikihoodwiki' [19:34:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:34:07] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='wikihoodwiki' [19:34:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:34:13] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='wikihoodwiki' [19:34:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:34:19] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='wikihoodwiki' [19:34:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:35:29] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*secosawikiwiki* on mw*, test131, and mwtask141 [19:35:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='secosawikiwiki' [19:35:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:35:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='secosawikiwiki' [19:35:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:35:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:35:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='secosawikiwiki' [19:35:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:35:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='secosawikiwiki' [19:36:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='secosawikiwiki' [19:36:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='secosawikiwiki' [19:36:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:13] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='secosawikiwiki' [19:36:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:41] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*silveriowikiwiki* on mw*, test131, and mwtask141 [19:36:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='silveriowikiwiki' [19:36:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='silveriowikiwiki' [19:36:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:36:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='silveriowikiwiki' [19:37:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='silveriowikiwiki' [19:37:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:13] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='silveriowikiwiki' [19:37:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='silveriowikiwiki' [19:37:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:27] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='silveriowikiwiki' [19:37:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:41] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*silverionewscenterwiki* on mw*, test131, and mwtask141 [19:37:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='silverionewscenterwiki' [19:37:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:37:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='silverionewscenterwiki' [19:38:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='silverionewscenterwiki' [19:38:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='silverionewscenterwiki' [19:38:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:14] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='silverionewscenterwiki' [19:38:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:19] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='silverionewscenterwiki' [19:38:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:38:26] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='silverionewscenterwiki' [19:38:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:39:55] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*ezmccainwiki* on mw*, test131, and mwtask141 [19:40:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='ezmccainwiki' [19:40:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:09] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='ezmccainwiki' [19:40:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='ezmccainwiki' [19:40:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:24] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='ezmccainwiki' [19:40:31] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='ezmccainwiki' [19:40:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='ezmccainwiki' [19:40:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:40:45] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='ezmccainwiki' [19:40:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:15] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*memeswiki* on mw*, test131, and mwtask141 [19:41:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:22] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='memeswiki' [19:41:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:28] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='memeswiki' [19:41:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='memeswiki' [19:41:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='memeswiki' [19:41:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='memeswiki' [19:41:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:41:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='memeswiki' [19:42:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:42:02] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='memeswiki' [19:42:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:29] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*yahya2wiki* on mw*, test131, and mwtask141 [19:43:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:36] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='yahya2wiki' [19:43:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='yahya2wiki' [19:43:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='yahya2wiki' [19:43:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='yahya2wiki' [19:43:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:43:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='yahya2wiki' [19:44:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:44:05] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='yahya2wiki' [19:44:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:44:12] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='yahya2wiki' [19:44:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:37] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*nopediawiki* on mw*, test131, and mwtask141 [19:50:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:43] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='nopediawiki' [19:50:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:50] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='nopediawiki' [19:50:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:50:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='nopediawiki' [19:51:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:51:03] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='nopediawiki' [19:51:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:51:10] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='nopediawiki' [19:51:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:51:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='nopediawiki' [19:51:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:51:22] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='nopediawiki' [19:51:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:55:35] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [19:57:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballanarchywiki --missing (END - exit=65280) [19:57:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:58:58] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*kaylamarieleewiki* on mw*, test131, and mwtask141 [19:59:05] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='kaylamarieleewiki' [19:59:11] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='kaylamarieleewiki' [19:59:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='kaylamarieleewiki' [19:59:25] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='kaylamarieleewiki' [19:59:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:59:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='kaylamarieleewiki' [19:59:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:59:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='kaylamarieleewiki' [19:59:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:59:43] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='kaylamarieleewiki' [19:59:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:59:47] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.36, 9.82, 7.99 [19:59:48] CosmicAlpha: you don't have to log all that tbh [19:59:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:59:57] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*scp13wiki* on mw*, test131, and mwtask141 [19:59:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='scp13wiki' [20:00:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:11] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='scp13wiki' [20:00:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='scp13wiki' [20:00:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballanarchywiki --missing (START) [20:00:27] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='scp13wiki' [20:00:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:33] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='scp13wiki' [20:00:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:40] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='scp13wiki' [20:00:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:48] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='scp13wiki' [20:00:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:00:59] !log started the removal of gluster121 [20:01:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:01:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:01:30] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildImages.php --wiki=polcompballanarchywiki --missing (END - exit=256) [20:01:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:01:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.42, 8.65, 7.77 [20:02:12] hmm.... that failed with: `MWException from line 1728 of /srv/mediawiki/w/includes/filerepo/FileRepo.php: FileRepo::enumFilesInStorage: could not get file listing for mwstore://local-backend/local-public/6/69` @paladox [20:02:35] what wiki? [20:02:50] paladox: polcompballanarchywiki [20:03:07] that's using the old file backend and i just disconnected gluster121 [20:03:11] oh [20:04:13] !log shutdown gluster121 [20:04:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:05:51] PROBLEM - gluster121 glusterd Volume on gluster121 is CRITICAL: connect to address 2a10:6740::6:304 port 5666: No route to hostconnect to host 2a10:6740::6:304 port 5666: No route to host [20:07:26] PROBLEM - gluster121 SSH on gluster121 is CRITICAL: connect to address 2a10:6740::6:304 and port 22: No route to host [20:07:26] PROBLEM - ping6 on gluster121 is CRITICAL: CRITICAL - Destination Unreachable (2a10:6740::6:304) [20:07:37] PROBLEM - gluster121 Puppet on gluster121 is CRITICAL: connect to address 2a10:6740::6:304 port 5666: No route to hostconnect to host 2a10:6740::6:304 port 5666: No route to host [20:07:37] PROBLEM - Host gluster121 is DOWN: CRITICAL - Destination Unreachable (2a10:6740::6:304) [20:10:10] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*rasalhaguewiki* on mw*, test131, and mwtask141 [20:10:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='rasalhaguewiki' [20:10:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:25] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='rasalhaguewiki' [20:10:31] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='rasalhaguewiki' [20:10:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:37] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='rasalhaguewiki' [20:10:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:43] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='rasalhaguewiki' [20:10:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:49] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='rasalhaguewiki' [20:10:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:55] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='rasalhaguewiki' [20:10:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:11] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*funkeywiki* on mw*, test131, and mwtask141 [20:11:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='funkeywiki' [20:11:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='funkeywiki' [20:11:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:29] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='funkeywiki' [20:11:32] RECOVERY - Host gluster121 is UP: PING OK - Packet loss = 0%, RTA = 4.55 ms [20:11:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:36] RECOVERY - gluster121 Puppet on gluster121 is OK: OK: Puppet is currently enabled, last run 1 second ago with 0 failures [20:11:36] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='funkeywiki' [20:11:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:43] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='funkeywiki' [20:11:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:49] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='funkeywiki' [20:11:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:11:56] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='funkeywiki' [20:12:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:12] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*troddenmosswiki* on mw*, test131, and mwtask141 [20:12:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='troddenmosswiki' [20:12:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='troddenmosswiki' [20:12:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:29] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='troddenmosswiki' [20:12:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='troddenmosswiki' [20:12:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='troddenmosswiki' [20:12:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='troddenmosswiki' [20:12:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:12:53] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='troddenmosswiki' [20:12:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:21] RECOVERY - gluster121 SSH on gluster121 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [20:13:26] RECOVERY - ping6 on gluster121 is OK: PING OK - Packet loss = 0%, RTA = 1.65 ms [20:13:28] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*uponhumanzhillwiki* on mw*, test131, and mwtask141 [20:13:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='uponhumanzhillwiki' [20:13:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='uponhumanzhillwiki' [20:13:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='uponhumanzhillwiki' [20:13:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='uponhumanzhillwiki' [20:13:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:13:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='uponhumanzhillwiki' [20:14:05] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='uponhumanzhillwiki' [20:14:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:12] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='uponhumanzhillwiki' [20:14:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:35] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*bruhmomentewiki* on mw*, test131, and mwtask141 [20:14:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='bruhmomentewiki' [20:14:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:49] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='bruhmomentewiki' [20:14:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:14:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='bruhmomentewiki' [20:14:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='bruhmomentewiki' [20:15:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='bruhmomentewiki' [20:15:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='bruhmomentewiki' [20:15:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:19] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='bruhmomentewiki' [20:15:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:40] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*ocversewiki* on mw*, test131, and mwtask141 [20:15:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:46] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='ocversewiki' [20:15:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:15:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='ocversewiki' [20:15:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='ocversewiki' [20:16:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='ocversewiki' [20:16:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:09] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='ocversewiki' [20:16:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='ocversewiki' [20:16:21] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='ocversewiki' [20:16:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:48] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*creationwiki* on mw*, test131, and mwtask141 [20:16:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='creationwiki' [20:16:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='creationwiki' [20:17:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='creationwiki' [20:17:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:10] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='creationwiki' [20:17:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='creationwiki' [20:17:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='creationwiki' [20:17:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:28] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='creationwiki' [20:17:29] PROBLEM - ping6 on gluster121 is CRITICAL: CRITICAL - Destination Unreachable (2a10:6740::6:304) [20:17:29] PROBLEM - gluster121 SSH on gluster121 is CRITICAL: connect to address 2a10:6740::6:304 and port 22: No route to host [20:17:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:17:51] PROBLEM - Host gluster121 is DOWN: CRITICAL - Destination Unreachable (2a10:6740::6:304) [20:22:54] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*jmscwiki* on mw*, test131, and mwtask141 [20:23:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:05] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='jmscwiki'; [20:23:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='jmscwiki'; [20:23:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='jmscwiki'; [20:23:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='jmscwiki'; [20:23:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:34] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='jmscwiki'; [20:23:40] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='jmscwiki'; [20:23:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:46] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='jmscwiki'; [20:23:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:11] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*kwiki* on mw*, test131, and mwtask141 [20:24:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='kwiki'; [20:24:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='kwiki'; [20:24:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:28] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='kwiki'; [20:24:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='kwiki'; [20:24:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='kwiki'; [20:24:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:49] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='kwiki'; [20:24:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:24:55] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='kwiki'; [20:25:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:08] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*synthsvisionwiki* on mw*, test131, and mwtask141 [20:25:13] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='synthsvisionwiki'; [20:25:19] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='synthsvisionwiki'; [20:25:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='synthsvisionwiki'; [20:25:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='synthsvisionwiki'; [20:25:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='synthsvisionwiki'; [20:25:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='synthsvisionwiki'; [20:25:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:25:54] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='synthsvisionwiki'; [20:25:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:49] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*evolutionismwiki* on mw*, test131, and mwtask141 [20:26:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:26:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='evolutionismwiki'; [20:27:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:03] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='evolutionismwiki'; [20:27:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:09] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='evolutionismwiki'; [20:27:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='evolutionismwiki'; [20:27:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:22] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='evolutionismwiki'; [20:27:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:28] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='evolutionismwiki'; [20:27:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:27:35] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='evolutionismwiki'; [20:27:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:35:48] !log remove gluster121 [20:35:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:36:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.78, 3.76, 3.13 [20:36:42] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/6b95657909ee...97384607573f [20:36:43] [url] Comparing 6b95657909ee...97384607573f · miraheze/dns · GitHub | github.com [20:36:44] [02miraheze/dns] 07paladox 039738460 - Remove gluster121 from dns [20:37:28] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/97384607573f...3e76d1b0bfd4 [20:37:29] [url] Comparing 97384607573f...3e76d1b0bfd4 · miraheze/dns · GitHub | github.com [20:37:30] [02miraheze/dns] 07paladox 033e76d1b - Add swiftobject122 to dns [20:37:39] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*webkinzguidewiki* on mw*, test131, and mwtask141 [20:37:46] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='webkinzguidewiki'; [20:37:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:37:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:37:52] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='webkinzguidewiki'; [20:37:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:37:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='webkinzguidewiki'; [20:38:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:38:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='webkinzguidewiki'; [20:38:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:38:11] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='webkinzguidewiki'; [20:38:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:38:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='webkinzguidewiki'; [20:38:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:38:24] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='webkinzguidewiki'; [20:38:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:38:52] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*supersonicowikiwiki* on mw*, test131, and mwtask141 [20:38:57] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='supersonicowikiwiki'; [20:38:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:39:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:39:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='supersonicowikiwiki'; [20:39:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:39:10] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='supersonicowikiwiki'; [20:39:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='supersonicowikiwiki'; [20:39:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:39:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:39:22] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='supersonicowikiwiki'; [20:39:28] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='supersonicowikiwiki'; [20:39:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:39:34] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='supersonicowikiwiki'; [20:39:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:39:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:39:49] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*theexperiencewiki* on mw*, test131, and mwtask141 [20:39:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='theexperiencewiki'; [20:39:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='theexperiencewiki'; [20:40:04] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.86, 2.99, 2.97 [20:40:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='theexperiencewiki'; [20:40:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='theexperiencewiki'; [20:40:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='theexperiencewiki'; [20:40:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:29] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='theexperiencewiki'; [20:40:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:40:38] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='theexperiencewiki'; [20:40:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:41:02] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*cryonicswiki* on mw*, test131, and mwtask141 [20:41:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:41:09] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='cryonicswiki'; [20:41:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='cryonicswiki'; [20:41:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='cryonicswiki'; [20:41:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:41:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:41:31] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='cryonicswiki'; [20:41:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:41:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='cryonicswiki'; [20:41:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:41:51] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='cryonicswiki'; [20:41:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:41:58] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='cryonicswiki'; [20:42:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:12] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*dragcavewiki* on mw*, test131, and mwtask141 [20:42:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='dragcavewiki'; [20:42:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='dragcavewiki'; [20:42:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='dragcavewiki'; [20:42:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:42:50] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='dragcavewiki'; [20:42:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='dragcavewiki'; [20:43:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='dragcavewiki'; [20:43:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:12] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='dragcavewiki'; [20:43:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:35] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*polarisracingwiki* on mw*, test131, and mwtask141 [20:43:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='polarisracingwiki'; [20:43:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='polarisracingwiki'; [20:43:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:43:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='polarisracingwiki'; [20:43:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:44:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='polarisracingwiki'; [20:44:10] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='polarisracingwiki'; [20:44:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:44:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='polarisracingwiki'; [20:44:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:44:23] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='polarisracingwiki'; [20:44:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:44:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:44:37] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*pokemonfakemonwiki* on mw*, test131, and mwtask141 [20:44:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:44:44] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='pokemonfakemonwiki'; [20:44:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:44:51] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='pokemonfakemonwiki'; [20:44:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:44:58] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='pokemonfakemonwiki'; [20:45:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:45:05] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='pokemonfakemonwiki'; [20:45:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:45:13] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='pokemonfakemonwiki'; [20:45:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:45:19] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='pokemonfakemonwiki'; [20:45:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:45:27] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='pokemonfakemonwiki'; [20:45:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:45:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:49:42] [02ssl] 07Universal-Omega closed pull request 03#618: Remove tot.wiki as it no longer points to Miraheze - 13https://github.com/miraheze/ssl/pull/618 [20:49:42] [url] Page not found · GitHub · GitHub | github.com [20:49:45] [02miraheze/ssl] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±1] 13https://github.com/miraheze/ssl/compare/6a05049ecf67...7abb7a690856 [20:49:45] [url] Comparing 6a05049ecf67...7abb7a690856 · miraheze/ssl · GitHub | github.com [20:49:47] [02miraheze/ssl] 07Pix1234 037abb7a6 - Remove tot.wiki as it no longer points to Miraheze (#618) [20:59:25] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/ssl/private/tot.wiki.key] [21:01:18] PROBLEM - cp33 Puppet on cp33 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/ssl/private/tot.wiki.key] [21:01:29] PROBLEM - cp23 Puppet on cp23 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): File[/etc/ssl/private/tot.wiki.key] [21:02:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.59, 3.00, 2.80 [21:04:04] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 1.71, 2.56, 2.67 [21:05:39] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-1/±0] 13https://github.com/miraheze/puppet/compare/84053cedbd80...f63d527699af [21:05:40] [url] Comparing 84053cedbd80...f63d527699af · miraheze/puppet · GitHub | github.com [21:05:40] [02miraheze/puppet] 07paladox 03f63d527 - Delete gluster121.yaml [21:06:23] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/puppet/compare/f63d527699af...ab3dc1ebefa7 [21:06:24] [url] Comparing f63d527699af...ab3dc1ebefa7 · miraheze/puppet · GitHub | github.com [21:06:24] [02miraheze/puppet] 07paladox 03ab3dc1e - Install swiftobject122 [21:06:32] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-1/±0] 13https://github.com/miraheze/puppet/compare/ab3dc1ebefa7...6f651b7d741e [21:06:33] [url] Comparing ab3dc1ebefa7...6f651b7d741e · miraheze/puppet · GitHub | github.com [21:06:33] [02miraheze/puppet] 07paladox 036f651b7 - Delete swiftobject115.yaml [21:06:39] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-1/±0] 13https://github.com/miraheze/puppet/compare/6f651b7d741e...01b94b7f5bf5 [21:06:39] [url] Comparing 6f651b7d741e...01b94b7f5bf5 · miraheze/puppet · GitHub | github.com [21:06:40] [02miraheze/puppet] 07paladox 0301b94b7 - Delete swiftobject114.yaml [21:15:40] PROBLEM - swiftobject122 conntrack_table_size on swiftobject122 is CRITICAL: connect to address 2a10:6740::6:317 port 5666: Connection refusedconnect to host 2a10:6740::6:317 port 5666: Connection refused [21:15:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=autisticcharacterswiki --no-updates --username-prefix=mh:autisticcharacters /home/universalomega/ImportDump/autisticcharacterswiki-20221202201205.xml (START) [21:15:42] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: connect to address 2a10:6740::6:317 port 5666: Connection refusedconnect to host 2a10:6740::6:317 port 5666: Connection refused [21:15:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:15:51] PROBLEM - swiftobject122 APT on swiftobject122 is CRITICAL: connect to address 2a10:6740::6:317 port 5666: Connection refusedconnect to host 2a10:6740::6:317 port 5666: Connection refused [21:15:54] PROBLEM - swiftobject122 Swift Object Service on swiftobject122 is CRITICAL: connect to address 2a10:6740::6:317 and port 6000: Connection refused [21:15:55] PROBLEM - swiftobject122 ferm_active on swiftobject122 is CRITICAL: connect to address 2a10:6740::6:317 port 5666: Connection refusedconnect to host 2a10:6740::6:317 port 5666: Connection refused [21:15:57] PROBLEM - swiftobject122 Puppet on swiftobject122 is CRITICAL: connect to address 2a10:6740::6:317 port 5666: Connection refusedconnect to host 2a10:6740::6:317 port 5666: Connection refused [21:16:10] PROBLEM - swiftobject122 Disk Space on swiftobject122 is CRITICAL: connect to address 2a10:6740::6:317 port 5666: Connection refusedconnect to host 2a10:6740::6:317 port 5666: Connection refused [21:16:15] PROBLEM - swiftobject122 NTP time on swiftobject122 is CRITICAL: connect to address 2a10:6740::6:317 port 5666: Connection refusedconnect to host 2a10:6740::6:317 port 5666: Connection refused [21:16:21] PROBLEM - swiftobject122 PowerDNS Recursor on swiftobject122 is CRITICAL: connect to address 2a10:6740::6:317 port 5666: Connection refusedconnect to host 2a10:6740::6:317 port 5666: Connection refused [21:17:06] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=alcriswiki --no-updates --username-prefix=w /home/universalomega/ImportDump/alcriswiki-20221202164326.xml (START) [21:17:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:18:03] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=alcriswiki --no-updates --username-prefix=w /home/universalomega/ImportDump/alcriswiki-20221202164326.xml (END - exit=0) [21:18:04] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=alcriswiki (START) [21:18:12] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=silveriowikiwiki --no-updates --username-prefix=mh:silveriowiki /home/universalomega/ImportDump/silveriowikiwiki-20221202201604.xml (START) [21:18:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:18:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:18:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:18:50] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=autisticcharacterswiki --no-updates --username-prefix=mh:autisticcharacters /home/universalomega/ImportDump/autisticcharacterswiki-20221202201205.xml (END - exit=0) [21:18:51] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=autisticcharacterswiki (START) [21:18:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:19:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:19:56] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=silverionewscenterwiki --no-updates --username-prefix=mh:silverionewscenter /home/universalomega/ImportDump/silverionewscenterwiki-20221202202031.xml (START) [21:20:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:20:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=silverionewscenterwiki --no-updates --username-prefix=mh:silverionewscenter /home/universalomega/ImportDump/silverionewscenterwiki-20221202202031.xml (END - exit=0) [21:20:27] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=silverionewscenterwiki (START) [21:20:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:20:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:20:44] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=silverionewscenterwiki (END - exit=0) [21:20:45] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=silverionewscenterwiki --active --update (END - exit=0) [21:20:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:20:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:20:59] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=secosawikiwiki --no-updates --username-prefix=mh:secosawiki /home/universalomega/ImportDump/secosawikiwiki-20221202203054.xml (START) [21:21:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:21:09] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=autisticcharacterswiki (END - exit=0) [21:21:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=autisticcharacterswiki --active --update (END - exit=0) [21:21:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:21:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:21:40] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=silveriowikiwiki --no-updates --username-prefix=mh:silveriowiki /home/universalomega/ImportDump/silveriowikiwiki-20221202201604.xml (END - exit=0) [21:21:41] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=silveriowikiwiki (START) [21:21:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:21:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:23:10] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=silveriowikiwiki (END - exit=0) [21:23:11] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=silveriowikiwiki --active --update (END - exit=0) [21:23:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:23:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:24:19] RECOVERY - swiftobject122 PowerDNS Recursor on swiftobject122 is OK: DNS OK: 0.582 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [21:24:19] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=alcriswiki (END - exit=0) [21:24:20] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=alcriswiki --active --update (END - exit=0) [21:24:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:24:29] RECOVERY - swiftobject122 NTP time on swiftobject122 is OK: NTP OK: Offset -0.007522284985 secs [21:24:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:24:31] RECOVERY - swiftobject122 Disk Space on swiftobject122 is OK: DISK OK - free space: / 887039 MB (99% inode=99%); [21:25:26] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 1.08, 1.44, 1.10 [21:25:28] PROBLEM - swiftobject122 conntrack_table_size on swiftobject122 is UNKNOWN: NRPE: Unable to read output [21:25:37] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=secosawikiwiki --no-updates --username-prefix=mh:secosawiki /home/universalomega/ImportDump/secosawikiwiki-20221202203054.xml (END - exit=0) [21:25:38] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=secosawikiwiki (START) [21:25:41] RECOVERY - swiftobject122 APT on swiftobject122 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [21:25:45] PROBLEM - swiftobject122 Puppet on swiftobject122 is UNKNOWN: NRPE: Unable to read output [21:25:52] PROBLEM - swiftobject122 ferm_active on swiftobject122 is UNKNOWN: NRPE: Unable to read output [21:26:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:26:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:27:25] RECOVERY - swiftobject122 conntrack_table_size on swiftobject122 is OK: OK: nf_conntrack is 0 % full [21:27:35] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=secosawikiwiki (END - exit=0) [21:27:36] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=secosawikiwiki --active --update (END - exit=0) [21:27:43] RECOVERY - swiftobject122 Puppet on swiftobject122 is OK: OK: Puppet is currently enabled, last run 49 seconds ago with 0 failures [21:27:51] RECOVERY - swiftobject122 ferm_active on swiftobject122 is OK: OK ferm input default policy is set [21:27:58] PROBLEM - cp33 HTTPS on cp33 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:27:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:28:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:28:27] PROBLEM - cp33 SSH on cp33 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:28:33] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 74.208.203.152/cpweb, 2607:f1c0:1800:26f::1/cpweb [21:28:49] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 74.208.203.152/cpweb, 2607:f1c0:1800:26f::1/cpweb [21:29:02] RECOVERY - cp23 Puppet on cp23 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:29:05] [02puppet] 07paladox closed pull request 03#3034: mariadb: set optimizer_switch - 13https://github.com/miraheze/puppet/pull/3034 [21:29:05] [url] Page not found · GitHub · GitHub | github.com [21:29:08] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-9 [21:29:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/01b94b7f5bf5...773a8ace22b1 [21:29:10] [url] Comparing 01b94b7f5bf5...773a8ace22b1 · miraheze/puppet · GitHub | github.com [21:29:11] [02miraheze/puppet] 07paladox 03773a8ac - mariadb: set optimizer_switch (#3034) [21:29:12] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:29:14] [02puppet] 07paladox deleted branch 03paladox-patch-9 - 13https://github.com/miraheze/puppet [21:29:14] [url] Page not found · GitHub · GitHub | github.com [21:29:35] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 73.93, 68.21, 30.58 [21:29:57] RECOVERY - cp33 HTTPS on cp33 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3424 bytes in 0.434 second response time [21:30:21] RECOVERY - cp33 SSH on cp33 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [21:30:28] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [21:30:49] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [21:32:09] RECOVERY - cp33 Puppet on cp33 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [21:32:21] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 10.14, 4.99, 2.80 [21:35:22] RECOVERY - swiftobject122 Swift Object Service on swiftobject122 is OK: TCP OK - 0.000 second response time on 2a10:6740::6:317 port 6000 [21:36:17] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.82, 3.97, 2.99 [21:36:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.30, 3.63, 2.99 [21:38:15] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.56, 3.22, 2.83 [21:38:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.87, 3.70, 3.09 [21:44:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.35, 3.77, 3.29 [21:46:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.70, 3.83, 3.38 [21:50:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.00, 4.39, 3.70 [21:51:46] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.93, 3.81, 3.04 [21:51:49] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.32, 3.77, 2.71 [21:52:51] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/94b1b446b90c [21:52:54] [02miraheze/mw-config] 07Universal-Omega 0394b1b44 - Add line break [21:52:56] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [21:52:56] [url] Page not found · GitHub · GitHub | github.com [21:52:59] [02mw-config] 07Universal-Omega opened pull request 03#4999: Add line break - 13https://github.com/miraheze/mw-config/pull/4999 [21:52:59] [url] Page not found · GitHub · GitHub | github.com [21:53:01] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/853369cdf332 [21:53:04] [02miraheze/mw-config] 07Universal-Omega 03853369c - Remove shellbox [21:53:07] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-2-1 - 13https://github.com/miraheze/mw-config [21:53:08] [url] Page not found · GitHub · GitHub | github.com [21:53:08] [02mw-config] 07Universal-Omega opened pull request 03#5000: Remove shellbox - 13https://github.com/miraheze/mw-config/pull/5000 [21:53:09] ... [21:53:32] [02mw-config] 07Universal-Omega closed pull request 03#4999: Add line break - 13https://github.com/miraheze/mw-config/pull/4999 [21:53:32] ... [21:53:35] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/26de7e5928a9...f71db79a4686 [21:53:35] [url] Comparing 26de7e5928a9...f71db79a4686 · miraheze/mw-config · GitHub | github.com [21:53:37] [02miraheze/mw-config] 07Universal-Omega 03f71db79 - Add line break (#4999) [21:53:39] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [21:53:42] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [21:53:42] [url] Page not found · GitHub · GitHub | github.com [21:53:43] [02mw-config] 07Universal-Omega closed pull request 03#5000: Remove shellbox - 13https://github.com/miraheze/mw-config/pull/5000 [21:53:43] ... [21:53:46] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/f71db79a4686...02a627c32ad5 [21:53:47] [url] Comparing f71db79a4686...02a627c32ad5 · miraheze/mw-config · GitHub | github.com [21:53:47] [02miraheze/mw-config] 07Universal-Omega 0302a627c - Remove shellbox (#5000) [21:53:48] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2-1 [21:53:49] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.63, 3.75, 2.84 [21:53:50] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2-1 - 13https://github.com/miraheze/mw-config [21:53:50] [url] Page not found · GitHub · GitHub | github.com [21:53:54] miraheze/mw-config - Universal-Omega the build passed. [21:54:06] miraheze/mw-config - Universal-Omega the build passed. [21:54:10] [02mw-config] 07Universal-Omega reviewed pull request 03#4998 commit - 13https://github.com/miraheze/mw-config/pull/4998#discussion_r1038570698 [21:54:11] [url] disable localClientDatabases, enable allowDataAccessInUserLanguage on gratisdatawiki by ugochimobi · Pull Request #4998 · miraheze/mw-config · GitHub | github.com [21:54:27] miraheze/mw-config - Universal-Omega the build passed. [21:54:47] miraheze/mw-config - Universal-Omega the build passed. [21:56:48] !log [@test131] starting deploy of {'config': True} to all [21:56:49] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [21:56:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:57:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:58:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.38, 4.00, 3.83 [22:01:49] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.14, 3.89, 3.27 [22:02:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.11, 3.85, 3.79 [22:04:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.51, 3.75, 3.77 [22:05:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 4.43, 3.51, 2.59 [22:06:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.02, 3.99, 3.86 [22:06:52] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.28, 1.19, 3.75 [22:06:57] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.60, 3.21, 2.67 [22:08:52] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.81, 1.02, 3.38 [22:08:54] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.40, 3.62, 2.89 [22:09:41] !log [@mwtask141] starting deploy of {'config': True} to all [22:09:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:09:48] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 6s [22:09:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:10:52] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.38, 3.59, 2.98 [22:10:53] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 3.31, 3.37, 3.33 [22:12:49] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.32, 3.84, 3.14 [22:19:31] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.58, 4.26, 3.72 [22:22:37] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.09, 3.83, 3.57 [22:23:20] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.92, 3.86, 3.71 [22:24:34] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.71, 4.12, 3.70 [22:26:32] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.99, 4.00, 3.71 [22:27:10] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.69, 3.97, 3.76 [22:28:29] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.07, 4.02, 3.75 [22:29:05] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.39, 3.71, 3.69 [22:32:24] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.69, 3.74, 3.68 [22:33:01] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=evolutionismwiki --no-updates --username-prefix=mh:immanuelle /home/universalomega/ImportDump/evolutionismwiki-20221202215540.xml (START) [22:33:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:34:22] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.10, 3.80, 3.70 [22:34:49] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.38, 3.81, 3.70 [22:34:58] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*afaoswiki* on mw*, test131, and mwtask141 [22:35:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='afaoswiki'; [22:35:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='afaoswiki'; [22:35:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='afaoswiki'; [22:35:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:25] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='afaoswiki'; [22:35:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='afaoswiki'; [22:35:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='afaoswiki'; [22:35:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:35:47] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='afaoswiki'; [22:35:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:36:19] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.86, 3.90, 3.76 [22:36:49] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*universepediawiki* on mw*, test131, and mwtask141 [22:36:55] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='universepediawiki'; [22:36:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='universepediawiki'; [22:37:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:08] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [22:37:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='universepediawiki'; [22:37:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='universepediawiki'; [22:37:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='universepediawiki'; [22:37:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:29] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='universepediawiki'; [22:37:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:37:37] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='universepediawiki'; [22:37:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:38:39] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.46, 3.84, 3.76 [22:39:37] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*welcometokgwiki* on mw*, test131, and mwtask141 [22:39:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:43] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='welcometokgwiki'; [22:39:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:50] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='welcometokgwiki'; [22:39:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:39:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='welcometokgwiki'; [22:40:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:03] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='welcometokgwiki'; [22:40:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:11] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='welcometokgwiki'; [22:40:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='welcometokgwiki'; [22:40:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:25] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='welcometokgwiki'; [22:40:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:40:56] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*memoniwiki* on mw*, test131, and mwtask141 [22:41:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='memoniwiki'; [22:41:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:08] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 7 = Critical] [22:41:09] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='memoniwiki'; [22:41:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='memoniwiki'; [22:41:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:24] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='memoniwiki'; [22:41:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:31] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='memoniwiki'; [22:41:33] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=evolutionismwiki --no-updates --username-prefix=mh:immanuelle /home/universalomega/ImportDump/evolutionismwiki-20221202215540.xml (END - exit=0) [22:41:34] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=evolutionismwiki (START) [22:41:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='memoniwiki'; [22:41:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:44] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='memoniwiki'; [22:41:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:41:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:01] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*kohwiki* on mw*, test131, and mwtask141 [22:42:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='kohwiki'; [22:42:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='kohwiki'; [22:42:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='kohwiki'; [22:42:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='kohwiki'; [22:42:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:37] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='kohwiki'; [22:42:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.09, 3.65, 3.94 [22:42:41] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=polcompballanarchywiki (END - exit=0) [22:42:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:42:43] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=polcompballanarchywiki --active --update (END - exit=0) [22:42:44] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='kohwiki'; [22:42:51] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='kohwiki'; [22:43:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:43:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:43:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:43:15] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*onlinemusicsongcontestwiki* on mw*, test131, and mwtask141 [22:43:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:43:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='onlinemusicsongcontestwiki'; [22:43:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:43:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:43:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='onlinemusicsongcontestwiki'; [22:43:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:43:37] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='onlinemusicsongcontestwiki'; [22:43:45] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='onlinemusicsongcontestwiki'; [22:43:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:43:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='onlinemusicsongcontestwiki'; [22:43:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='onlinemusicsongcontestwiki'; [22:44:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:07] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='onlinemusicsongcontestwiki'; [22:44:09] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.14, 4.09, 3.82 [22:44:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:23] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*xyrinfewiki* on mw*, test131, and mwtask141 [22:44:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:31] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='xyrinfewiki'; [22:44:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='xyrinfewiki'; [22:44:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.34, 3.93, 4.00 [22:44:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:45] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='xyrinfewiki'; [22:44:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:44:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='xyrinfewiki'; [22:44:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:01] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='xyrinfewiki'; [22:45:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='xyrinfewiki'; [22:45:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:18] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='xyrinfewiki'; [22:45:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:33] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*kinkpediawiki* on mw*, test131, and mwtask141 [22:45:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:39] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='kinkpediawiki'; [22:45:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:46] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='kinkpediawiki'; [22:45:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:45:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='kinkpediawiki'; [22:45:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='kinkpediawiki'; [22:45:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:05] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='kinkpediawiki'; [22:46:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='kinkpediawiki'; [22:46:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:19] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='kinkpediawiki'; [22:46:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.55, 3.73, 3.67 [22:46:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:36] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*monolithwiki* on mw*, test131, and mwtask141 [22:46:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:43] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='monolithwiki'; [22:46:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:50] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='monolithwiki'; [22:46:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:46:57] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='monolithwiki'; [22:47:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='monolithwiki'; [22:47:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:11] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='monolithwiki'; [22:47:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='monolithwiki'; [22:47:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:24] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='monolithwiki'; [22:47:25] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=evolutionismwiki (END - exit=0) [22:47:26] !log [universalomega@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=evolutionismwiki --active --update (END - exit=0) [22:47:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:47:58] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*zhvupwikiwiki* on mw*, test131, and mwtask141 [22:48:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='zhvupwikiwiki'; [22:48:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:05] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.58, 3.88, 3.80 [22:48:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='zhvupwikiwiki'; [22:48:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 2.87, 3.37, 3.54 [22:48:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='zhvupwikiwiki'; [22:48:29] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='zhvupwikiwiki'; [22:48:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='zhvupwikiwiki'; [22:48:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='zhvupwikiwiki'; [22:48:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:48:48] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='zhvupwikiwiki'; [22:48:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:06] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*islamwiki* on mw*, test131, and mwtask141 [22:49:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='islamwiki'; [22:49:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='islamwiki'; [22:49:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:25] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='islamwiki'; [22:49:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:31] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='islamwiki'; [22:49:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:37] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='islamwiki'; [22:49:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:43] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='islamwiki'; [22:49:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:49:49] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='islamwiki'; [22:49:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 5.74, 4.47, 4.02 [22:50:13] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*echoesofhyboriawiki* on mw*, test131, and mwtask141 [22:50:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.42, 3.71, 3.64 [22:50:20] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='echoesofhyboriawiki'; [22:50:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='echoesofhyboriawiki'; [22:50:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:33] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='echoesofhyboriawiki'; [22:50:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:40] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='echoesofhyboriawiki'; [22:50:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:46] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='echoesofhyboriawiki'; [22:50:51] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='echoesofhyboriawiki'; [22:50:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:50:57] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='echoesofhyboriawiki'; [22:51:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:15] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*pokeclickerwiki* on mw*, test131, and mwtask141 [22:51:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:20] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='pokeclickerwiki'; [22:51:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:27] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='pokeclickerwiki'; [22:51:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:33] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='pokeclickerwiki'; [22:51:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='pokeclickerwiki'; [22:51:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:45] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='pokeclickerwiki'; [22:51:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:51] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='pokeclickerwiki'; [22:51:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:51:58] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='pokeclickerwiki'; [22:52:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 2.48, 2.98, 4.00 [22:52:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:14] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*selahwiki* on mw*, test131, and mwtask141 [22:52:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.89, 3.75, 3.66 [22:52:20] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='selahwiki'; [22:52:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:28] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='selahwiki'; [22:52:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:34] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='selahwiki'; [22:52:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='selahwiki'; [22:52:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='selahwiki'; [22:52:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:52:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='selahwiki'; [22:53:00] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='selahwiki'; [22:53:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:25] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*wutheringwaveswiki* on mw*, test131, and mwtask141 [22:53:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='wutheringwaveswiki'; [22:53:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:36] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='wutheringwaveswiki'; [22:53:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='wutheringwaveswiki'; [22:53:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='wutheringwaveswiki'; [22:53:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='wutheringwaveswiki'; [22:53:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:53:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='wutheringwaveswiki'; [22:54:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:06] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='wutheringwaveswiki'; [22:54:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:35] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*gaiawiki* on mw*, test131, and mwtask141 [22:54:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='gaiawiki'; [22:54:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='gaiawiki'; [22:54:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:54:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='gaiawiki'; [22:55:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='gaiawiki'; [22:55:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:55:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:55:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='gaiawiki'; [22:55:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:55:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='gaiawiki'; [22:55:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:55:23] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='gaiawiki'; [22:55:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [22:56:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 6.11, 3.60, 3.94 [22:58:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.09, 3.72, 3.87 [23:04:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 6.32, 4.32, 4.01 [23:04:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.04, 3.61, 3.57 [23:05:51] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.67, 2.60, 1.69 [23:06:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.87, 3.73, 3.62 [23:07:49] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.90, 2.58, 1.79 [23:08:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.74, 3.87, 3.89 [23:12:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.58, 4.12, 3.98 [23:16:55] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.15, 3.09, 1.75 [23:17:01] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 7.21, 3.41, 1.74 [23:18:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 2.89, 3.69, 3.89 [23:18:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.18, 3.76, 3.99 [23:19:01] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 3.35, 3.40, 1.95 [23:20:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.48, 3.95, 3.96 [23:22:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.22, 3.72, 3.88 [23:22:13] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*erthreetradingwiki* on mw*, test131, and mwtask141 [23:22:20] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='erthreetradingwiki'; [23:22:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:22:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:22:26] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='erthreetradingwiki'; [23:22:32] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='erthreetradingwiki'; [23:22:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:22:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='erthreetradingwiki'; [23:22:44] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='erthreetradingwiki'; [23:22:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:22:50] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='erthreetradingwiki'; [23:22:55] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 3.33, 3.91, 2.62 [23:22:56] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='erthreetradingwiki'; [23:23:01] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.51, 3.89, 2.51 [23:23:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:23:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:23:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:23:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:24:55] PROBLEM - gluster112 Current Load on gluster112 is CRITICAL: CRITICAL - load average: 5.47, 4.48, 2.98 [23:25:36] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*sirfswiki* on mw*, test131, and mwtask141 [23:25:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='sirfswiki'; [23:25:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:25:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='sirfswiki'; [23:25:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:25:56] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='sirfswiki'; [23:26:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='sirfswiki'; [23:26:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:09] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='sirfswiki'; [23:26:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='sirfswiki'; [23:26:22] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='sirfswiki'; [23:26:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:26:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 4.05, 3.68, 3.83 [23:26:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:27:01] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.27, 3.89, 2.82 [23:27:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:28:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.43, 3.61, 3.79 [23:29:01] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 2.41, 3.46, 2.80 [23:30:07] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*naidbwiki* on mw*, test131, and mwtask141 [23:30:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:30:14] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='naidbwiki'; [23:30:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:30:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 4.13, 3.52, 3.49 [23:30:21] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='naidbwiki'; [23:30:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:30:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='naidbwiki'; [23:30:38] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='naidbwiki'; [23:30:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 5.14, 3.99, 3.90 [23:30:44] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='naidbwiki'; [23:30:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:30:50] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='naidbwiki'; [23:30:56] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='naidbwiki'; [23:30:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:01] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.26, 4.02, 3.10 [23:31:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:31:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:32:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.47, 3.46, 3.47 [23:32:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.55, 3.80, 3.84 [23:33:01] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.50, 3.90, 3.17 [23:33:35] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*ruchiwiki* on mw*, test131, and mwtask141 [23:33:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='ruchiwiki'; [23:33:47] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='ruchiwiki'; [23:33:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:53] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='ruchiwiki'; [23:34:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='ruchiwiki'; [23:34:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='ruchiwiki'; [23:34:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:13] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='ruchiwiki'; [23:34:19] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='ruchiwiki'; [23:34:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:34:54] PROBLEM - discordian.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - discordian.wiki All nameservers failed to answer the query. [23:34:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:01] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.25, 4.21, 3.38 [23:35:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:35:49] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.30, 3.70, 3.95 [23:36:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is CRITICAL: CRITICAL - load average: 5.77, 4.01, 3.64 [23:36:21] PROBLEM - gluster102 Current Load on gluster102 is WARNING: WARNING - load average: 3.42, 2.94, 2.31 [23:37:09] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*waysofdarknesswiki* on mw*, test131, and mwtask141 [23:37:17] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='waysofdarknesswiki'; [23:37:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:37:23] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='waysofdarknesswiki'; [23:37:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:37:29] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='waysofdarknesswiki'; [23:37:35] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='waysofdarknesswiki'; [23:37:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:37:41] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='waysofdarknesswiki'; [23:37:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:37:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='waysofdarknesswiki'; [23:37:49] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 4.53, 4.12, 4.08 [23:37:54] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='waysofdarknesswiki'; [23:37:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:38:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:38:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:38:16] RECOVERY - gluster102 Current Load on gluster102 is OK: OK - load average: 2.68, 2.78, 2.32 [23:38:19] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 3.33, 3.83, 3.63 [23:38:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:11] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*termoversewiki* on mw*, test131, and mwtask141 [23:40:18] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='termoversewiki'; [23:40:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:24] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='termoversewiki'; [23:40:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:30] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='termoversewiki'; [23:40:36] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='termoversewiki'; [23:40:39] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 6.02, 4.29, 3.97 [23:40:42] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='termoversewiki'; [23:40:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:48] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='termoversewiki'; [23:40:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:40:55] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='termoversewiki'; [23:41:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:41:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:41:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:41:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:42:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.16, 3.92, 3.83 [23:42:55] PROBLEM - gluster112 Current Load on gluster112 is WARNING: WARNING - load average: 1.33, 3.54, 3.88 [23:43:38] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*chadsofawiki* on mw*, test131, and mwtask141 [23:43:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:43:45] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='chadsofawiki'; [23:43:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:43:51] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='chadsofawiki'; [23:43:57] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='chadsofawiki'; [23:43:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:03] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='chadsofawiki'; [23:44:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='chadsofawiki'; [23:44:13] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='chadsofawiki'; [23:44:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:20] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='chadsofawiki'; [23:44:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:44:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:45:01] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 1.67, 3.10, 3.47 [23:46:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 1.92, 3.20, 3.90 [23:46:55] RECOVERY - gluster112 Current Load on gluster112 is OK: OK - load average: 0.62, 2.12, 3.23 [23:47:01] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 0.73, 2.30, 3.13 [23:48:30] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*kaslainiawiki* on mw*, test131, and mwtask141 [23:48:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:48:37] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='kaslainiawiki'; [23:48:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:48:46] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='kaslainiawiki'; [23:48:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:48:54] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='kaslainiawiki'; [23:49:00] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='kaslainiawiki'; [23:49:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:49:06] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='kaslainiawiki'; [23:49:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:49:12] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='kaslainiawiki'; [23:49:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:49:18] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='kaslainiawiki'; [23:49:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:49:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:50:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 7.54, 4.83, 4.32 [23:51:39] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*lifeoffvirtuawiki* on mw*, test131, and mwtask141 [23:51:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:51:45] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='lifeoffvirtuawiki'; [23:51:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:51:52] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='lifeoffvirtuawiki'; [23:51:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:51:59] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='lifeoffvirtuawiki'; [23:52:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.77, 3.98, 3.98 [23:52:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:52:04] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='lifeoffvirtuawiki'; [23:52:10] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='lifeoffvirtuawiki'; [23:52:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:52:15] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='lifeoffvirtuawiki'; [23:52:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:52:21] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='lifeoffvirtuawiki'; [23:52:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:52:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:54:27] !log [universalomega@puppet141] sudo -u www-data rm /srv/mediawiki/cache/*knowledgedancewiki* on mw*, test131, and mwtask141 [23:54:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:54:36] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname='knowledgedancewiki'; [23:54:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:54:45] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_settings WHERE s_dbname='knowledgedancewiki'; [23:54:52] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_namespaces WHERE ns_dbname='knowledgedancewiki'; [23:55:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:55:02] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM mw_permissions WHERE perm_dbname='knowledgedancewiki'; [23:55:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:55:08] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localnames WHERE ln_wiki='knowledgedancewiki'; [23:55:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:55:16] !log [universalomega@db101] MariaDB [mhglobal]> DELETE FROM localuser WHERE lu_wiki='knowledgedancewiki'; [23:55:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:55:25] !log [universalomega@db101] MariaDB [metawiki]> DELETE FROM echo_unread_wikis WHERE euw_wiki='knowledgedancewiki'; [23:55:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:55:35] [Grafana] !sre FIRING: The mediawiki job queue has more than 2500 unclaimed jobs https://grafana.miraheze.org/d/GtxbP1Xnk?orgId=1 [23:55:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:56:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is CRITICAL: CRITICAL - load average: 4.62, 4.14, 4.01 [23:56:19] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 2.64, 3.07, 3.35 [23:56:40] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 3.45, 3.78, 3.94 [23:58:04] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 3.56, 3.92, 3.95