[00:00:03] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.40, 3.74, 3.58 [00:03:15] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.27, 3.42, 2.79 [00:05:11] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.77, 3.25, 2.81 [00:06:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.96, 2.80, 3.27 [00:11:02] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.33, 3.78, 3.18 [00:12:59] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.56, 3.00, 2.97 [00:34:02] RECOVERY - graylog131 NTP time on graylog131 is OK: NTP OK: Offset -0.0009938776493 secs [00:36:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.17, 4.38, 3.22 [00:38:39] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.66, 3.87, 3.16 [00:38:48] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [00:40:07] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [00:40:17] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.12, 6.37, 4.18 [00:40:33] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.08, 2.72, 1.54 [00:41:08] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [00:42:17] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 6.43, 6.39, 4.45 [00:42:34] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.43, 2.87, 1.74 [00:42:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.59, 4.15, 3.42 [00:44:33] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.73, 2.95, 1.92 [00:44:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.94, 3.46, 3.27 [00:46:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.13, 2.62, 2.98 [00:53:06] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1824074984 secs [00:53:31] [02mw-config] 07AgentIsai opened pull request 03#5203: Disable Graph - 13https://github.com/miraheze/mw-config/pull/5203 [00:54:52] [02mw-config] 07AgentIsai synchronize pull request 03#5203: Disable Graph - 13https://github.com/miraheze/mw-config/pull/5203 [00:55:51] miraheze/mw-config - AgentIsai the build passed. [00:56:47] [02mw-config] 07AgentIsai synchronize pull request 03#5203: Disable Graph - 13https://github.com/miraheze/mw-config/pull/5203 [00:57:06] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08263671398 secs [00:57:48] miraheze/mw-config - AgentIsai the build passed. [00:58:29] [02mw-config] 07AgentIsai synchronize pull request 03#5203: Disable Graph - 13https://github.com/miraheze/mw-config/pull/5203 [00:59:31] miraheze/mw-config - AgentIsai the build passed. [01:05:00] [02mw-config] 07paladox closed pull request 03#5203: Disable Graph - 13https://github.com/miraheze/mw-config/pull/5203 [01:05:01] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/5e5c3170a565...14e913b9280f [01:05:04] [02miraheze/mw-config] 07AgentIsai 0314e913b - Disable Graph (#5203) [01:06:00] miraheze/mw-config - paladox the build passed. [01:06:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.56, 3.84, 2.79 [01:08:39] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.58, 3.72, 2.90 [01:09:20] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [01:10:05] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [01:10:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.97, 3.24, 2.83 [01:10:50] !log [@mwtask141] starting deploy of {'config': True} to all [01:10:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:10:59] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 8s [01:11:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:11:06] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.126917094 secs [01:11:17] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [01:15:06] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.07388174534 secs [01:26:38] !log [@test131] starting deploy of {'config': True} to all [01:26:39] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [01:26:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:26:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:39:44] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8359 MB (6% inode=99%); [01:55:06] PROBLEM - mystiverse.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mystiverse.wiki could not be found [02:05:34] PROBLEM - mystiverse.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address mystiverse.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [02:06:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.02, 3.52, 2.80 [02:08:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.91, 2.93, 2.68 [02:11:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.30, 10.34, 9.12 [02:13:41] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.15, 10.49, 9.34 [02:15:39] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.66, 9.31, 9.04 [02:25:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.90, 3.10, 2.56 [02:26:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.30, 2.79, 2.51 [02:37:11] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.50, 3.42, 2.71 [02:39:08] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.39, 3.01, 2.64 [02:53:44] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7963 MB (5% inode=99%); [03:00:38] RECOVERY - db121 Backups SQL on db121 is OK: FILE_AGE OK: /var/log/sql-backup.log is 35 seconds old and 275 bytes [03:04:02] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.74, 4.19, 3.03 [03:06:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.95, 3.35, 2.87 [03:20:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.02, 3.72, 3.24 [03:24:02] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.46, 3.98, 3.40 [03:26:02] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.42, 3.62, 3.34 [03:28:02] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.99, 3.01, 3.14 [03:39:30] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [03:41:26] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [04:01:38] PROBLEM - graylog131 NTP time on graylog131 is CRITICAL: NTP CRITICAL: Offset 0.7811754942 secs [04:07:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.89, 4.05, 3.00 [04:09:36] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [04:11:31] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [04:11:44] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.72, 3.51, 3.04 [04:13:40] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.36, 2.77, 2.82 [04:28:32] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.84, 6.72, 5.38 [04:30:30] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 6.13, 6.64, 5.53 [04:32:08] RECOVERY - graylog131 NTP time on graylog131 is OK: NTP OK: Offset 0.002555012703 secs [04:32:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.14, 10.67, 9.28 [04:34:42] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.34, 11.22, 9.64 [04:36:40] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.92, 10.75, 9.66 [04:38:38] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.55, 9.58, 9.36 [04:39:22] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.86, 7.39, 6.27 [04:41:20] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.28, 7.69, 6.52 [04:42:33] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.52, 11.80, 10.27 [04:44:31] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.40, 10.54, 10.00 [04:46:29] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.97, 9.15, 9.55 [04:47:16] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 5.95, 7.64, 6.95 [04:49:15] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.35, 7.68, 7.02 [04:51:13] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 5.90, 7.10, 6.90 [04:53:12] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 5.56, 6.63, 6.76 [04:59:06] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.66, 7.42, 6.99 [05:01:05] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 5.99, 6.84, 6.83 [05:03:04] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 5.84, 6.55, 6.72 [05:04:51] RECOVERY - mystiverse.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'mystiverse.wiki' will expire on Fri 12 May 2023 03:49:07 GMT +0000. [05:06:59] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.56, 7.57, 7.13 [05:14:54] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 4.71, 6.04, 6.59 [05:15:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 3.74, 4.72, 3.31 [05:15:44] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8322 MB (6% inode=99%); [05:17:30] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.62, 3.64, 3.08 [05:19:19] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.91, 3.15, 2.97 [05:22:12] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.11, 6.26, 5.14 [05:24:11] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.46, 6.62, 5.41 [05:24:43] RECOVERY - mystiverse.wiki - reverse DNS on sslhost is OK: SSL OK - mystiverse.wiki reverse DNS resolves to cp23.miraheze.org - CNAME FLAT [05:26:12] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.96, 5.84, 5.26 [05:28:46] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.35, 10.01, 9.13 [05:30:44] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.10, 10.69, 9.45 [05:32:43] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.96, 10.56, 9.55 [05:34:41] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.28, 9.81, 9.40 [05:36:26] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419051200.xml (START) [05:36:32] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419051200.xml (END - exit=0) [05:36:33] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tttewikiwiki (START) [05:36:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:36:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:36:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:38:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.74, 10.69, 9.87 [05:40:33] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.20, 12.37, 10.57 [05:41:25] PROBLEM - graylog131 NTP time on graylog131 is WARNING: NTP WARNING: Offset 0.428111434 secs [05:42:31] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.88, 11.47, 10.47 [05:44:30] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.90, 11.93, 10.75 [05:46:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.67, 11.95, 10.93 [05:47:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.90, 10.64, 9.68 [05:47:43] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:49:11] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.25, 9.77, 9.46 [05:49:37] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.01, 6.69, 6.21 [05:51:24] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 6.78, 6.80, 6.31 [05:53:12] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.70, 6.85, 5.76 [05:54:20] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.29, 11.85, 11.16 [05:55:11] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.14, 6.46, 5.74 [05:55:40] RECOVERY - graylog131 NTP time on graylog131 is OK: NTP OK: Offset -0.008898347616 secs [05:56:04] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tttewikiwiki (END - exit=0) [05:56:05] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=tttewikiwiki --active --update (END - exit=0) [05:56:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:56:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:58:17] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.91, 10.88, 10.98 [05:59:17] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 6.91, 7.19, 6.66 [06:02:13] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.59, 9.06, 10.18 [06:12:00] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.38, 11.27, 10.63 [06:13:07] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 6.03, 6.76, 6.79 [06:15:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.06, 11.99, 11.12 [06:17:42] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [06:21:01] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.01, 7.19, 6.90 [06:23:00] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 6.53, 7.04, 6.89 [06:23:49] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.29, 9.20, 10.08 [06:23:56] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.26, 7.22, 6.13 [06:25:37] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [06:25:55] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.92, 7.31, 6.29 [06:26:57] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 6.05, 6.67, 6.79 [06:27:44] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 15 packages available for upgrade (0 critical updates). [06:27:54] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.88, 6.29, 6.04 [06:31:49] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1024334133 secs [06:33:49] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.0809122324 secs [06:36:49] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 7.25, 6.78, 6.70 [06:38:47] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 6.17, 6.48, 6.60 [06:39:44] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7969 MB (5% inode=99%); [06:39:49] PROBLEM - cp23 NTP time on cp23 is CRITICAL: NTP CRITICAL: Offset 0.5707971752 secs [06:55:59] !log sudo service ircrcbot restat on mon141 [06:56:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:56:45] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03lockedwikisitenotice [+0/-0/±2] 13https://github.com/miraheze/MirahezeMagic/commit/ed9073f7b3d6 [06:56:48] [02miraheze/MirahezeMagic] 07Reception123 03ed9073f - specific sitenotice for steward/t&s closed wikis [06:56:50] [02MirahezeMagic] 07Reception123 created branch 03lockedwikisitenotice - 13https://github.com/miraheze/MirahezeMagic [06:56:53] [02MirahezeMagic] 07Reception123 opened pull request 03#416: specific sitenotice for steward/t&s closed wikis - 13https://github.com/miraheze/MirahezeMagic/pull/416 [06:58:55] [02miraheze/MirahezeMagic] 07github-actions[bot] pushed 031 commit to 03lockedwikisitenotice [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ed9073f7b3d6...b6bafd55e2b6 [06:58:56] [02miraheze/MirahezeMagic] 07github-actions 03b6bafd5 - CI: lint code to MediaWiki standards [06:58:57] [02MirahezeMagic] 07github-actions[bot] synchronize pull request 03#416: specific sitenotice for steward/t&s closed wikis - 13https://github.com/miraheze/MirahezeMagic/pull/416 [06:59:00] [02MirahezeMagic] 07Reception123 synchronize pull request 03#416: specific sitenotice for steward/t&s closed wikis - 13https://github.com/miraheze/MirahezeMagic/pull/416 [06:59:01] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03lockedwikisitenotice [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/b6bafd55e2b6...4a9236c16efa [06:59:03] [02miraheze/MirahezeMagic] 07Reception123 034a9236c - slightly modify text [06:59:49] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.4957728982 secs [07:00:04] [02MirahezeMagic] 07Reception123 edited pull request 03#416: specific sitenotice for steward/t&s closed wikis (T4164 ) - 13https://github.com/miraheze/MirahezeMagic/pull/416 [07:00:07] [02MirahezeMagic] 07Reception123 edited pull request 03#416: specific sitenotice for steward/t&s closed wikis (T4164) - 13https://github.com/miraheze/MirahezeMagic/pull/416 [07:07:17] miraheze/MirahezeMagic - Reception123 the build passed. [07:07:49] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.002785861492 secs [07:08:37] PROBLEM - os141 Current Load on os141 is WARNING: WARNING - load average: 3.49, 2.36, 1.19 [07:08:55] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:10:34] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.05, 2.24, 1.29 [07:11:59] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.09, 10.85, 9.15 [07:13:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.97, 10.35, 9.18 [07:14:08] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [07:15:55] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.32, 9.30, 8.94 [07:19:37] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:33:49] PROBLEM - cp23 NTP time on cp23 is CRITICAL: NTP CRITICAL: Offset 0.5514424741 secs [07:41:49] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.001127749681 secs [07:49:36] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [07:51:18] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.89, 5.83, 4.89 [07:53:17] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.71, 5.97, 5.05 [08:11:49] PROBLEM - cp23 NTP time on cp23 is CRITICAL: NTP CRITICAL: Offset 0.5020425916 secs [08:11:59] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.98, 12.19, 9.80 [08:13:49] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.0007801353931 secs [08:13:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.39, 11.61, 9.88 [08:17:44] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8302 MB (6% inode=99%); [08:17:54] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.46, 9.27, 9.32 [08:27:49] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2451741993 secs [08:31:49] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.0245603323 secs [08:37:06] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.36, 2.74, 1.95 [08:38:48] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:40:59] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.01, 2.98, 2.24 [08:41:24] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [08:45:44] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7968 MB (5% inode=99%); [09:22:32] [02mw-config] 07Universal-Omega reviewed pull request 03#5203 commit - 13https://github.com/miraheze/mw-config/pull/5203#discussion_r1171068771 [09:35:40] PROBLEM - wiki.seamly.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.seamly.net. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:05:40] PROBLEM - wiki.seamly.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.seamly.net All nameservers failed to answer the query. [10:05:45] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 8.92, 6.62, 3.95 [10:07:45] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.34, 6.37, 4.24 [10:11:45] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.71, 6.96, 5.10 [10:15:45] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.06, 5.90, 5.16 [10:21:45] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 6.47, 7.43, 6.11 [10:25:46] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.53, 6.50, 6.12 [10:31:45] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 5.81, 9.74, 7.88 [10:35:40] PROBLEM - wiki.seamly.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query seamly.net. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:35:45] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 3.24, 7.30, 7.42 [10:39:44] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8124 MB (6% inode=99%); [10:41:45] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.46, 4.13, 6.17 [10:53:44] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7964 MB (5% inode=99%); [11:05:24] PROBLEM - housing.wiki - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query housing.wiki. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:08:46] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.29, 3.57, 2.12 [11:10:48] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:12:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.75, 2.98, 2.25 [11:15:39] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [11:25:06] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:25:55] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.36, 8.25, 6.27 [11:27:23] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 15 packages available for upgrade (0 critical updates). [11:27:53] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 5.88, 7.28, 6.16 [11:29:52] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.90, 6.31, 5.93 [11:51:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.13, 6.50, 5.52 [11:54:17] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [11:55:38] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.07, 6.40, 5.74 [12:03:18] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1141731441 secs [12:05:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.62, 9.87, 8.76 [12:07:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.33, 9.93, 8.94 [12:08:39] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.49, 3.76, 2.30 [12:10:48] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:11:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.51, 10.76, 9.48 [12:13:14] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [12:13:44] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8367 MB (6% inode=99%); [12:14:05] PROBLEM - graylog131 NTP time on graylog131 is WARNING: NTP WARNING: Offset 0.4751876295 secs [12:15:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.50, 9.77, 9.40 [12:16:38] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.52, 3.43, 2.87 [12:18:39] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.54, 2.79, 2.71 [12:23:28] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:24:16] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [12:26:25] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 24.11, 12.87, 8.12 [12:26:26] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.06, 5.99, 4.45 [12:27:04] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.22, 9.85, 9.06 [12:28:19] PROBLEM - graylog131 NTP time on graylog131 is CRITICAL: NTP CRITICAL: Offset 0.9468194246 secs [12:28:26] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.58, 5.59, 4.50 [12:28:59] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 15 packages available for upgrade (0 critical updates). [12:29:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.53, 9.81, 9.12 [12:32:24] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 4.43, 7.81, 7.50 [12:33:04] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.43, 9.51, 9.14 [12:35:50] RECOVERY - wiki.seamly.net - reverse DNS on sslhost is OK: SSL OK - wiki.seamly.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [12:36:27] RECOVERY - graylog131 NTP time on graylog131 is OK: NTP OK: Offset 0.0002625584602 secs [12:37:11] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08358925581 secs [12:38:22] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.39, 5.55, 6.58 [12:41:20] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:43:16] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [12:43:57] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.01, 10.10, 9.41 [12:45:55] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.64, 9.17, 9.15 [12:47:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/0eb4d68814ad...90fb6453e42f [12:47:03] [02miraheze/puppet] 07paladox 0390fb645 - swift: set fallocate_reserve to 3% for object-server [12:51:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.85, 10.56, 9.67 [12:56:09] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [12:57:37] PROBLEM - swiftobject121 SSH on swiftobject121 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [12:57:42] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.95, 11.39, 10.35 [12:58:26] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 131.45, 66.09, 29.48 [12:59:40] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.80, 12.01, 10.72 [12:59:42] RECOVERY - swiftobject121 SSH on swiftobject121 is OK: SSH OK - OpenSSH_8.4p1 Debian-5+deb11u1 (protocol 2.0) [13:00:22] !log swiftobject121: restart swift-object-server [13:00:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:01:13] RECOVERY - swiftobject121 APT on swiftobject121 is OK: APT OK: 15 packages available for upgrade (0 critical updates). [13:01:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.12, 10.85, 10.45 [13:03:47] RECOVERY - housing.wiki - reverse DNS on sslhost is OK: SSL OK - housing.wiki reverse DNS resolves to cp32.miraheze.org - CNAME FLAT [13:07:33] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.95, 9.79, 10.15 [13:21:44] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7969 MB (5% inode=99%); [13:28:11] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 3.60, 3.54, 7.98 [13:32:07] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.85, 11.64, 10.38 [13:34:05] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.66, 11.51, 10.50 [13:34:11] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 4.11, 3.80, 6.64 [13:36:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.92, 3.25, 2.26 [13:38:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.66, 12.50, 11.03 [13:38:14] !log bash /home/reception/delbackups.sh /home/reception/delwikis.txt /srv/mediawiki/w/maintenance/dumpBackup.php (delbackups) [13:38:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:38:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.42, 2.89, 2.25 [13:45:54] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.24, 11.31, 11.36 [13:53:22] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [13:53:46] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.26, 11.46, 11.09 [13:54:28] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.86, 10.55, 9.71 [13:55:44] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.00, 10.86, 10.92 [13:57:35] [02mediawiki] 07redbluegreenhat closed pull request 03#14365: T10700: Add Extension WebAuthn - 13https://github.com/miraheze/mediawiki/pull/14365 [13:57:38] [02miraheze/mediawiki] 07redbluegreenhat pushed 031 commit to 03REL1_39 [+1/-0/±1] 13https://github.com/miraheze/mediawiki/compare/a8ad911bfb22...39477449d256 [13:57:41] [02miraheze/mediawiki] 07brandon-wm 033947744 - T10700: Add Extension WebAuthn (#14365) [13:57:43] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.09, 12.18, 11.37 [13:57:59] [02mw-config] 07redbluegreenhat closed pull request 03#5183: T10700: Add WebAuthn - 13https://github.com/miraheze/mw-config/pull/5183 [13:58:01] [02miraheze/mw-config] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/mw-config/compare/14e913b9280f...c9361110c8a5 [13:58:02] [02miraheze/mw-config] 07brandon-wm 03c936111 - T10700: Add WebAuthn (#5183) [13:58:58] miraheze/mw-config - redbluegreenhat the build passed. [14:00:18] !log [alex@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [14:00:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:02:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.04, 11.80, 10.60 [14:04:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.99, 11.80, 10.74 [14:05:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.01, 11.63, 11.63 [14:06:02] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.87, 12.72, 11.22 [14:06:38] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.13, 3.17, 2.46 [14:06:56] !log [alex@mwtask141] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 397s [14:07:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:07:14] !log [alex@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [14:07:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:07:33] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.76, 12.41, 11.91 [14:07:49] !log [alex@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 34s [14:07:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:08:38] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.32, 2.71, 2.37 [14:19:32] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.27, 11.62, 11.70 [14:22:15] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:23:24] !log [alex@mwtask141] starting deploy of {'l10n': True} to all [14:23:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:25:06] PROBLEM - mem141 NTP time on mem141 is WARNING: NTP WARNING: Offset 0.1555639207 secs [14:27:16] !log [@test131] starting deploy of {'config': True} to all [14:27:17] !log [@test131] DEPLOY ABORTED: Canary check failed for beta.betaheze.org@localhost [14:27:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:27:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:28:02] from what I know, that doesn't sound good [14:28:13] looks like test131 is broken [14:28:53] test131 is often broken heh, that's what it's for! [14:30:36] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[MediaWiki Config Sync] [14:30:41] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 1731 bytes in 0.035 second response time [14:30:52] damn [14:30:59] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tayclayvisionwiki --no-updates --username-prefix=wikia:tayclayvision-song-contest /home/reception/ImportDump/tayclayvisionwiki-20230419092600.xml (START) [14:31:00] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419141812.xml (START) [14:31:01] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419142826.xml (START) [14:31:02] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419142025.xml (START) [14:31:03] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419142612.xml (START) [14:31:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:31:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:31:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:31:14] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=reindevwiki --no-updates --username-prefix=wikia:minecraftreindev /home/reception/ImportDump/reindevwiki-20230418190255.xml (START) [14:31:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:31:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:31:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:31:32] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.70, 13.21, 12.21 [14:32:44] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419141812.xml (END - exit=0) [14:32:45] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tttewikiwiki (START) [14:32:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:32:52] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tayclayvisionwiki --no-updates --username-prefix=wikia:tayclayvision-song-contest /home/reception/ImportDump/tayclayvisionwiki-20230419092600.xml (END - exit=0) [14:32:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:32:53] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tayclayvisionwiki (START) [14:32:56] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419142826.xml (END - exit=0) [14:32:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:32:57] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tttewikiwiki (START) [14:33:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:33:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:33:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:33:55] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tttewikiwiki (END - exit=256) [14:33:58] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=tttewikiwiki --active --update (END - exit=0) [14:34:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:34:07] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tayclayvisionwiki (END - exit=0) [14:34:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:34:08] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=tayclayvisionwiki --active --update (END - exit=0) [14:34:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:34:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:36:06] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419142612.xml (END - exit=0) [14:36:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:36:23] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tttewikiwiki (START) [14:36:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:37:25] RECOVERY - mem141 NTP time on mem141 is OK: NTP OK: Offset -0.02611547709 secs [14:37:31] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.67, 7.40, 4.29 [14:38:43] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.41, 3.52, 2.41 [14:39:30] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.47, 6.77, 4.46 [14:40:16] [02puppet] 07redbluegreenhat opened pull request 03#3202: T10700: Add WebAuthn's composer - 13https://github.com/miraheze/puppet/pull/3202 [14:40:40] paladox: ^ [14:41:02] [02puppet] 07paladox closed pull request 03#3202: T10700: Add WebAuthn's composer - 13https://github.com/miraheze/puppet/pull/3202 [14:41:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/90fb6453e42f...1d6953b0c130 [14:41:06] [02miraheze/puppet] 07redbluegreenhat 031d6953b - T10700: Add WebAuthn's composer (#3202) [14:41:40] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=reindevwiki --no-updates --username-prefix=wikia:minecraftreindev /home/reception/ImportDump/reindevwiki-20230418190255.xml (END - exit=0) [14:41:41] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=reindevwiki (START) [14:41:54] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=tttewikiwiki --no-updates --username-prefix=wikia:ttte /home/reception/ImportDump/tttewikiwiki-20230419142025.xml (END - exit=0) [14:41:55] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=tttewikiwiki (START) [14:41:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:42:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:42:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:42:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:44:39] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=reindevwiki (END - exit=0) [14:44:40] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=reindevwiki --active --update (END - exit=0) [14:44:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:44:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:46:06] !log MariaDB [mhglobal]> DELETE FROM cw_wikis WHERE wiki_dbname = 'contestofnoveltracksexcludingserverteapartywiki'; [14:46:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:48:43] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.20, 3.76, 3.21 [14:50:43] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.11, 3.88, 3.32 [14:51:10] hang in there mwtask! just a little more and the l10n deploy will be done [14:51:32] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/bc037a3c2472...a7f5b3c0e156 [14:51:35] [02miraheze/dns] 07Reception123 03a7f5b3c - add cheeseepedia.org zone [14:52:43] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.41, 3.78, 3.35 [14:52:46] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/d59b6c599d67...9d9f5fe00cc6 [14:52:49] [02miraheze/ssl] 07MirahezeSSLBot 039d9f5fe - Bot: Add SSL cert for cheeseepedia.org [14:56:43] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.10, 4.34, 3.67 [14:57:26] !log RENAMED terrapediaenwiki to terrapediawiki (T10739) [14:57:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:00:00] !log RENAMED cryptominingwiki to bitcoinminingwiki (T10726) [15:00:10]