[00:00:43] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_41 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/1df1ceef3f7b...aa5900d8a6db [00:00:45] [02miraheze/mediawiki] 07paladox 03aa5900d - Update LinkTitles to 71713f6f2356a90a4672c609d90bc6ad030f86c2 [00:00:47] RECOVERY - wiki.hspdev.0t0.jp - reverse DNS on sslhost is OK: SSL OK - wiki.hspdev.0t0.jp reverse DNS resolves to cp25.miraheze.org - CNAME OK [00:01:06] !log [paladox@test131] starting deploy of {'world': True} to all [00:01:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:01:49] !log [paladox@test131] finished deploy of {'world': True} to all - SUCCESS in 42s [00:01:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.73, 7.82, 7.56 [00:01:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:03:01] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 6.97, 3.92, 2.29 [00:03:16] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 13.08, 6.44, 3.01 [00:04:16] PROBLEM - wiki.solarconquest.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.solarconquest.net' expires in 15 day(s) (Fri 12 Jan 2024 23:53:46 GMT +0000). [00:04:32] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a4caa65263f1...8b610ea05d61 [00:04:34] [02miraheze/ssl] 07MirahezeSSLBot 038b610ea - Bot: Update SSL cert for wiki.solarconquest.net [00:07:01] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.60, 3.39, 2.46 [00:07:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.57, 8.07, 7.63 [00:08:20] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.78, 7.07, 6.74 [00:09:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.68, 7.78, 7.57 [00:10:17] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.02, 6.51, 6.58 [00:11:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.93, 8.56, 7.87 [00:14:12] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.40, 7.52, 6.99 [00:16:08] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.18, 7.16, 6.91 [00:17:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.08, 7.89, 7.83 [00:18:05] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.25, 6.41, 6.66 [00:19:16] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 6.25, 7.90, 7.85 [00:19:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.23, 8.01, 7.88 [00:21:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.91, 6.94, 7.51 [00:22:51] PROBLEM - os131 Current Load on os131 is WARNING: LOAD WARNING - total load average: 3.85, 3.16, 2.33 [00:23:21] PROBLEM - graylog131 Current Load on graylog131 is WARNING: LOAD WARNING - total load average: 3.86, 3.46, 2.62 [00:23:35] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [00:24:47] RECOVERY - os131 Current Load on os131 is OK: LOAD OK - total load average: 2.30, 2.87, 2.33 [00:25:16] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 3.00, 4.66, 6.43 [00:25:21] RECOVERY - graylog131 Current Load on graylog131 is OK: LOAD OK - total load average: 1.91, 2.84, 2.50 [00:27:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.57, 5.97, 6.80 [00:33:33] RECOVERY - wiki.solarconquest.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.solarconquest.net' will expire on Tue 26 Mar 2024 23:04:24 GMT +0000. [00:35:30] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.49, 3.69, 3.18 [00:37:16] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.57, 3.18, 2.75 [00:39:16] PROBLEM - os141 Current Load on os141 is CRITICAL: LOAD CRITICAL - total load average: 4.23, 3.44, 2.89 [00:39:19] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.77, 3.77, 3.35 [00:41:17] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 3.36, 3.33, 2.92 [00:47:01] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 3.27, 3.24, 3.27 [00:49:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.37, 7.64, 6.98 [00:51:35] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:53:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.60, 7.63, 7.18 [00:55:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.19, 7.97, 7.34 [00:57:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.62, 7.30, 7.16 [01:15:50] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.70, 6.34, 6.78 [01:18:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.74, 7.14, 6.40 [01:19:01] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.43, 3.40, 3.21 [01:19:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 12.66, 8.89, 7.67 [01:20:55] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.88, 6.54, 6.26 [01:21:01] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.41, 3.05, 3.10 [01:25:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.77, 7.77, 7.61 [01:27:39] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 25.18, 11.25, 7.06 [01:29:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.51, 8.21, 7.82 [01:31:35] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.87, 7.32, 6.36 [01:31:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.04, 7.86, 7.74 [01:33:33] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 11.36, 8.79, 6.99 [01:33:36] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.58, 6.90, 6.31 [01:35:30] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 6.50, 7.88, 6.87 [01:35:32] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.38, 6.54, 6.24 [01:37:28] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 6.50, 8.32, 7.21 [01:39:26] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.54, 7.12, 6.91 [01:42:42] PROBLEM - mwtask141 Puppet on mwtask141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[libboost-regex1.74.0-icu72] [01:43:22] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.66, 6.39, 6.72 [01:45:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.30, 7.36, 7.28 [01:47:16] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 36.47, 13.36, 8.97 [01:51:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.60, 7.87, 7.63 [01:53:05] PROBLEM - matomo121 HTTPS on matomo121 is CRITICAL: HTTP CRITICAL: HTTP/2 502 - 176 bytes in 0.011 second response time [01:55:02] RECOVERY - matomo121 HTTPS on matomo121 is OK: HTTP OK: HTTP/2 200 - 552 bytes in 1.501 second response time [01:59:56] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8752 MB (6% inode=99%); [02:02:51] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.71, 7.14, 6.56 [02:04:47] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.31, 6.52, 6.41 [02:10:39] RECOVERY - mwtask141 Puppet on mwtask141 is OK: OK: Puppet is currently enabled, last run 45 seconds ago with 0 failures [02:11:01] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.76, 3.05, 2.45 [02:13:01] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 3.23, 3.09, 2.54 [02:15:16] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 2.65, 4.24, 7.49 [02:15:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.66, 6.08, 6.71 [02:17:01] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.94, 3.41, 2.78 [02:19:16] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 2.80, 3.76, 6.57 [02:19:59] PROBLEM - puppetdb121 Puppet on puppetdb121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[puppetdb] [02:21:01] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 3.03, 3.25, 2.86 [02:22:41] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.67, 7.09, 6.97 [02:26:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.11, 7.61, 7.21 [02:30:23] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.57, 7.62, 7.30 [02:38:04] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.59, 7.44, 7.20 [02:40:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.85, 7.23, 7.16 [02:41:11] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [02:42:46] PROBLEM - ns1 NTP time on ns1 is CRITICAL: NTP CRITICAL: Offset 0.5005150735 secs [02:53:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.90, 5.97, 6.62 [03:03:25] PROBLEM - db131 Backups SQL on db131 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864204 seconds old and 0 bytes [03:07:59] RECOVERY - puppetdb121 Puppet on puppetdb121 is OK: OK: Puppet is currently enabled, last run 35 seconds ago with 0 failures [03:09:11] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [03:18:24] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.20, 6.96, 6.82 [03:20:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.01, 8.23, 7.28 [03:22:14] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.85, 7.84, 7.24 [03:24:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.23, 7.72, 7.25 [03:26:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.68, 7.14, 7.08 [03:31:51] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.59, 6.27, 6.73 [03:47:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.92, 7.47, 7.06 [03:49:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.96, 8.18, 7.38 [03:53:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.74, 7.25, 7.21 [03:57:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.24, 6.23, 6.80 [04:03:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.51, 6.73, 6.89 [04:19:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.64, 7.92, 7.41 [04:23:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.47, 7.84, 7.52 [04:49:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.39, 7.28, 7.04 [04:51:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.97, 7.14, 7.02 [04:57:50] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.39, 6.50, 6.75 [05:04:42] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.07, 7.08, 6.92 [05:08:33] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.50, 6.91, 6.83 [05:10:29] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.68, 6.42, 6.67 [06:19:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.94, 6.61, 6.22 [06:21:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.64, 6.23, 6.12 [07:32:48] PROBLEM - mw142 Puppet on mw142 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[libboost-regex1.74.0-icu72] [07:33:59] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7444 MB (5% inode=99%); [07:35:56] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8094 MB (6% inode=99%); [07:42:26] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [07:46:26] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [08:00:50] RECOVERY - mw142 Puppet on mw142 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [08:05:25] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.85, 3.47, 2.95 [08:19:01] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.84, 3.95, 3.68 [08:23:01] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.41, 4.09, 3.79 [08:27:01] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.17, 3.74, 3.72 [08:38:26] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [08:42:28] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [08:43:01] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.61, 3.92, 3.77 [08:45:01] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.72, 3.84, 3.76 [08:49:01] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.27, 3.87, 3.77 [08:53:02] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.83, 3.75, 3.74 [09:01:01] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.40, 3.97, 3.82 [09:11:01] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.11, 3.85, 3.89 [09:15:01] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.19, 3.91, 3.90 [09:17:01] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.10, 3.76, 3.86 [09:17:56] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7963 MB (5% inode=99%); [09:19:56] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 7997 MB (6% inode=99%); [09:24:46] PROBLEM - cloud14 Puppet on cloud14 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [09:31:01] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 1.67, 2.60, 3.21 [09:41:56] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7969 MB (5% inode=99%); [09:52:50] RECOVERY - cloud14 Puppet on cloud14 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [10:07:02] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [10:19:59] PROBLEM - puppetdb121 Puppet on puppetdb121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[puppetdb] [10:36:05] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp24.miraheze.org - CNAME OK [10:44:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.35, 6.52, 5.87 [10:46:04] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.36, 5.99, 5.75 [11:07:59] RECOVERY - puppetdb121 Puppet on puppetdb121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:24:43] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.18, 8.31, 7.07 [11:26:39] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.94, 7.41, 6.89 [11:36:16] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.50, 7.94, 7.27 [11:38:12] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.12, 7.43, 7.16 [11:43:06] [02mw-config] 07AgentIsai closed pull request 03#5346: Setup dlfmwiki for system messages' translation. - 13https://github.com/miraheze/mw-config/pull/5346 [11:43:07] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3cece00a8c80...43439c24b7da [11:43:10] [02miraheze/mw-config] 07JerryHan3 0343439c2 - Setup dlfmwiki for system messages' translation. (#5346) [11:44:06] miraheze/mw-config - AgentIsai the build passed. [11:45:53] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.27, 6.15, 6.67 [11:48:30] [02mw-config] 07AgentIsai closed pull request 03#5269: T10924: Add some ApprovedRevs settings - 13https://github.com/miraheze/mw-config/pull/5269 [11:48:33] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/43439c24b7da...6477d3b82975 [11:48:36] [02miraheze/mw-config] 07redbluegreenhat 036477d3b - T10924: Add some ApprovedRevs settings (#5269) [11:49:30] miraheze/mw-config - AgentIsai the build passed. [11:51:15] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/6477d3b82975...a9b03707717a [11:51:16] [02miraheze/mw-config] 07AgentIsai 03a9b0370 - T10924: Add ApprovedRevs config to LocalSettings [11:52:05] miraheze/mw-config - AgentIsai the build has errored. [11:52:37] [02miraheze/mw-config] 07AgentIsai pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a9b03707717a...7185030f69d7 [11:52:40] [02miraheze/mw-config] 07AgentIsai 037185030 - Remove ghost array [11:53:37] miraheze/mw-config - AgentIsai the build passed. [11:56:56] !log [@test131] starting deploy of {'config': True} to all [11:56:57] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [11:57:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:57:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:59:41] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/cleanupEmptyCategories.php --wiki=nenawikiwiki (END - exit=0) [11:59:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:01:15] !log [agent@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/extensions/ManageWiki/maintenance/populateGroupPermissionsWithDefaults.php --wiki=husmusenwiki (END - exit=0) [12:01:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:07:36] PROBLEM - mw141 Current Load on mw141 is WARNING: LOAD WARNING - total load average: 10.63, 8.18, 5.00 [12:09:19] PROBLEM - os141 Current Load on os141 is WARNING: LOAD WARNING - total load average: 3.58, 2.87, 1.54 [12:09:36] RECOVERY - mw141 Current Load on mw141 is OK: LOAD OK - total load average: 4.49, 6.71, 4.85 [12:10:36] !log [@mwtask141] starting deploy of {'config': True} to all [12:10:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:11:02] !log [@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 27s [12:11:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:11:16] RECOVERY - os141 Current Load on os141 is OK: LOAD OK - total load average: 2.98, 3.05, 1.77 [12:34:34] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [13:04:34] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query pt.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:13:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/2360eb6d3084...045a194fd220 [13:13:05] [02miraheze/puppet] 07paladox 03045a194 - Revert "matomo: Install Provider plugin" [13:17:20] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.06, 3.48, 3.18 [13:19:14] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 3.15, 3.27, 3.13 [13:28:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-15 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/a4ccb55223f2 [13:28:03] [02miraheze/puppet] 07paladox 03a4ccb55 - matomo: update ldap config [13:28:06] [02puppet] 07paladox created branch 03paladox-patch-15 - 13https://github.com/miraheze/puppet [13:28:07] [02puppet] 07paladox opened pull request 03#3574: matomo: update ldap config - 13https://github.com/miraheze/puppet/pull/3574 [13:28:11] [02puppet] 07paladox closed pull request 03#3574: matomo: update ldap config - 13https://github.com/miraheze/puppet/pull/3574 [13:28:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/045a194fd220...d65b233d51c8 [13:28:15] [02miraheze/puppet] 07paladox 03d65b233 - matomo: update ldap config (#3574) [13:28:17] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-15 [13:28:19] [02puppet] 07paladox deleted branch 03paladox-patch-15 - 13https://github.com/miraheze/puppet [13:44:12] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.84, 7.22, 6.76 [13:46:07] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.89, 6.51, 6.56 [14:16:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.74, 6.81, 6.43 [14:17:58] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.50, 6.64, 6.40 [14:19:59] PROBLEM - puppetdb121 Puppet on puppetdb121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[puppetdb] [14:44:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.70, 7.08, 6.58 [14:46:00] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.36, 6.72, 6.50 [15:07:59] RECOVERY - puppetdb121 Puppet on puppetdb121 is OK: OK: Puppet is currently enabled, last run 50 seconds ago with 0 failures [15:19:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.62, 7.17, 6.60 [15:21:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.33, 7.07, 6.63 [15:23:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.18, 7.69, 6.87 [15:25:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.57, 7.64, 6.96 [15:29:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.86, 8.92, 7.59 [15:30:17] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.26, 8.01, 6.56 [15:31:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.20, 7.72, 7.31 [15:31:55] PROBLEM - wiki.hsdfz.org.cn - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.hsdfz.org.cn All nameservers failed to answer the query. [15:32:14] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 5.85, 7.31, 6.49 [15:34:10] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.99, 6.64, 6.35 [15:45:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.29, 6.19, 6.69 [15:51:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.40, 7.06, 6.86 [15:53:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.81, 7.57, 7.07 [15:55:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.27, 7.08, 6.95 [16:01:55] PROBLEM - wiki.hsdfz.org.cn - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.hsdfz.org.cn could not be found [16:05:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.50, 6.55, 6.79 [16:07:04] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [16:13:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.41, 7.74, 7.16 [16:15:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.97, 7.53, 7.16 [16:19:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.38, 7.80, 7.28 [16:21:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.47, 7.67, 7.30 [16:31:51] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.44, 7.23, 6.16 [16:33:48] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.07, 6.87, 6.17 [16:33:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.88, 7.93, 7.42 [16:35:39] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.92, 3.52, 2.92 [16:35:44] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.67, 6.40, 6.07 [16:35:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.56, 7.58, 7.37 [16:37:34] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.91, 3.36, 2.94 [16:41:24] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.12, 3.41, 3.07 [16:43:19] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.21, 3.01, 2.96 [16:46:11] PROBLEM - franchise.franchising.org.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query franchise.franchising.org.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:51:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.96, 6.32, 6.73 [17:05:09] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [17:07:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.94, 6.70, 6.52 [17:09:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.89, 7.41, 6.80 [17:13:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.56, 7.73, 7.14 [17:15:24] RECOVERY - franchise.franchising.org.ua - reverse DNS on sslhost is OK: SSL OK - franchise.franchising.org.ua reverse DNS resolves to cp25.miraheze.org - CNAME OK [17:19:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.30, 7.82, 7.27 [17:21:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.01, 6.84, 6.99 [17:23:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.32, 5.95, 6.64 [17:35:02] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp24.miraheze.org - CNAME OK [17:44:14] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.26, 7.05, 6.79 [17:46:10] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.41, 6.80, 6.73 [17:51:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.32, 6.94, 6.76 [17:55:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.36, 6.53, 6.63 [18:07:04] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [18:11:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.29, 8.63, 7.35 [18:19:59] PROBLEM - puppetdb121 Puppet on puppetdb121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[puppetdb] [18:27:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.12, 7.51, 7.74 [18:33:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.04, 7.01, 7.31 [18:35:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.10, 6.98, 7.29 [18:36:07] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp25.miraheze.org - CNAME OK [18:47:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.71, 7.70, 7.36 [18:51:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.56, 7.60, 7.39 [18:52:04] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.97, 6.21, 5.82 [18:55:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.27, 7.48, 7.35 [18:57:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.34, 6.69, 7.08 [18:58:03] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.43, 5.67, 5.76 [19:06:31] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/importDump.php --wiki=craftycraftmoddingwiki --no-updates --username-prefix=wikia:crafty-craft /home/macfan/ImportDump/craftycraftmoddingwiki-20231218225211.xml (START) [19:06:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:07:59] RECOVERY - puppetdb121 Puppet on puppetdb121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:09:19] [02miraheze/mw-config] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7185030f69d7...54a0055b2d17 [19:09:21] [02miraheze/mw-config] 07MacFan4000 0354a0055 - shemwiki: switch importSources order [19:09:24] !log [macfan@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:09:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:09:38] !log [macfan@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 13s [19:09:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:09:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.96, 8.33, 7.51 [19:10:13] miraheze/mw-config - MacFan4000 the build passed. [19:11:10] !log [macfan@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:11:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:11:27] !log [macfan@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 17s [19:11:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:12:20] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/importDump.php --wiki=craftycraftmoddingwiki --no-updates --username-prefix=wikia:crafty-craft /home/macfan/ImportDump/craftycraftmoddingwiki-20231218225211.xml (END - exit=0) [19:12:21] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=craftycraftmoddingwiki (START) [19:12:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:12:28] [02miraheze/mw-config] 07MacFan4000 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/54a0055b2d17...256c2350540b [19:12:30] [02miraheze/mw-config] 07MacFan4000 03256c235 - Update LocalSettings.php [19:12:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:12:47] !log [macfan@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:12:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:12:57] !log [macfan@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s [19:13:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:13:27] miraheze/mw-config - MacFan4000 the build passed. [19:15:15] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=craftycraftmoddingwiki (END - exit=0) [19:15:16] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=craftycraftmoddingwiki --active --update (END - exit=0) [19:15:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:15:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:15:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.31, 7.33, 7.35 [19:23:55] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/importDump.php --wiki=velsorwiki --no-updates --username-prefix=wikia:velsor /home/macfan/ImportDump/velsorwiki-20231219070747.xml (START) [19:24:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:24:51] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/importDump.php --wiki=velsorwiki --no-updates --username-prefix=wikia:velsor /home/macfan/ImportDump/velsorwiki-20231219070747.xml (END - exit=0) [19:24:52] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=velsorwiki (START) [19:24:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:09] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=velsorwiki (END - exit=0) [19:25:10] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=velsorwiki --active --update (END - exit=0) [19:25:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:16] !log [@test131] starting deploy of {'config': True} to all [19:26:17] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [19:26:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:27:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.33, 6.98, 6.93 [19:29:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.64, 6.64, 6.82 [19:35:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.99, 6.17, 6.63 [19:42:41] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.50, 7.77, 7.20 [19:42:58] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.81, 6.42, 6.00 [19:44:54] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.15, 6.15, 5.97 [19:46:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.90, 7.75, 7.36 [19:48:49] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/importDump.php --wiki=animatedinanimatebattlewiki --no-updates --username-prefix=wikia:animatedinanimatebattle /home/macfan/ImportDump/animatedinanimatebattlewiki-20231220033042.xml (START) [19:48:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:54:14] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.96, 7.39, 7.25 [19:55:23] PROBLEM - mon141 Puppet on mon141 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_IRC-Discord-Relay] [19:56:09] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.31, 7.28, 7.22 [19:58:05] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.47, 8.03, 7.50 [20:00:00] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.39, 7.25, 7.27 [20:00:40] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 2 minutes ago with 2 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki config],Exec[git_pull_landing] [20:05:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.12, 7.32, 7.28 [20:07:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.74, 7.07, 7.19 [20:10:07] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/importDump.php --wiki=animatedinanimatebattlewiki --no-updates --username-prefix=wikia:animatedinanimatebattle /home/macfan/ImportDump/animatedinanimatebattlewiki-20231220033042.xml (END - exit=0) [20:10:08] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=animatedinanimatebattlewiki (START) [20:10:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:10:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:16:05] PROBLEM - phab121 Current Load on phab121 is CRITICAL: LOAD CRITICAL - total load average: 7.76, 4.71, 2.14 [20:19:49] PROBLEM - jobchron121 Puppet on jobchron121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_JobRunner] [20:19:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 11.19, 8.77, 7.89 [20:20:24] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=animatedinanimatebattlewiki (END - exit=0) [20:20:25] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=animatedinanimatebattlewiki --active --update (END - exit=0) [20:20:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:20:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:23:22] RECOVERY - mon141 Puppet on mon141 is OK: OK: Puppet is currently enabled, last run 19 seconds ago with 0 failures [20:23:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.03, 7.37, 7.52 [20:26:38] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 21 seconds ago with 0 failures [20:29:51] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.49, 7.10, 7.18 [20:32:02] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 8.07, 6.75, 6.25 [20:33:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.24, 7.56, 7.41 [20:34:03] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.55, 6.56, 6.23 [20:35:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.12, 7.44, 7.37 [20:45:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.05, 7.69, 7.72 [20:47:54] RECOVERY - jobchron121 Puppet on jobchron121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [20:49:39] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/importDump.php --wiki=cctgwiki --no-updates --username-prefix=wikia:cctg /home/macfan/ImportDump/cctgwiki-20231221021640.xml (START) [20:49:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:52:05] PROBLEM - phab121 Current Load on phab121 is WARNING: LOAD WARNING - total load average: 0.57, 0.69, 1.91 [20:56:05] RECOVERY - phab121 Current Load on phab121 is OK: LOAD OK - total load average: 1.01, 0.79, 1.66 [20:59:01] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/importDump.php --wiki=cctgwiki --no-updates --username-prefix=wikia:cctg /home/macfan/ImportDump/cctgwiki-20231221021640.xml (END - exit=0) [20:59:02] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=cctgwiki (START) [20:59:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:59:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:02:05] PROBLEM - phab121 Current Load on phab121 is CRITICAL: LOAD CRITICAL - total load average: 4.44, 2.76, 2.18 [21:03:47] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=cctgwiki (END - exit=0) [21:03:50] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/run.php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=cctgwiki --active --update (END - exit=0) [21:03:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:03:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [21:14:05] PROBLEM - phab121 Current Load on phab121 is WARNING: LOAD WARNING - total load average: 0.39, 1.42, 1.99 [21:17:49] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.09, 6.44, 6.80 [21:18:06] RECOVERY - phab121 Current Load on phab121 is OK: LOAD OK - total load average: 0.84, 0.95, 1.65 [21:25:02] PROBLEM - thestories.kr - LetsEncrypt on sslhost is CRITICAL: connect to address thestories.kr and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [21:31:25] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.55, 7.18, 6.87 [21:41:01] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 9.39, 8.00, 7.31 [21:48:03] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.16, 7.52, 6.54 [21:50:03] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.42, 7.42, 6.62 [21:53:58] RECOVERY - thestories.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'thestories.kr' will expire on Sun 03 Mar 2024 22:18:10 GMT +0000. [21:54:02] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.78, 6.58, 6.46 [22:00:14] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.74, 7.39, 8.00 [22:02:10] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.12, 7.60, 8.00 [22:08:03] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.81, 6.95, 6.56 [22:13:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.45, 7.53, 7.99 [22:14:03] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.70, 6.61, 6.61 [22:28:59] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.00, 6.85, 6.51 [22:32:09] [02miraheze/ImportDump] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+1/-0/±0] 13https://github.com/miraheze/ImportDump/commit/9ce69e6582b1 [22:32:12] [02miraheze/ImportDump] 07MacFan4000 039ce69e6 - Create ImportDumpLogFormatter.php [22:32:14] [02ImportDump] 07MacFan4000 created branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ImportDump [22:33:18] [02miraheze/ImportDump] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/9ce69e6582b1...bed2266b6069 [22:33:19] [02miraheze/ImportDump] 07MacFan4000 03bed2266 - Update ImportDumpRequestManager.php [22:34:31] [02miraheze/ImportDump] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/bed2266b6069...722a9640756e [22:34:32] [02miraheze/ImportDump] 07MacFan4000 03722a964 - Update SpecialRequestImportDump.php [22:35:27] [02miraheze/ImportDump] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/722a9640756e...194a115be10e [22:35:28] [02miraheze/ImportDump] 07MacFan4000 03194a115 - Update extension.json [22:35:51] [02ImportDump] 07MacFan4000 opened pull request 03#58: Fix raw HTML in IRC feed - 13https://github.com/miraheze/ImportDump/pull/58 [22:36:45] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.09, 6.37, 6.51 [22:37:20] [02miraheze/ImportDump] 07github-actions[bot] pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±3] 13https://github.com/miraheze/ImportDump/compare/194a115be10e...61056e1866d0 [22:37:22] [02miraheze/ImportDump] 07github-actions 0361056e1 - CI: lint code to MediaWiki standards [22:37:25] [02ImportDump] 07github-actions[bot] synchronize pull request 03#58: Fix raw HTML in IRC feed - 13https://github.com/miraheze/ImportDump/pull/58 [22:38:41] miraheze/ImportDump - MacFan4000 the build has errored. [22:40:34] [02ImportDump] 07MacFan4000 synchronize pull request 03#58: Fix raw HTML in IRC feed - 13https://github.com/miraheze/ImportDump/pull/58 [22:40:35] [02miraheze/ImportDump] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/61056e1866d0...d561be61c014 [22:40:36] [02miraheze/ImportDump] 07MacFan4000 03d561be6 - Update ImportDumpLogFormatter.php [22:43:39] miraheze/ImportDump - MacFan4000 the build has errored. [22:43:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.49, 7.35, 7.17 [22:45:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.57, 6.97, 7.06 [22:46:42] [02ImportDump] 07MacFan4000 synchronize pull request 03#58: Fix raw HTML in IRC feed - 13https://github.com/miraheze/ImportDump/pull/58 [22:46:43] [02miraheze/ImportDump] 07MacFan4000 pushed 031 commit to 03MacFan4000-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/compare/d561be61c014...576507710a9f [22:46:45] [02miraheze/ImportDump] 07MacFan4000 035765077 - Update ImportDumpLogFormatter.php [22:47:49] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.15, 7.40, 7.20 [22:50:09] miraheze/ImportDump - MacFan4000 the build has errored. [22:51:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.30, 7.67, 7.37 [22:57:12]