[00:08:42] RECOVERY - cp33 Disk Space on cp33 is OK: DISK OK - free space: / 14095 MB (18% inode=98%); [00:16:51] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.55, 3.66, 2.77 [00:17:06] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/20f13351edb0...f261d6276c98 [00:17:08] [02miraheze/puppet] 07paladox 03f261d62 - db112: stop backing up grafana [00:18:49] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.84, 3.38, 2.78 [00:30:32] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/c45ca09823b8 [00:30:35] [02miraheze/puppet] 07paladox 03c45ca09 - miraheze-backup: Set X-Delete-After for segment objects as well [00:30:40] [02puppet] 07paladox created branch 03paladox-patch-7 - 13https://github.com/miraheze/puppet [00:30:43] [02puppet] 07paladox opened pull request 03#3338: miraheze-backup: Set X-Delete-After for segment objects as well - 13https://github.com/miraheze/puppet/pull/3338 [00:31:26] [02puppet] 07paladox synchronize pull request 03#3338: miraheze-backup: Set X-Delete-After for segment objects as well - 13https://github.com/miraheze/puppet/pull/3338 [00:31:28] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/c45ca09823b8...1a2271c9d8df [00:31:29] [02miraheze/puppet] 07paladox 031a2271c - Update miraheze-backup.py.erb [00:32:48] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.09, 3.23, 2.67 [00:33:18] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2417633832 secs [00:34:46] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.57, 3.21, 2.73 [00:36:45] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.41, 3.56, 2.90 [00:40:42] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.55, 3.65, 3.10 [00:46:39] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.09, 3.24, 3.10 [00:47:18] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.01305219531 secs [00:56:29] [02puppet] 07paladox synchronize pull request 03#3338: miraheze-backup: Set X-Delete-After for segment objects as well - 13https://github.com/miraheze/puppet/pull/3338 [00:56:30] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1a2271c9d8df...bcd639a68a29 [00:56:31] [02miraheze/puppet] 07paladox 03bcd639a - Update miraheze-backup.py.erb [01:18:14] [02puppet] 07paladox closed pull request 03#3338: miraheze-backup: Set X-Delete-After for segment objects as well - 13https://github.com/miraheze/puppet/pull/3338 [01:18:15] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/f261d6276c98...d6aec1e08adb [01:18:16] [02miraheze/puppet] 07paladox 03d6aec1e - miraheze-backup: Set X-Delete-After for segment objects as well (#3338) [01:18:18] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-7 [01:18:20] [02puppet] 07paladox deleted branch 03paladox-patch-7 - 13https://github.com/miraheze/puppet [01:28:51] PROBLEM - db112 Backups SQL grafana on db112 is CRITICAL: FILE_AGE CRITICAL: File not found - /var/log/sql-grafana-backup-fortnightly.log [02:03:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/94d607b4f2b3 [02:03:04] [02miraheze/puppet] 07paladox 0394d607b - miraheze-backup: use pigz for sql dump [02:03:06] [02puppet] 07paladox created branch 03paladox-patch-7 - 13https://github.com/miraheze/puppet [02:03:07] [02puppet] 07paladox opened pull request 03#3339: miraheze-backup: use pigz for sql dump - 13https://github.com/miraheze/puppet/pull/3339 [02:03:32] [02puppet] 07paladox synchronize pull request 03#3339: miraheze-backup: use pigz for sql dump - 13https://github.com/miraheze/puppet/pull/3339 [02:03:33] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/94d607b4f2b3...5adeeb1eafde [02:03:35] [02miraheze/puppet] 07paladox 035adeeb1 - Update miraheze-backup.py.erb [02:04:17] [02puppet] 07paladox edited pull request 03#3339: miraheze-backup: use pigz for sql dump - 13https://github.com/miraheze/puppet/pull/3339 [02:09:44] [02puppet] 07paladox synchronize pull request 03#3339: miraheze-backup: use pigz for sql dump - 13https://github.com/miraheze/puppet/pull/3339 [02:09:47] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/5adeeb1eafde...59c61940faca [02:09:50] [02miraheze/puppet] 07paladox 0359c6194 - Update miraheze-backup.py.erb [02:11:13] [02puppet] 07paladox edited pull request 03#3339: miraheze-backup: use pigz for sql dump - 13https://github.com/miraheze/puppet/pull/3339 [02:12:31] [02puppet] 07paladox closed pull request 03#3339: miraheze-backup: use pigz for sql dump - 13https://github.com/miraheze/puppet/pull/3339 [02:12:33] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/d6aec1e08adb...11037f4dc306 [02:12:34] [02miraheze/puppet] 07paladox 0311037f4 - miraheze-backup: use pigz for sql dump (#3339) [02:12:35] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-7 [02:12:36] [02puppet] 07paladox deleted branch 03paladox-patch-7 - 13https://github.com/miraheze/puppet [02:21:08] PROBLEM - www.hebammenwiki.de - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.hebammenwiki.de All nameservers failed to answer the query. [02:24:21] RECOVERY - db131 Backups SQL on db131 is OK: FILE_AGE OK: /var/log/sql-backup.log is 25 seconds old and 0 bytes [02:33:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1002070606 secs [02:35:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09984183311 secs [02:37:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/f51478cd0398 [02:37:30] [02miraheze/puppet] 07paladox 03f51478c - miraheze-backup: sort db directories if fetching all dbs [02:37:31] [02puppet] 07paladox created branch 03paladox-patch-7 - 13https://github.com/miraheze/puppet [02:37:34] [02puppet] 07paladox opened pull request 03#3340: miraheze-backup: sort db directories if fetching all dbs - 13https://github.com/miraheze/puppet/pull/3340 [02:37:57] [02puppet] 07paladox closed pull request 03#3340: miraheze-backup: sort db directories if fetching all dbs - 13https://github.com/miraheze/puppet/pull/3340 [02:37:58] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/11037f4dc306...b6bb8854e7ae [02:38:00] [02miraheze/puppet] 07paladox 03b6bb885 - miraheze-backup: sort db directories if fetching all dbs (#3340) [02:38:02] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-7 [02:38:03] [02puppet] 07paladox deleted branch 03paladox-patch-7 - 13https://github.com/miraheze/puppet [02:40:16] PROBLEM - polandball.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for polandball.wiki could not be found [02:41:06] RECOVERY - db121 Backups SQL on db121 is OK: FILE_AGE OK: /var/log/sql-backup.log is 50 seconds old and 0 bytes [02:44:24] RECOVERY - db142 Backups SQL on db142 is OK: FILE_AGE OK: /var/log/sql-backup.log is 90 seconds old and 0 bytes [02:50:43] RECOVERY - www.hebammenwiki.de - reverse DNS on sslhost is OK: SSL OK - www.hebammenwiki.de reverse DNS resolves to cp22.miraheze.org - CNAME OK [02:57:19] [02puppet] 07paladox closed pull request 03#3337: miraheze-backup: make sure fabric connection is closed - 13https://github.com/miraheze/puppet/pull/3337 [02:57:21] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-8 [02:57:24] [02puppet] 07paladox deleted branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [03:03:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/817530172c4a [03:03:43] [02miraheze/puppet] 07paladox 038175301 - DO NOT MERGE [03:03:44] [02puppet] 07paladox created branch 03paladox-patch-7 - 13https://github.com/miraheze/puppet [03:03:45] [02puppet] 07paladox opened pull request 03#3341: DO NOT MERGE - 13https://github.com/miraheze/puppet/pull/3341 [03:28:09] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/dfb780716a83...6e3064624e9b [03:28:11] [02miraheze/CreateWiki] 07paladox 036e30646 - Run recacheJson inside deferred update [03:29:06] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/9c08f9f82438...c799f0d2a2f0 [03:29:09] [02miraheze/mediawiki] 07paladox 03c799f0d - Update CreateWiki [03:29:53] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/3294e6a22785...c349aaa9b4e4 [03:29:55] [02miraheze/mediawiki] 07paladox 03c349aaa - Update CreateWiki [03:30:10] !log [paladox@test131] starting deploy of {'world': True, 'l10n': True} to all [03:30:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:30:26] !log [paladox@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [03:30:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:31:42] miraheze/CreateWiki - paladox the build has errored. [03:32:38] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/6e3064624e9b...0388b7eb9b31 [03:32:41] [02miraheze/CreateWiki] 07paladox 030388b7e - Fix [03:32:44] !log [paladox@mwtask141] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [03:32:45] !log [paladox@test131] DEPLOY ABORTED: Non-Zero Exit Code in prep, see output. [03:32:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:32:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:33:22] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/c799f0d2a2f0...443facc3f703 [03:33:22] !log [paladox@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [03:33:24] [02miraheze/mediawiki] 07paladox 03443facc - Update CreateWiki [03:33:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:35:49] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.76, 3.82, 3.23 [03:37:19] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/c349aaa9b4e4...403a76a8aff3 [03:37:20] !log [paladox@test131] starting deploy of {'world': True, 'l10n': True} to all [03:37:21] [02miraheze/mediawiki] 07paladox 03403a76a - Update CreateWiki [03:37:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:38:41] !log [paladox@mwtask141] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 319s [03:38:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:39:55] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [03:40:49] [02miraheze/ManageWiki] 07paladox pushed 032 commits to 03paladox-patch-2 [+0/-0/±3] 13https://github.com/miraheze/ManageWiki/compare/12119826f3eb...0e8e98911696 [03:40:51] [02miraheze/ManageWiki] 07paladox 030e8e989 - Merge branch 'master' into paladox-patch-2 [03:40:54] [02ManageWiki] 07paladox synchronize pull request 03#418: Move some of NamespaceMigrationJob logic to a common class - 13https://github.com/miraheze/ManageWiki/pull/418 [03:42:41] !log [paladox@test131] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 321s [03:42:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:43:27] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.05, 3.81, 3.53 [03:43:47] miraheze/ManageWiki - paladox the build has errored. [03:43:55] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [03:45:21] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.39, 4.16, 3.70 [03:46:04] miraheze/CreateWiki - paladox the build passed. [03:49:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.33, 3.91, 3.72 [03:51:32] PROBLEM - wiki.wisrail.de - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wisrail.de. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:54:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.52, 3.51, 3.92 [03:56:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.01, 3.76, 3.97 [03:58:23] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/7b676ab3f9cf [03:58:24] [02miraheze/ManageWiki] 07paladox 037b676ab - Don't execute ManageWikiNameSpaceMigration job on wiki creation [03:58:26] [02ManageWiki] 07paladox created branch 03paladox-patch-3 - 13https://github.com/miraheze/ManageWiki [03:58:27] [02ManageWiki] 07paladox opened pull request 03#420: Don't execute ManageWikiNameSpaceMigration job on wiki creation - 13https://github.com/miraheze/ManageWiki/pull/420 [03:58:51] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/7b676ab3f9cf...898bc1a86151 [03:58:52] [02miraheze/ManageWiki] 07paladox 03898bc1a - Update Hooks.php [03:58:55] [02ManageWiki] 07paladox synchronize pull request 03#420: Don't execute ManageWikiNameSpaceMigration job on wiki creation - 13https://github.com/miraheze/ManageWiki/pull/420 [03:59:16] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/898bc1a86151...fd87414a5e35 [03:59:17] [02miraheze/ManageWiki] 07paladox 03fd87414 - Update NamespaceMigrationJob.php [03:59:19] [02ManageWiki] 07paladox synchronize pull request 03#420: Don't execute ManageWikiNameSpaceMigration job on wiki creation - 13https://github.com/miraheze/ManageWiki/pull/420 [04:00:18] [02ManageWiki] 07paladox synchronize pull request 03#420: Don't execute ManageWikiNameSpaceMigration job on wiki creation - 13https://github.com/miraheze/ManageWiki/pull/420 [04:00:20] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/fd87414a5e35...b09afecf0538 [04:00:23] [02miraheze/ManageWiki] 07paladox 03b09afec - Update ManageWikiNamespaces.php [04:00:32] [02ManageWiki] 07paladox synchronize pull request 03#420: Don't execute ManageWikiNameSpaceMigration job on wiki creation - 13https://github.com/miraheze/ManageWiki/pull/420 [04:00:35] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/b09afecf0538...16bcc5360ecf [04:00:38] [02miraheze/ManageWiki] 07paladox 0316bcc53 - Update Hooks.php [04:00:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.79, 3.57, 3.87 [04:02:04] [02miraheze/ManageWiki] 07github-actions[bot] pushed 031 commit to 03paladox-patch-3 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/16bcc5360ecf...cd829adb32dd [04:02:07] [02miraheze/ManageWiki] 07github-actions 03cd829ad - CI: lint code to MediaWiki standards [04:02:09] [02ManageWiki] 07github-actions[bot] synchronize pull request 03#420: Don't execute ManageWikiNameSpaceMigration job on wiki creation - 13https://github.com/miraheze/ManageWiki/pull/420 [04:04:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.18, 3.84, 3.85 [04:04:54] [02ManageWiki] 07paladox closed pull request 03#420: Don't execute ManageWikiNameSpaceMigration job on wiki creation - 13https://github.com/miraheze/ManageWiki/pull/420 [04:04:57] [02miraheze/ManageWiki] 07paladox pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/ManageWiki/compare/07952dd08f8c...045c9eadb436 [04:05:00] [02miraheze/ManageWiki] 07paladox 03045c9ea - Don't execute ManageWikiNameSpaceMigration job on wiki creation (#420) [04:05:03] [02miraheze/ManageWiki] 07paladox deleted branch 03paladox-patch-3 [04:05:04] [02ManageWiki] 07paladox deleted branch 03paladox-patch-3 - 13https://github.com/miraheze/ManageWiki [04:05:35] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/443facc3f703...7d29185548ae [04:05:38] [02miraheze/mediawiki] 07paladox 037d29185 - Update ManageWiki [04:06:14] !log [paladox@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [04:06:19] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/403a76a8aff3...17e2791ffc7f [04:06:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:06:20] !log [paladox@test131] starting deploy of {'world': True, 'l10n': True} to all [04:06:20] [02miraheze/mediawiki] 07paladox 0317e2791 - Update ManageWiki [04:06:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:06:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.40, 3.70, 3.80 [04:10:19] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.96, 4.28, 3.86 [04:10:58] miraheze/ManageWiki - paladox the build passed. [04:11:08] !log [paladox@mwtask141] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 294s [04:11:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:11:18] miraheze/ManageWiki - paladox the build passed. [04:11:43] !log [paladox@test131] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 323s [04:11:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:12:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.83, 4.06, 3.83 [04:14:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.95, 3.97, 3.87 [04:14:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.64, 3.94, 3.82 [04:16:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.14, 5.24, 4.29 [04:18:19] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 0.90, 2.35, 3.23 [04:21:00] RECOVERY - wiki.wisrail.de - reverse DNS on sslhost is OK: SSL OK - wiki.wisrail.de reverse DNS resolves to cp22.miraheze.org - CNAME OK [04:40:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.58, 2.80, 3.92 [04:44:55] PROBLEM - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gesamtschule-nordkirchen.de All nameservers failed to answer the query. [04:46:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.40, 2.33, 3.39 [05:05:24] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.31, 5.33, 4.15 [05:14:19] RECOVERY - wiki.gesamtschule-nordkirchen.de - reverse DNS on sslhost is OK: SSL OK - wiki.gesamtschule-nordkirchen.de reverse DNS resolves to cp23.miraheze.org - CNAME OK [05:26:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.84, 3.35, 3.95 [05:30:45] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.24, 3.20, 3.72 [05:34:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.78, 3.69, 3.81 [05:42:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.19, 3.22, 3.47 [05:44:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.55, 3.47, 3.55 [05:48:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.54, 2.92, 3.29 [06:00:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.08, 4.13, 3.70 [06:06:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.93, 3.69, 3.68 [06:10:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.41, 2.69, 3.29 [06:28:20] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.32, 3.33, 1.76 [06:28:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.31, 3.21, 2.90 [06:30:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.22, 2.93, 2.84 [06:32:20] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 2.72, 3.91, 2.44 [06:33:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1667410731 secs [06:34:20] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 3.89, 4.57, 2.92 [06:36:20] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.02, 3.28, 2.65 [06:51:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.05877918005 secs [07:27:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset -0.1178539693 secs [07:43:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.0623921454 secs [08:14:49] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [08:44:08] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.nj.cn.eu.org could not be found [10:00:58] PROBLEM - pt.polandball.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pt.polandball.wiki' expires in 15 day(s) (Fri 18 Aug 2023 09:40:31 GMT +0000). [10:07:31] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/108175fb3e80...8c50f6c58edb [10:07:33] [02miraheze/ssl] 07MirahezeSSLBot 038c50f6c - Bot: Update SSL cert for pt.polandball.wiki [10:29:56] RECOVERY - pt.polandball.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'pt.polandball.wiki' will expire on Tue 31 Oct 2023 09:07:23 GMT +0000. [10:48:25] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [10:59:07] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.2275970578 secs [11:13:07] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.01806676388 secs [11:17:30] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [11:48:35] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:11:13] PROBLEM - wiki.qadrishattari.xyz - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query qadrishattari.xyz. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:12:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.73, 3.02, 2.29 [12:14:19] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.20, 3.16, 2.43 [12:17:41] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [12:24:57] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.18, 3.76, 3.06 [12:26:51] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.54, 3.62, 3.09 [12:28:46] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.58, 3.87, 3.24 [12:30:41] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.30, 3.64, 3.23 [12:36:24] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.11, 3.58, 3.30 [12:38:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.64, 3.46, 3.29 [12:38:26] PROBLEM - wiki.templeofludus.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.templeofludus.org All nameservers failed to answer the query. [12:39:50] PROBLEM - wiki.qadrishattari.xyz - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.qadrishattari.xyz All nameservers failed to answer the query. [12:40:19] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.86, 4.03, 3.52 [12:42:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.52, 3.98, 3.58 [12:50:19] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.37, 3.62, 3.49 [12:52:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.62, 3.67, 3.53 [12:57:25] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.29, 3.46, 2.49 [12:59:22] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.47, 2.74, 2.34 [13:04:19] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.58, 2.97, 3.33 [13:07:26] RECOVERY - wiki.templeofludus.org - reverse DNS on sslhost is OK: SSL OK - wiki.templeofludus.org reverse DNS resolves to cp23.miraheze.org - CNAME OK [13:28:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.66, 3.18, 2.52 [13:30:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.92, 3.19, 2.62 [13:39:07] RECOVERY - wiki.qadrishattari.xyz - reverse DNS on sslhost is OK: SSL OK - wiki.qadrishattari.xyz reverse DNS resolves to cp22.miraheze.org - CNAME OK [13:43:55] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [14:01:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1433781087 secs [14:07:54] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.79, 3.91, 3.26 [14:09:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.78, 3.18, 3.08 [14:13:46] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [14:15:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.07985001802 secs [14:24:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.05, 3.67, 3.24 [14:26:30] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.91, 3.11, 3.10 [14:45:08] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:45:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset -0.1102843285 secs [14:47:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.09669855237 secs [15:01:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1851183474 secs [15:14:14] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [15:23:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.05655181408 secs [15:38:24] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.54, 3.73, 3.19 [15:43:19] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [15:44:15] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.51, 3.50, 3.30 [15:46:12] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.08, 2.63, 3.00 [15:48:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.95, 3.56, 2.80 [15:54:06] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.28, 3.54, 3.49 [15:56:03] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.37, 3.90, 3.60 [15:56:19] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.24, 3.40, 3.04 [15:58:00] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.84, 3.61, 3.54 [15:59:37] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/f86ebd42f4e2 [15:59:40] [02miraheze/puppet] 07paladox 03f86ebd4 - miraheze-backup: add some logs for backing up db [15:59:43] [02puppet] 07paladox created branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [15:59:44] [02puppet] 07paladox opened pull request 03#3342: miraheze-backup: add some logs for backing up db - 13https://github.com/miraheze/puppet/pull/3342 [15:59:57] [02puppet] 07paladox closed pull request 03#3342: miraheze-backup: add some logs for backing up db - 13https://github.com/miraheze/puppet/pull/3342 [15:59:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.79, 3.05, 3.34 [15:59:57] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b6bb8854e7ae...69479b01e6fe [16:00:01] [02miraheze/puppet] 07paladox 0369479b0 - miraheze-backup: add some logs for backing up db (#3342) [16:00:01] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-8 [16:00:03] [02puppet] 07paladox deleted branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [16:00:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.54, 3.55, 3.19 [16:04:19] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.69, 3.95, 3.43 [16:06:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.69, 3.82, 3.44 [16:06:22] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.44, 3.55, 2.51 [16:09:24] PROBLEM - cp33 Disk Space on cp33 is WARNING: DISK WARNING - free space: / 8212 MB (10% inode=98%); [16:12:22] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.38, 3.75, 2.98 [16:13:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.14, 3.48, 3.42 [16:15:36] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.22, 4.18, 3.67 [16:17:06] PROBLEM - wiki.joust.ro - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.joust.ro All nameservers failed to answer the query. [16:20:19] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.55, 2.99, 3.31 [16:24:22] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.91, 3.27, 3.16 [16:26:05] [02puppet] 07paladox synchronize pull request 03#3341: DO NOT MERGE - 13https://github.com/miraheze/puppet/pull/3341 [16:26:06] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-7 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/817530172c4a...74aa12fddde8 [16:26:07] [02miraheze/puppet] 07paladox 0374aa12f - Update miraheze-backup.py.erb [16:30:22] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.03, 3.43, 3.23 [16:32:22] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.49, 3.09, 3.14 [16:33:10] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.48, 3.15, 3.79 [16:38:22] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.44, 3.37, 3.22 [16:39:00] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.25, 2.42, 3.31 [16:40:22] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 3.13, 3.32, 3.23 [16:40:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/a9181eccffb8 [16:40:56] [02miraheze/puppet] 07paladox 03a9181ec - miraheze-backup: make sure pigz doesn't use all cpu resources [16:40:59] [02puppet] 07paladox created branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [16:41:00] [02puppet] 07paladox opened pull request 03#3343: miraheze-backup: make sure pigz doesn't use all cpu resources - 13https://github.com/miraheze/puppet/pull/3343 [16:41:10] [02puppet] 07paladox closed pull request 03#3343: miraheze-backup: make sure pigz doesn't use all cpu resources - 13https://github.com/miraheze/puppet/pull/3343 [16:41:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/69479b01e6fe...cef71413b4b2 [16:41:14] [02miraheze/puppet] 07paladox 03cef7141 - miraheze-backup: make sure pigz doesn't use all cpu resources (#3343) [16:41:17] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-8 [16:41:18] [02puppet] 07paladox deleted branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [16:45:42] RECOVERY - wiki.joust.ro - reverse DNS on sslhost is OK: SSL OK - wiki.joust.ro reverse DNS resolves to cp22.miraheze.org - CNAME OK [16:46:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.44, 3.24, 2.87 [16:48:49] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.62, 3.42, 3.33 [16:50:19] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.86, 3.13, 2.92 [16:50:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.56, 3.14, 3.24 [16:58:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.99, 4.38, 3.73 [17:00:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.94, 3.86, 3.63 [17:04:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.58, 2.76, 3.24 [17:04:57] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.32, 3.43, 3.23 [17:06:51] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.20, 3.39, 3.25 [17:10:41] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.49, 3.83, 3.45 [17:12:35] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.27, 3.57, 3.40 [17:13:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.01, 4.24, 3.70 [17:15:30] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.37, 3.75, 3.60 [17:18:19] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.52, 2.91, 3.22 [17:19:24] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.64, 3.87, 3.68 [17:21:21] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.50, 3.68, 3.63 [17:23:18] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.47, 4.11, 3.78 [17:25:15] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.06, 3.63, 3.64 [17:29:09] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.34, 3.87, 3.67 [17:31:03] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.93, 3.60, 3.40 [17:31:06] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.93, 3.08, 3.40 [17:38:40] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.05, 3.66, 3.48 [17:42:29] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.34, 3.75, 3.59 [17:44:24] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.32, 3.14, 3.38 [17:55:36] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.57, 3.80, 3.48 [17:56:49] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zulaclub.net All nameservers failed to answer the query. [17:57:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/214327fa8e9f [17:57:33] [02miraheze/puppet] 07paladox 03214327f - miraheze-backup: fix expire header not being added to sql objects [17:57:33] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.54, 3.06, 3.25 [17:57:35] [02puppet] 07paladox created branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [17:57:38] [02puppet] 07paladox opened pull request 03#3344: miraheze-backup: fix expire header not being added to sql objects - 13https://github.com/miraheze/puppet/pull/3344 [17:58:16] [02puppet] 07paladox closed pull request 03#3344: miraheze-backup: fix expire header not being added to sql objects - 13https://github.com/miraheze/puppet/pull/3344 [17:58:19] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/cef71413b4b2...fc263c08e0d5 [17:58:20] [02miraheze/puppet] 07paladox 03fc263c0 - miraheze-backup: fix expire header not being added to sql objects (#3344) [17:58:21] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-8 [17:58:24] [02puppet] 07paladox deleted branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [18:08:19] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.08, 3.48, 2.81 [18:08:21] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.67, 4.55, 3.70 [18:15:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/8f5c2d486c6d [18:15:02] [02miraheze/puppet] 07paladox 038f5c2d4 - miraheze-backup: fix missing containers in unfreeze_backup [18:15:04] [02puppet] 07paladox created branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [18:15:06] [02puppet] 07paladox opened pull request 03#3345: miraheze-backup: fix missing containers in unfreeze_backup - 13https://github.com/miraheze/puppet/pull/3345 [18:15:52] [02puppet] 07paladox synchronize pull request 03#3345: miraheze-backup: fix missing containers in unfreeze_backup - 13https://github.com/miraheze/puppet/pull/3345 [18:15:53] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/8f5c2d486c6d...fc90dab44117 [18:15:55] [02miraheze/puppet] 07paladox 03fc90dab - Update miraheze-backup.py.erb [18:16:10] [02puppet] 07paladox closed pull request 03#3345: miraheze-backup: fix missing containers in unfreeze_backup - 13https://github.com/miraheze/puppet/pull/3345 [18:16:13] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/fc263c08e0d5...cae863714d3c [18:16:15] [02miraheze/puppet] 07paladox 03cae8637 - miraheze-backup: fix missing containers in unfreeze_backup (#3345) [18:16:18] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-8 [18:16:21] [02puppet] 07paladox deleted branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [18:22:00] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.52, 3.43, 3.85 [18:25:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.46, 4.03, 3.95 [18:27:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.42, 3.41, 3.74 [18:31:45] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.58, 3.94, 3.85 [18:33:43] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.46, 3.53, 3.73 [18:36:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/55b773adc75f [18:36:03] [02miraheze/puppet] 07paladox 0355b773a - miraheze-backup: use subprocess rather than os [18:36:05] [02puppet] 07paladox created branch 03paladox-patch-8 - 13https://github.com/miraheze/puppet [18:36:11] [02puppet] 07paladox opened pull request 03#3346: miraheze-backup: use subprocess rather than os - 13https://github.com/miraheze/puppet/pull/3346 [18:37:37] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.22, 3.05, 3.43 [18:39:34] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.87, 3.29, 3.47 [18:43:28] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.02, 3.11, 3.35 [18:44:58] [02puppet] 07paladox synchronize pull request 03#3346: miraheze-backup: use subprocess rather than os - 13https://github.com/miraheze/puppet/pull/3346 [18:45:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/55b773adc75f...d72123567628 [18:45:02] [02miraheze/puppet] 07paladox 03d721235 - Update miraheze-backup.py.erb [18:55:54] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/42ce5afb55d7 [18:55:57] [02miraheze/CreateWiki] 07paladox 0342ce5af - Set recacheJson() in deferredupdate [18:55:59] [02CreateWiki] 07paladox created branch 03paladox-patch-2 - 13https://github.com/miraheze/CreateWiki [18:56:00] [02CreateWiki] 07paladox opened pull request 03#430: Set recacheJson() in deferredupdate - 13https://github.com/miraheze/CreateWiki/pull/430 [18:56:15] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp22.miraheze.org - CNAME OK [19:07:22] miraheze/CreateWiki - paladox the build passed. [19:07:42] [02CreateWiki] 07paladox closed pull request 03#430: Set recacheJson() in deferredupdate - 13https://github.com/miraheze/CreateWiki/pull/430 [19:07:43] [02miraheze/CreateWiki] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/0388b7eb9b31...1b01b8e08c5e [19:07:45] [02miraheze/CreateWiki] 07paladox 031b01b8e - Set recacheJson() in deferredupdate (#430) [19:07:47] [02miraheze/CreateWiki] 07paladox deleted branch 03paladox-patch-2 [19:07:50] [02CreateWiki] 07paladox deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/CreateWiki [19:08:25] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_40 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/17e2791ffc7f...0653f64857f0 [19:08:28] [02miraheze/mediawiki] 07paladox 030653f64 - Update CreateWiki [19:09:20] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_39 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/7d29185548ae...2eaa577ccbec [19:09:20] [02miraheze/mediawiki] 07paladox 032eaa577 - Update CreateWiki [19:09:28] !log [paladox@mwtask141] starting deploy of {'world': True, 'l10n': True} to all [19:09:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:09:39] !log [paladox@test131] starting deploy of {'world': True, 'l10n': True} to all [19:09:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:10:55] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.55, 3.32, 3.11 [19:12:52] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.66, 3.36, 3.14 [19:14:49] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.79, 4.01, 3.41 [19:16:00] !log [paladox@test131] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 381s [19:16:02] !log [paladox@mwtask141] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 393s [19:16:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:16:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:20:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.64, 3.65, 3.95 [19:20:19] [02puppet] 07paladox synchronize pull request 03#3346: miraheze-backup: use subprocess rather than os - 13https://github.com/miraheze/puppet/pull/3346 [19:20:23] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/d72123567628...921d74a27948 [19:20:24] [02miraheze/puppet] 07paladox 03921d74a - Update miraheze-backup.py.erb [19:21:26] miraheze/CreateWiki - paladox the build passed. [19:22:29] [02puppet] 07paladox synchronize pull request 03#3346: miraheze-backup: use subprocess rather than os - 13https://github.com/miraheze/puppet/pull/3346 [19:22:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-8 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/921d74a27948...3ec1988618cc [19:22:33] [02miraheze/puppet] 07paladox 033ec1988 - Update miraheze-backup.py.erb [19:30:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.47, 3.98, 4.00 [19:32:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.18, 4.21, 4.09 [19:34:19] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.18, 3.78, 3.79 [19:34:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.02, 3.84, 3.97 [19:36:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.45, 3.59, 3.71 [19:36:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.18, 4.19, 4.09 [19:40:19] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.23, 3.73, 3.74 [19:40:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.95, 3.69, 3.97 [19:42:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.99, 3.83, 3.77 [19:46:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.41, 3.90, 3.92 [19:51:01] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [19:54:19] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.05, 3.64, 3.65 [19:58:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.56, 3.72, 3.70 [19:58:39] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.08, 3.60, 3.96 [20:04:39] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.59, 3.32, 3.61 [20:06:39] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.12, 2.80, 3.39 [20:07:48] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=hehehehawwiki --no-updates --username-prefix=wikia:browutisthis123 /home/macfan/ImportDump/hehehehawwiki-20230702224658.xml (START) [20:07:51] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=hehehehawwiki --no-updates --username-prefix=wikia:browutisthis123 /home/macfan/ImportDump/hehehehawwiki-20230702224658.xml (END - exit=0) [20:07:52] !log [macfan@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=hehehehawwiki (START) [20:07:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [20:07:58]