[00:01:06] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.41, 7.18, 6.84 [00:01:52] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 18.77, 14.02, 7.17 [00:03:04] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.78, 6.69, 6.70 [00:03:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.51, 10.46, 10.59 [00:03:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 4.48, 4.35, 3.08 [00:05:15] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.56, 10.23, 10.50 [00:05:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.49, 4.00, 3.11 [00:06:57] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.51, 6.85, 6.79 [00:07:49] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.12, 3.50, 2.76 [00:11:49] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.90, 3.33, 2.88 [00:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.31, 10.75, 10.97 [00:13:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.33, 3.08, 3.06 [00:13:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.24, 10.86, 10.99 [00:14:49] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.88, 6.59, 6.75 [00:15:56] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [00:20:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.52, 7.27, 7.00 [00:22:03] [02CreateWiki] 07Universal-Omega opened pull request 03#400: RebuildExtensionListCache: add a --cachedir option - 13https://github.com/miraheze/CreateWiki/pull/400 [00:24:36] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.26, 6.55, 6.75 [00:25:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.71, 9.61, 10.13 [00:25:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.63, 2.42, 3.72 [00:29:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.75, 2.28, 3.37 [00:29:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.84, 9.14, 9.96 [00:30:09] miraheze/CreateWiki - Universal-Omega the build passed. [00:36:15] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.92, 6.32, 4.15 [00:37:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.21, 10.27, 10.11 [00:40:15] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.52, 6.05, 4.64 [00:41:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.68, 11.87, 10.70 [00:51:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.44, 11.80, 11.46 [00:59:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.24, 3.63, 2.79 [01:01:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 3.03, 3.23, 2.74 [01:07:02] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.69, 10.80, 9.78 [01:08:01] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.19, 4.59, 3.31 [01:09:58] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.41, 3.69, 3.13 [01:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 18.57, 13.81, 11.88 [01:13:00] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.47, 9.57, 9.64 [01:13:53] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.50, 2.73, 2.87 [01:13:56] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [01:15:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.11, 10.64, 11.04 [01:20:25] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 10.30, 7.63, 6.79 [01:24:15] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.57, 6.22, 3.40 [01:24:20] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.77, 7.78, 7.05 [01:26:15] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 6.26, 6.51, 3.87 [01:35:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.62, 9.47, 10.20 [01:36:08] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.07, 7.50, 7.20 [01:38:05] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.25, 7.04, 7.07 [01:38:53] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.32, 11.09, 10.16 [01:39:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.65, 10.43, 10.45 [01:40:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.67, 10.93, 10.22 [01:44:51] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.39, 9.51, 9.85 [01:45:56] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:47:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.25, 11.68, 10.91 [01:49:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.61, 11.22, 10.88 [01:49:53] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.10, 7.46, 7.24 [01:51:50] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.38, 7.57, 7.32 [01:53:48] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.31, 7.76, 7.41 [01:53:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.91, 8.09, 9.69 [01:55:46] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.81, 7.77, 7.46 [01:59:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.69, 8.11, 7.62 [02:03:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.23, 7.80, 7.61 [02:05:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.93, 10.75, 10.03 [02:07:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.79, 7.87, 7.64 [02:11:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.96, 7.58, 7.60 [02:13:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.85, 7.91, 7.71 [02:15:16] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.99, 6.93, 5.95 [02:15:46] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.87, 6.27, 5.20 [02:17:17] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.46, 6.72, 5.99 [02:17:43] PROBLEM - swiftobject112 Current Load on swiftobject112 is CRITICAL: CRITICAL - load average: 9.23, 7.31, 5.71 [02:18:22] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.12, 4.01, 3.03 [02:19:40] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 4.05, 5.99, 5.41 [02:19:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.61, 7.79, 7.81 [02:20:19] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.81, 3.21, 2.86 [02:20:37] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [02:21:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.06, 7.92, 7.85 [02:23:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.65, 7.36, 7.65 [02:25:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.58, 9.20, 9.99 [02:26:09] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.31, 3.86, 3.21 [02:29:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.48, 7.75, 7.71 [02:30:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.23, 3.62, 3.31 [02:33:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.26, 7.53, 7.64 [02:33:59] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.80, 2.95, 3.12 [02:39:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.00, 10.70, 10.07 [02:41:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.83, 11.26, 10.37 [02:43:56] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [02:45:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.23, 10.09, 10.09 [02:48:41] RECOVERY - swiftobject113 Disk Space on swiftobject113 is OK: DISK OK - free space: / 58649 MB (11% inode=84%); [02:49:40] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [02:52:15] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.27, 6.01, 3.30 [02:56:15] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.25, 5.27, 3.71 [02:57:40] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.05, 6.11, 6.78 [03:03:25] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.91, 7.86, 5.07 [03:11:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.71, 3.58, 3.96 [03:13:41] RECOVERY - swiftobject111 Disk Space on swiftobject111 is OK: DISK OK - free space: / 58693 MB (11% inode=84%); [03:17:07] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.77, 2.49, 3.35 [03:17:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.57, 10.43, 9.73 [03:19:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.17, 9.62, 9.53 [03:20:31] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.47, 7.37, 6.78 [03:22:29] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.21, 7.14, 6.76 [03:24:54] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.87, 4.22, 3.70 [03:28:48] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.99, 3.64, 3.60 [03:30:21] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.59, 8.12, 7.29 [03:31:10] RECOVERY - swiftobject112 Disk Space on swiftobject112 is OK: DISK OK - free space: / 58644 MB (11% inode=84%); [03:32:43] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.38, 2.89, 3.29 [03:35:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.87, 7.00, 6.40 [03:37:03] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.39, 6.45, 6.28 [03:53:09] PROBLEM - swiftobject121 APT on swiftobject121 is CRITICAL: APT CRITICAL: 16 packages available for upgrade (1 critical updates). [03:59:04] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8436 MB (6% inode=99%); [04:19:06] [02CreateWiki] 07Reception123 closed pull request 03#400: RebuildExtensionListCache: add a --cachedir option - 13https://github.com/miraheze/CreateWiki/pull/400 [04:19:08] [02miraheze/CreateWiki] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/f78899489775...277a8cb8bd34 [04:19:10] [02miraheze/CreateWiki] 07Universal-Omega 03277a8cb - RebuildExtensionListCache: add a --cachedir option (#400) [04:25:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.66, 7.19, 7.82 [04:27:08] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1000004411 secs [04:27:51] miraheze/CreateWiki - Reception123 the build passed. [04:29:08] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.09993487597 secs [04:29:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.46, 7.45, 7.75 [04:33:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.80, 7.57, 7.77 [04:33:46] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.13, 5.32, 3.59 [04:34:15] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.84, 5.53, 3.95 [04:36:15] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.92, 5.56, 4.16 [04:37:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.94, 3.62, 3.29 [04:39:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.20, 3.33, 3.23 [04:43:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.28, 7.76, 7.70 [04:47:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.73, 7.52, 7.65 [04:51:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.56, 8.16, 7.85 [04:53:09] !log reception@mwtask141:~$ sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/deleted.json /srv/mediawiki/w/extensions/CreateWiki/maintenance/setContainersAccess.php [04:53:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:53:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.02, 7.83, 7.78 [04:57:41] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.47, 8.00, 7.84 [04:59:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.08, 7.80, 7.80 [05:11:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.68, 7.39, 7.37 [05:13:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.10, 7.33, 7.35 [05:15:43] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.92, 7.80, 7.51 [05:27:04] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7961 MB (5% inode=99%); [05:29:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.44, 7.72, 7.84 [05:47:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.03, 7.63, 7.58 [05:57:54] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.84, 6.55, 6.02 [05:59:50] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 6.41, 6.35, 6.00 [06:01:20] RECOVERY - swiftac111 Backups Swift Account Container on swiftac111 is OK: FILE_AGE OK: /var/log/swift-account-container-backup.log is 79 seconds old and 0 bytes [06:15:56] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:33:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.34, 7.26, 7.96 [06:44:52] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [06:47:42] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 6.87, 6.58, 6.13 [06:49:40] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 6.22, 6.50, 6.16 [06:49:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.40, 8.18, 7.95 [06:53:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.96, 7.95, 7.94 [06:55:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.34, 8.06, 7.98 [06:59:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.50, 7.85, 7.92 [07:01:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.83, 8.01, 7.96 [07:03:43] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.56, 7.76, 7.87 [07:07:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.72, 7.91, 7.88 [07:15:04] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8408 MB (6% inode=99%); [07:17:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.49, 7.93, 7.96 [07:19:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.09, 8.35, 8.11 [07:29:16] PROBLEM - swiftobject111 Current Load on swiftobject111 is WARNING: WARNING - load average: 7.16, 6.55, 5.91 [07:31:16] RECOVERY - swiftobject111 Current Load on swiftobject111 is OK: OK - load average: 6.11, 6.49, 5.97 [07:31:32] PROBLEM - swiftobject121 Disk Space on swiftobject121 is WARNING: DISK WARNING - free space: / 28976 MB (6% inode=83%); [07:55:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.99, 7.74, 8.00 [07:57:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.43, 7.92, 8.04 [07:59:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.66, 7.67, 7.92 [08:01:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.87, 8.01, 8.01 [08:15:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.57, 7.75, 7.95 [08:19:07] [02mw-config] 07redbluegreenhat closed pull request 03#5207: Create global-renamer group on Meta - 13https://github.com/miraheze/mw-config/pull/5207 [08:19:08] [02miraheze/mw-config] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/c9361110c8a5...49164c23a8d3 [08:19:09] [02miraheze/mw-config] 07AgentIsai 0349164c2 - Create global-renamer group on Meta (#5207) [08:19:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.06, 7.74, 7.88 [08:20:12] miraheze/mw-config - redbluegreenhat the build passed. [08:21:03] !log [alex@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [08:21:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:21:08] PROBLEM - cp22 NTP time on cp22 is CRITICAL: NTP CRITICAL: Offset 0.5331358314 secs [08:21:11] !log [alex@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [08:21:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:21:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.33, 7.58, 7.80 [08:27:07] !log [@test131] starting deploy of {'config': True} to all [08:27:08] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [08:27:11] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:27:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:27:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.51, 7.59, 7.68 [08:29:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.26, 7.38, 7.59 [08:30:08] that didn't really work [08:32:33] !log [alex@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [08:32:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:32:42] !log [alex@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 8s [08:32:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:33:01] nope, still no group [08:33:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.08, 7.61, 7.62 [08:35:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.62, 7.58, 7.61 [08:37:04] PROBLEM - db112 Disk Space on db112 is CRITICAL: DISK CRITICAL - free space: / 7965 MB (5% inode=99%); [08:39:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.57, 8.62, 8.00 [08:43:31] maybe the group has to exist beforehand so that ManageWiki adds the permission? [08:47:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.73, 7.86, 7.92 [08:49:08] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.0002545118332 secs [08:51:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.03, 8.19, 8.00 [08:53:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.37, 7.45, 7.75 [08:54:01] or maybe run ManageWiki's populateGroupPermissions.php? [08:54:16] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.90, 5.86, 3.32 [08:55:37] certainly looks like it [08:55:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.72, 7.71, 7.79 [08:58:15] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.79, 5.16, 3.77 [08:59:20] Reception123: What do you think? [08:59:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.56, 7.82, 7.84 [09:07:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.22, 7.50, 7.64 [09:11:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.35, 7.76, 7.74 [09:13:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.20, 7.81, 7.75 [09:14:41] PROBLEM - swiftobject122 Disk Space on swiftobject122 is WARNING: DISK WARNING - free space: / 97364 MB (10% inode=84%); [09:15:56] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [09:17:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.88, 7.80, 7.76 [09:19:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.26, 7.89, 7.79 [09:21:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.81, 7.95, 7.83 [09:29:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.51, 7.81, 7.72 [09:31:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.08, 7.47, 7.60 [09:33:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.50, 7.56, 7.60 [09:36:03] PROBLEM - swiftobject112 Current Load on swiftobject112 is WARNING: WARNING - load average: 7.58, 6.54, 6.11 [09:37:40] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.52, 7.34, 7.55 [09:39:58] RECOVERY - swiftobject112 Current Load on swiftobject112 is OK: OK - load average: 5.65, 6.17, 6.06 [09:43:40] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.06, 5.78, 6.75 [09:44:52] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [09:53:23] I think so but I never know with these scripts [09:58:33] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.26, 7.31, 6.80 [09:59:32] RECOVERY - swiftobject121 Disk Space on swiftobject121 is OK: DISK OK - free space: / 52996 MB (11% inode=84%); [10:00:31] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.55, 7.59, 6.98 [10:02:29] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.04, 7.61, 7.05 [10:04:26] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.40, 7.48, 7.07 [10:06:25] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 8.53, 8.00, 7.32 [10:08:22] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.51, 7.74, 7.30 [10:12:18] PROBLEM - swiftobject121 Current Load on swiftobject121 is CRITICAL: CRITICAL - load average: 9.20, 8.32, 7.63 [10:24:05] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 6.27, 7.47, 7.66 [10:42:16] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.13, 4.83, 2.44 [10:44:15] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.74, 4.70, 2.71 [10:51:40] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 5.30, 5.90, 6.61 [11:00:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 4.80, 5.84, 7.87 [11:01:12] PROBLEM - swiftobject113 Current Load on swiftobject113 is WARNING: WARNING - load average: 7.48, 7.04, 6.58 [11:06:02] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.60, 4.90, 6.76 [11:09:06] RECOVERY - swiftobject113 Current Load on swiftobject113 is OK: OK - load average: 6.07, 6.57, 6.58 [11:13:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.37, 11.61, 9.54 [11:17:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.60, 10.07, 9.38 [11:49:25] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+1/-0/±0] 13https://github.com/miraheze/MirahezeMagic/commit/52771f1ccbf1 [11:49:28] [02miraheze/MirahezeMagic] 07Reception123 0352771f1 - add script to download/upload swift containers for DataDump compatibility [11:49:31] [02MirahezeMagic] 07Reception123 created branch 03Reception123-patch-1 - 13https://github.com/miraheze/MirahezeMagic [11:49:32] [02MirahezeMagic] 07Reception123 opened pull request 03#419: add script to download/upload swift containers for DataDump compatibi… - 13https://github.com/miraheze/MirahezeMagic/pull/419 [11:51:05] [02miraheze/MirahezeMagic] 07github-actions[bot] pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/52771f1ccbf1...dce5f87ae051 [11:51:06] [02miraheze/MirahezeMagic] 07github-actions 03dce5f87 - CI: lint code to MediaWiki standards [11:51:08] [02MirahezeMagic] 07github-actions[bot] synchronize pull request 03#419: add script to download/upload swift containers for DataDump compatibi… - 13https://github.com/miraheze/MirahezeMagic/pull/419 [11:58:55] [02MirahezeMagic] 07Reception123 synchronize pull request 03#419: add script to download/upload swift containers for DataDump compatibi… - 13https://github.com/miraheze/MirahezeMagic/pull/419 [11:58:58] [02miraheze/MirahezeMagic] 07Reception123 pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/dce5f87ae051...08544cf17f5d [11:58:59] [02miraheze/MirahezeMagic] 07Reception123 0308544cf - Update swiftDump.php [12:00:22] [02miraheze/MirahezeMagic] 07github-actions[bot] pushed 031 commit to 03Reception123-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/08544cf17f5d...64aecf135bbb [12:00:25] [02miraheze/MirahezeMagic] 07github-actions 0364aecf1 - CI: lint code to MediaWiki standards [12:00:27] [02MirahezeMagic] 07github-actions[bot] synchronize pull request 03#419: add script to download/upload swift containers for DataDump compatibi… - 13https://github.com/miraheze/MirahezeMagic/pull/419 [12:01:20] miraheze/MirahezeMagic - Reception123 the build has errored. [12:09:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.85, 10.14, 9.08 [12:11:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.94, 11.44, 9.70 [12:13:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.79, 10.91, 9.72 [12:14:49] !log reception@mwtask141:~$ sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/deleted.json /home/reception/fix_swift.php [12:14:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:15:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.69, 9.58, 9.36 [12:19:03] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 10.96, 7.42, 4.86 [12:20:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.87, 5.96, 5.44 [12:22:02] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.26, 5.61, 5.38 [12:22:42] PROBLEM - graylog131 NTP time on graylog131 is CRITICAL: NTP CRITICAL: Offset 0.7625715733 secs [12:22:57] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 4.84, 7.06, 5.38 [12:24:55] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.79, 5.21, 4.90 [12:25:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.30, 12.77, 10.58 [12:26:45] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.32, 11.40, 9.48 [12:28:44] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.18, 11.49, 9.77 [12:28:56] RECOVERY - graylog131 NTP time on graylog131 is OK: NTP OK: Offset -0.03055107594 secs [12:34:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.32, 12.88, 10.79 [12:37:19] PROBLEM - ie.unigon.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'ie.unigon.net' expires in 15 day(s) (Tue 09 May 2023 12:25:37 GMT +0000). [12:38:41] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.13, 12.00, 10.92 [12:40:50] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/14db1d2607e9...0be08d67469d [12:40:53] [02miraheze/ssl] 07MirahezeSSLBot 030be08d6 - Bot: Update SSL cert for ie.unigon.net [12:42:41] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.07, 12.02, 11.15 [12:44:40] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.54, 11.57, 11.10 [12:45:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.22, 11.42, 11.69 [12:50:38] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.44, 12.16, 11.44 [12:55:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.35, 11.35, 11.51 [12:59:02] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [13:06:36] RECOVERY - ie.unigon.net - LetsEncrypt on sslhost is OK: OK - Certificate 'ie.unigon.net' will expire on Sat 22 Jul 2023 11:40:36 GMT +0000. [13:13:46] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.77, 3.01, 2.14 [13:14:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.91, 11.47, 11.94 [13:15:46] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.52, 2.41, 2.02 [13:20:29] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.44, 11.64, 11.82 [13:21:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.41, 10.74, 11.82 [13:22:29] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.27, 11.01, 11.56 [13:25:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.15, 11.90, 11.95 [13:27:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.49, 11.84, 11.94 [13:28:27] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.78, 11.29, 11.37 [13:29:00] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:30:26] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.51, 10.53, 11.11 [13:35:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.33, 12.08, 11.93 [13:39:25] looks like the global-renamer problem took care of itself [13:39:41] I'll make an announcement on Meta's community portal just in case [13:40:24] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.14, 11.87, 11.35 [13:42:23] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.57, 11.51, 11.28 [13:42:53] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.99, 6.87, 6.42 [13:44:50] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.31, 6.30, 6.27 [13:46:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.23, 11.06, 11.10 [13:48:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.86, 10.71, 10.96 [13:50:40] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:51:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.83, 11.06, 11.93 [13:53:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.63, 12.02, 12.20 [14:02:17] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.15, 8.99, 10.13 [14:05:53] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.52, 3.24, 2.79 [14:06:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.27, 10.66, 10.63 [14:07:04] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 8352 MB (6% inode=99%); [14:07:49] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 3.17, 3.18, 2.82 [14:14:13] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.79, 12.13, 11.21 [14:19:44] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [14:20:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.19, 11.74, 11.48 [14:22:11] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.06, 11.88, 11.56 [14:24:10] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.91, 11.55, 11.48 [14:30:09] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.22, 11.70, 11.54 [14:32:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.28, 11.28, 11.41 [14:34:07] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.78, 12.17, 11.72 [14:36:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.57, 11.71, 11.62 [14:37:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.35, 9.90, 11.58 [14:41:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 17.80, 12.88, 12.30 [14:45:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.52, 11.53, 11.93 [14:46:29] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.18, 3.42, 2.58 [14:48:27] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.84, 2.80, 2.45 [14:51:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.54, 12.05, 11.95 [14:52:14] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.55, 7.79, 6.89 [14:52:19] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.57, 3.65, 2.91 [14:54:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.41, 4.03, 3.15 [14:55:50] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.70, 11.70, 11.95 [14:56:01] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.69, 9.43, 10.17 [14:56:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.74, 3.52, 3.06 [14:58:02] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.08, 6.65, 6.75 [14:58:11] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.57, 2.90, 2.90 [15:01:41] !log [reception@puppet141] Upgraded packages libxml2 on cloud14 [15:01:50] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.90, 10.58, 11.19 [15:01:51] !log [reception@puppet141] Upgraded packages libxml2 on cloud13 [15:01:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:01:59] !log [reception@puppet141] Upgraded packages libxml2 on cloud11 [15:02:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:02:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:02:18] !log [reception@puppet141] Upgraded packages libxml2 on db121 [15:02:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:02:36] !log [reception@puppet141] Upgraded packages libxml2 on jobchron121 [15:02:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:02:49] !log [reception@puppet141] Upgraded packages libxml2 on db131 [15:02:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:03:00] !log [reception@puppet141] Upgraded packages libxml2 on cloud10 [15:03:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:03:07] RECOVERY - cloud13 APT on cloud13 is OK: APT OK: 82 packages available for upgrade (0 critical updates). [15:03:14] RECOVERY - db121 APT on db121 is OK: APT OK: 30 packages available for upgrade (0 critical updates). [15:03:22] RECOVERY - cloud14 APT on cloud14 is OK: APT OK: 91 packages available for upgrade (0 critical updates). [15:03:31] RECOVERY - cloud11 APT on cloud11 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [15:03:40] RECOVERY - cloud10 APT on cloud10 is OK: APT OK: 82 packages available for upgrade (0 critical updates). [15:04:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 6.18, 8.32, 7.61 [15:04:05] RECOVERY - jobchron121 APT on jobchron121 is OK: APT OK: 22 packages available for upgrade (0 critical updates). [15:04:22] RECOVERY - db131 APT on db131 is OK: APT OK: 30 packages available for upgrade (0 critical updates). [15:05:31] !log [reception@puppet141] Upgraded packages libxml2 on ldap141 [15:05:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:06:02] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.28, 7.34, 7.34 [15:06:07] RECOVERY - ldap141 APT on ldap141 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [15:06:16] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.84, 5.08, 2.78 [15:06:56] !log [reception@puppet141] Upgraded packages libxml2 on db142 [15:07:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:07:19] !log [reception@puppet141] Upgraded packages libxml2 on bast121 [15:07:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:07:52] !log [reception@puppet141] Upgraded packages libxml2 on cloud12 [15:07:58] RECOVERY - db142 APT on db142 is OK: APT OK: 10 packages available for upgrade (0 critical updates). [15:07:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:08:07] !log [reception@puppet141] Upgraded packages libxml2 on db101 [15:08:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:08:15] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.62, 4.79, 2.99 [15:08:16] RECOVERY - bast121 APT on bast121 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [15:08:23] !log [reception@puppet141] Upgraded packages libxml2 on mem131 [15:08:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:08:35] RECOVERY - db101 APT on db101 is OK: APT OK: 30 packages available for upgrade (0 critical updates). [15:08:39] !log [reception@puppet141] Upgraded packages libxml2 on mon141 [15:08:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:08:54] !log [reception@puppet141] Upgraded packages libxml2 on cp22 [15:08:56] RECOVERY - cp22 APT on cp22 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [15:08:56] RECOVERY - mem131 APT on mem131 is OK: APT OK: 22 packages available for upgrade (0 critical updates). [15:08:57] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.03, 12.71, 11.05 [15:09:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:09:08] !log [reception@puppet141] Upgraded packages libxml2 on graylog131 [15:09:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:09:22] !log [reception@puppet141] Upgraded packages libxml2 on db112 [15:09:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:09:41] RECOVERY - cloud12 APT on cloud12 is OK: APT OK: 82 packages available for upgrade (0 critical updates). [15:09:42] !log [reception@puppet141] Upgraded packages libxml2 on mw121 [15:09:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:09:50] RECOVERY - db112 APT on db112 is OK: APT OK: 30 packages available for upgrade (0 critical updates). [15:09:52] RECOVERY - mw121 APT on mw121 is OK: APT OK: 24 packages available for upgrade (0 critical updates). [15:09:59] !log [reception@puppet141] Upgraded packages libxml2 on cp23 [15:10:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:10:14] !log [reception@puppet141] Upgraded packages libxml2 on bast141 [15:10:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:10:26] RECOVERY - mon141 APT on mon141 is OK: APT OK: 11 packages available for upgrade (0 critical updates). [15:10:32] !log [reception@puppet141] Upgraded packages libxml2 on ns2 [15:10:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:10:37] RECOVERY - ns2 APT on ns2 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [15:10:44] !log [reception@puppet141] Upgraded packages libxml2 on mw132 [15:10:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:11:04] RECOVERY - graylog131 APT on graylog131 is OK: APT OK: 2 packages available for upgrade (0 critical updates). [15:11:07] RECOVERY - mw132 APT on mw132 is OK: APT OK: 24 packages available for upgrade (0 critical updates). [15:11:13] !log [reception@puppet141] Upgraded packages libxml2 on matomo121 [15:11:14] RECOVERY - cp23 APT on cp23 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [15:11:21] RECOVERY - matomo121 APT on matomo121 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [15:11:22]