[00:06:17] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 5.04, 3.32, 2.09 [00:10:17] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.71, 3.68, 2.53 [00:14:17] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.71, 3.27, 2.63 [02:40:59] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.48, 3.29, 2.72 [02:42:54] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.71, 3.09, 2.72 [03:31:36] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [03:48:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.43, 3.60, 3.46 [03:50:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.87, 3.38, 3.40 [03:54:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.91, 3.62, 3.48 [03:58:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.39, 3.27, 3.40 [04:01:30] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [04:10:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.30, 3.77, 3.52 [04:12:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.58, 3.63, 3.51 [04:20:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.26, 3.31, 3.40 [04:26:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.71, 3.51, 3.45 [04:40:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.32, 3.90, 3.62 [04:42:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.62, 3.85, 3.64 [04:44:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.22, 4.04, 3.74 [04:50:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.40, 3.77, 3.74 [05:04:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.81, 2.97, 3.34 [05:12:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.93, 3.40, 3.36 [05:14:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.32, 3.39, 3.36 [05:32:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.50, 3.36, 3.25 [05:34:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.14, 3.24, 3.21 [05:55:04] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.73, 3.62, 3.37 [06:06:34] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.27, 3.97, 3.57 [07:09:18] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.80, 2.56, 1.20 [07:11:18] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.50, 2.48, 1.34 [07:14:02] PROBLEM - tudien.como.vn - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'tudien.como.vn' expires in 15 day(s) (Tue 10 Oct 2023 06:50:49 GMT +0000). [07:20:36] PROBLEM - wiki.drycleaninglobby.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.drycleaninglobby.net' expires in 15 day(s) (Tue 10 Oct 2023 06:58:48 GMT +0000). [07:26:37] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/ecb1067c68c0...65f9a0c6d1ce [07:26:37] [02miraheze/ssl] 07MirahezeSSLBot 0365f9a0c - Bot: Update SSL cert for wiki.drycleaninglobby.net [07:44:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.44, 3.58, 3.95 [08:02:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.58, 3.03, 3.39 [08:18:47] RECOVERY - wiki.drycleaninglobby.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.drycleaninglobby.net' will expire on Sat 23 Dec 2023 06:23:44 GMT +0000. [08:29:37] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.52, 3.49, 3.38 [08:31:32] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.49, 3.19, 3.29 [08:41:08] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.89, 3.49, 3.31 [08:44:58] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.12, 3.33, 3.28 [08:58:24] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.07, 3.44, 3.29 [09:00:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 4.00, 3.66, 3.39 [09:04:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.20, 3.75, 3.47 [09:06:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.89, 3.74, 3.50 [09:10:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.28, 3.86, 3.58 [09:12:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.26, 3.60, 3.52 [09:24:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.03, 3.57, 3.51 [09:26:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.92, 3.26, 3.40 [09:40:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.62, 3.59, 3.44 [09:42:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.67, 2.89, 3.20 [11:29:56] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [11:59:50] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [12:08:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.98, 2.98, 2.34 [12:10:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.62, 3.90, 2.76 [12:16:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.41, 3.74, 3.08 [12:20:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.86, 4.00, 3.32 [13:08:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.74, 3.87, 4.00 [13:12:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.10, 3.91, 3.99 [13:14:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.80, 3.49, 3.83 [13:18:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.21, 2.67, 3.40 [13:29:31] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [13:59:26] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [14:08:39] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/6396ef8d81e6...fae368d6252a [14:08:42] [02miraheze/puppet] 07paladox 03fae368d - matomo: set nginx config backlog to 4096 [14:10:16] RECOVERY - opendatascot.org - reverse DNS on sslhost is OK: SSL OK - opendatascot.org reverse DNS resolves to cp25.miraheze.org - NS RECORDS OK [14:17:16] RECOVERY - matomo121 APT on matomo121 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:18:46] !log upgrade matomo121 to brookworm [14:18:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:20:59] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-11 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/8be06012f7bd [14:21:02] [02miraheze/puppet] 07paladox 038be0601 - matomo: upgrade to php 8.2 [14:21:03] [02puppet] 07paladox created branch 03paladox-patch-11 - 13https://github.com/miraheze/puppet [14:21:04] [02puppet] 07paladox opened pull request 03#3435: matomo: upgrade to php 8.2 - 13https://github.com/miraheze/puppet/pull/3435 [14:23:13] [02puppet] 07paladox closed pull request 03#3435: matomo: upgrade to php 8.2 - 13https://github.com/miraheze/puppet/pull/3435 [14:23:16] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/fae368d6252a...9b9ad4339257 [14:23:19] [02miraheze/puppet] 07paladox 039b9ad43 - matomo: upgrade to php 8.2 (#3435) [14:23:20] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-11 [14:23:23] [02puppet] 07paladox deleted branch 03paladox-patch-11 - 13https://github.com/miraheze/puppet [14:25:26] PROBLEM - matomo121 APT on matomo121 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [14:25:46] PROBLEM - opendatascot.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'opendatascot.org' expires in 11 day(s) (Thu 05 Oct 2023 20:37:51 GMT +0000). [14:27:36] PROBLEM - matomo121 php-fpm on matomo121 is CRITICAL: PROCS CRITICAL: 0 processes with command name 'php-fpm7.4' [14:27:48] PROBLEM - matomo121 HTTPS on matomo121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 358 bytes in 0.267 second response time [14:28:41] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/65f9a0c6d1ce...6f7ec16f7126 [14:28:43] [02miraheze/ssl] 07MirahezeSSLBot 036f7ec16 - Bot: Update SSL cert for opendatascot.org [14:31:26] RECOVERY - matomo121 APT on matomo121 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:37:59] PROBLEM - matomo121 Puppet on matomo121 is UNKNOWN: NRPE: Unable to read output [14:38:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-11 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/0c965007498d [14:38:58] [02miraheze/puppet] 07paladox 030c96500 - nginx: add more mime types and rearrange [14:39:00] [02puppet] 07paladox created branch 03paladox-patch-11 - 13https://github.com/miraheze/puppet [14:39:02] [02puppet] 07paladox opened pull request 03#3436: nginx: add more mime types and rearrange - 13https://github.com/miraheze/puppet/pull/3436 [14:39:15] [02puppet] 07paladox closed pull request 03#3436: nginx: add more mime types and rearrange - 13https://github.com/miraheze/puppet/pull/3436 [14:39:17] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/9b9ad4339257...66d29f1a6312 [14:39:19] [02miraheze/puppet] 07paladox 0366d29f1 - nginx: add more mime types and rearrange (#3436) [14:39:22] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-11 [14:39:25] [02puppet] 07paladox deleted branch 03paladox-patch-11 - 13https://github.com/miraheze/puppet [14:45:58] PROBLEM - matomo121 Puppet on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 port 5666: Connection refusedconnect to host 2a10:6740::6:207 port 5666: Connection refused [14:48:17] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 port 5666: Connection refusedconnect to host 2a10:6740::6:207 port 5666: Connection refused [14:48:18] PROBLEM - matomo121 NTP time on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 port 5666: Connection refusedconnect to host 2a10:6740::6:207 port 5666: Connection refused [14:48:20] PROBLEM - matomo121 SSH on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 and port 22: Connection refused [14:48:24] PROBLEM - matomo121 Disk Space on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 port 5666: Connection refusedconnect to host 2a10:6740::6:207 port 5666: Connection refused [14:48:37] PROBLEM - matomo121 ferm_active on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 port 5666: Connection refusedconnect to host 2a10:6740::6:207 port 5666: Connection refused [14:49:14] PROBLEM - matomo121 conntrack_table_size on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 port 5666: Connection refusedconnect to host 2a10:6740::6:207 port 5666: Connection refused [14:49:16] PROBLEM - matomo121 APT on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 port 5666: Connection refusedconnect to host 2a10:6740::6:207 port 5666: Connection refused [14:49:21] PROBLEM - matomo121 Redis Process on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 port 5666: Connection refusedconnect to host 2a10:6740::6:207 port 5666: Connection refused [14:49:45] PROBLEM - matomo121 PowerDNS Recursor on matomo121 is CRITICAL: connect to address 2a10:6740::6:207 port 5666: Connection refusedconnect to host 2a10:6740::6:207 port 5666: Connection refused [14:58:37] RECOVERY - matomo121 ferm_active on matomo121 is OK: OK ferm input default policy is set [14:58:40] RECOVERY - matomo121 Disk Space on matomo121 is OK: DISK OK - free space: / 9285MiB (49% inode=90%); [14:58:49] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 1.16, 0.26, 0.09 [14:59:14] RECOVERY - matomo121 conntrack_table_size on matomo121 is OK: OK: nf_conntrack is 0 % full [14:59:17] RECOVERY - matomo121 APT on matomo121 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [14:59:22] RECOVERY - matomo121 Redis Process on matomo121 is OK: PROCS OK: 1 process with args 'redis-server' [14:59:46] RECOVERY - matomo121 PowerDNS Recursor on matomo121 is OK: DNS OK: 0.087 seconds response time. miraheze.org returns 2001:41d0:801:2000::3a18,2001:41d0:801:2000::5d68,51.195.201.140,51.89.139.24 [14:59:58] RECOVERY - matomo121 NTP time on matomo121 is OK: NTP OK: Offset -0.0002088546753 secs [14:59:59] PROBLEM - matomo121 Puppet on matomo121 is UNKNOWN: NRPE: Unable to read output [15:00:26] RECOVERY - matomo121 SSH on matomo121 is OK: SSH OK - OpenSSH_9.2p1 Debian-2 (protocol 2.0) [15:03:36] RECOVERY - matomo121 php-fpm on matomo121 is OK: PROCS OK: 19 processes with command name 'php-fpm8.2' [15:03:48] RECOVERY - matomo121 HTTPS on matomo121 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.207 second response time [15:03:59] RECOVERY - matomo121 Puppet on matomo121 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [15:12:29] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.88, 3.55, 3.20 [15:14:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/66d29f1a6312...1e3655b6a451 [15:14:58] [02miraheze/puppet] 07paladox 031e3655b - matomo: tweet config slightly [15:24:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.28, 3.94, 3.56 [15:25:45] RECOVERY - opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Sat 23 Dec 2023 13:28:31 GMT +0000. [15:25:53] PROBLEM - sparabel.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'sparabel.wiki' expires in 13 day(s) (Sat 07 Oct 2023 20:33:09 GMT +0000). [15:26:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.43, 3.68, 3.51 [15:46:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-11 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/22fb8c388c7a [15:46:13] [02miraheze/puppet] 07paladox 0322fb8c3 - varnish: cache more of matomo [15:46:14] [02puppet] 07paladox created branch 03paladox-patch-11 - 13https://github.com/miraheze/puppet [15:46:16] [02puppet] 07paladox opened pull request 03#3437: varnish: cache more of matomo - 13https://github.com/miraheze/puppet/pull/3437 [15:46:39] [02puppet] 07paladox synchronize pull request 03#3437: varnish: cache more of matomo - 13https://github.com/miraheze/puppet/pull/3437 [15:46:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-11 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/22fb8c388c7a...a43da09100e8 [15:46:43] [02miraheze/puppet] 07paladox 03a43da09 - Update default.vcl [15:52:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.92, 2.66, 3.21 [15:55:48] PROBLEM - sparabel.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address sparabel.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [16:18:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.47, 3.26, 2.98 [16:22:13] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.03, 3.23, 3.04 [16:40:59] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 14607 MB (10% inode=99%); [16:41:32] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.68, 3.54, 3.34 [16:42:17] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 4.00, 3.38, 3.08 [16:44:17] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 2.78, 3.14, 3.03 [16:47:17] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.70, 3.29, 3.32 [17:28:41] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 7.39, 7.39, 5.61 [17:29:11] PROBLEM - www.mh142.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.mh142.com All nameservers failed to answer the query. [17:36:32] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 10.17, 8.90, 7.02 [17:42:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.63, 3.61, 3.08 [17:43:10] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-12 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/b8b556245e5b [17:43:13] [02miraheze/puppet] 07paladox 03b8b5562 - nginx: adjust keepalive [17:43:16] [02puppet] 07paladox created branch 03paladox-patch-12 - 13https://github.com/miraheze/puppet [17:43:17] [02puppet] 07paladox opened pull request 03#3438: nginx: adjust keepalive - 13https://github.com/miraheze/puppet/pull/3438 [17:45:29] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-12 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b8b556245e5b...9a5fe28bc020 [17:45:31] [02miraheze/puppet] 07paladox 039a5fe28 - Update mw131.yaml [17:45:32] [02puppet] 07paladox synchronize pull request 03#3438: nginx: adjust keepalive - 13https://github.com/miraheze/puppet/pull/3438 [17:45:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-12 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/9a5fe28bc020...e78d39ec1b2b [17:45:47] [02miraheze/puppet] 07paladox 03e78d39e - Update mw132.yaml [17:45:49] [02puppet] 07paladox synchronize pull request 03#3438: nginx: adjust keepalive - 13https://github.com/miraheze/puppet/pull/3438 [17:45:57] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-12 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e78d39ec1b2b...05958c05000c [17:46:00] [02miraheze/puppet] 07paladox 0305958c0 - Update mw133.yaml [17:46:01] [02puppet] 07paladox synchronize pull request 03#3438: nginx: adjust keepalive - 13https://github.com/miraheze/puppet/pull/3438 [17:46:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-12 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/05958c05000c...b2d857c0aaa0 [17:46:08] [02miraheze/puppet] 07paladox 03b2d857c - Update mw141.yaml [17:46:11] [02puppet] 07paladox synchronize pull request 03#3438: nginx: adjust keepalive - 13https://github.com/miraheze/puppet/pull/3438 [17:46:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.07, 3.78, 3.26 [17:46:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-12 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/b2d857c0aaa0...99220370bc9f [17:46:17] [02miraheze/puppet] 07paladox 039922037 - Update mw142.yaml [17:46:19] [02puppet] 07paladox synchronize pull request 03#3438: nginx: adjust keepalive - 13https://github.com/miraheze/puppet/pull/3438 [17:46:23] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-12 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/99220370bc9f...5e175552d229 [17:46:24] [02miraheze/puppet] 07paladox 035e17555 - Update mw143.yaml [17:46:26] [02puppet] 07paladox synchronize pull request 03#3438: nginx: adjust keepalive - 13https://github.com/miraheze/puppet/pull/3438 [17:46:34] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-12 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/5e175552d229...7054eaf816f2 [17:46:37] [02miraheze/puppet] 07paladox 037054eaf - Update mwtask141.yaml [17:46:39] [02puppet] 07paladox synchronize pull request 03#3438: nginx: adjust keepalive - 13https://github.com/miraheze/puppet/pull/3438 [17:50:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.40, 3.47, 3.29 [18:00:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-13 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/edcf2d5c0b7b [18:00:56] [02miraheze/puppet] 07paladox 03edcf2d5 - base: set net.ipv4.tcp_fastopen_blackhole_timeout_sec to 3600 [18:00:57] [02puppet] 07paladox created branch 03paladox-patch-13 - 13https://github.com/miraheze/puppet [18:01:00] [02puppet] 07paladox opened pull request 03#3439: base: set net.ipv4.tcp_fastopen_blackhole_timeout_sec to 3600 - 13https://github.com/miraheze/puppet/pull/3439 [18:01:10] [02puppet] 07paladox closed pull request 03#3439: base: set net.ipv4.tcp_fastopen_blackhole_timeout_sec to 3600 - 13https://github.com/miraheze/puppet/pull/3439 [18:01:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1e3655b6a451...2926ab067836 [18:01:14] [02miraheze/puppet] 07paladox 032926ab0 - base: set net.ipv4.tcp_fastopen_blackhole_timeout_sec to 3600 (#3439) [18:01:16] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-13 [18:01:19] [02puppet] 07paladox deleted branch 03paladox-patch-13 - 13https://github.com/miraheze/puppet [18:02:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.17, 3.64, 3.45 [18:04:06] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/2926ab067836...eebaa0078fd1 [18:04:07] [02miraheze/puppet] 07paladox 03eebaa00 - base: set some sysctl params [18:04:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.90, 3.65, 3.48 [18:06:12] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/eebaa0078fd1...a0e9e7d73ba6 [18:06:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.70, 3.98, 3.62 [18:06:15] [02miraheze/puppet] 07paladox 03a0e9e7d - base: set fs.file-max to 9223372036854775807 for kvm [18:27:11] RECOVERY - www.mh142.com - reverse DNS on sslhost is OK: SSL OK - www.mh142.com reverse DNS resolves to cp25.miraheze.org - NS RECORDS OK [18:29:40] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a0e9e7d73ba6...5c4eaad824b8 [18:29:43] [02miraheze/puppet] 07paladox 035c4eaad - nginx: disable gzip [18:32:22] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.70, 6.29, 7.60 [18:35:30] !log UPDATE cw_requests SET cw_status='approved' WHERE cw_id=35452; [18:35:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [18:38:22] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.53, 5.37, 6.78 [19:15:19] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/cd9b80c14afb...a439636d95aa [19:15:22] [02miraheze/mw-config] 07paladox 03a439636 - Set wgMaxMsgCacheEntrySize to 1024 [19:15:41] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [19:15:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:15:52] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 10s [19:15:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:15:57] !log [paladox@mwtask141] starting deploy of {'config': True} to all [19:16:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:16:05] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [19:16:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:16:22] miraheze/mw-config - paladox the build passed. [19:20:35] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 8.89, 6.81, 6.00 [19:22:31] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.79, 6.78, 6.09 [19:26:00] !log [@test131] starting deploy of {'config': True} to all [19:26:01] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 1s [19:26:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:26:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:30:24] [02puppet] 07paladox closed pull request 03#3438: nginx: adjust keepalive - 13https://github.com/miraheze/puppet/pull/3438 [19:30:25] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-12 [19:30:28] [02puppet] 07paladox deleted branch 03paladox-patch-12 - 13https://github.com/miraheze/puppet [19:30:35] [02puppet] 07paladox closed pull request 03#3419: varnish: set ttl to 20s to work around shortlived using transient - 13https://github.com/miraheze/puppet/pull/3419 [19:30:37] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [19:30:39] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [19:32:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.95, 3.79, 4.00 [19:34:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.12, 3.91, 4.02 [19:36:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.92, 3.87, 3.99 [19:52:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.36, 3.89, 3.81 [19:54:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.50, 3.70, 3.75 [19:58:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.05, 3.79, 3.77 [20:01:27] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.01, 6.45, 6.02 [20:02:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.86, 3.91, 3.83 [20:03:24] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 6.08, 6.15, 5.95 [20:35:57] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.95, 7.48, 6.56 [20:39:57] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.73, 6.53, 6.37 [20:50:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.16, 3.58, 3.53 [20:52:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.59, 3.60, 3.55 [21:08:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.42, 3.80, 3.61 [21:16:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.01, 3.81, 3.78 [21:38:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.01, 4.14, 3.85 [22:05:17] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset 0.005199462175 secs [22:11:19] PROBLEM - os141 Current Load on os141 is CRITICAL: CRITICAL - load average: 4.52, 2.93, 1.54 [22:13:18] RECOVERY - os141 Current Load on os141 is OK: OK - load average: 2.57, 2.82, 1.67 [23:04:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.42, 3.44, 3.96 [23:04:22] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 13.08, 7.76, 3.61 [23:06:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.04, 3.60, 3.95 [23:08:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.49, 3.54, 3.89 [23:10:22] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 1.02, 6.11, 4.62 [23:18:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.66, 3.63, 3.65 [23:22:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.85, 3.83, 3.74