[00:00:46] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/85fbd4ce16bd [00:00:49] [02miraheze/puppet] 07paladox 0385fbd4c - mwtask141: increase memory_limit to 1G [00:00:50] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [00:00:51] PROBLEM - correypedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'correypedia.org' expires in 15 day(s) (Sun 13 Nov 2022 23:56:35 GMT +0000). [00:00:52] [02puppet] 07paladox opened pull request 03#2971: mwtask141: increase memory_limit to 1G - 13https://github.com/miraheze/puppet/pull/2971 [00:01:00] [02puppet] 07paladox closed pull request 03#2971: mwtask141: increase memory_limit to 1G - 13https://github.com/miraheze/puppet/pull/2971 [00:01:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/66d81c24c155...7b5fab20737f [00:01:03] [02miraheze/puppet] 07paladox 037b5fab2 - mwtask141: increase memory_limit to 1G (#2971) [00:01:05] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-4 [00:01:08] [02puppet] 07paladox deleted branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [00:01:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.99, 10.10, 9.66 [00:02:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.23, 11.50, 11.12 [00:03:33] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1734348834 secs [00:04:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.47, 4.60, 3.24 [00:05:24] PROBLEM - wiki.ravynos.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.ravynos.com' expires in 15 day(s) (Mon 14 Nov 2022 00:00:40 GMT +0000). [00:06:17] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/16943bf68437...cb546c6fc670 [00:06:18] [02miraheze/ssl] 07MirahezeSSLBot 03cb546c6 - Bot: Update SSL cert for correypedia.org [00:06:47] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.42, 11.61, 11.23 [00:07:38] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.95, 11.42, 10.38 [00:08:34] PROBLEM - swiftobject115 NTP time on swiftobject115 is WARNING: NTP WARNING: Offset 0.3731890917 secs [00:09:27] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-4 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/eaad8eab37ab [00:09:29] [02miraheze/puppet] 07paladox 03eaad8ea - swift: proxy - set error_suppression_interval to 0 [00:09:30] [02puppet] 07paladox created branch 03paladox-patch-4 - 13https://github.com/miraheze/puppet [00:09:32] [02puppet] 07paladox opened pull request 03#2972: swift: proxy - set error_suppression_interval to 0 - 13https://github.com/miraheze/puppet/pull/2972 [00:09:35] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.98, 12.79, 10.98 [00:12:35] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 6.11, 4.20, 2.77 [00:13:30] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.22, 10.59, 10.58 [00:13:33] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.07566958666 secs [00:14:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.77, 10.94, 11.35 [00:14:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.37, 3.97, 3.61 [00:15:53] PROBLEM - wiki.apico.buzz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.apico.buzz' expires in 15 day(s) (Sun 13 Nov 2022 23:50:45 GMT +0000). [00:16:33] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.92, 3.27, 2.75 [00:16:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.39, 3.84, 3.58 [00:16:46] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/cb546c6fc670...e3913be9af82 [00:16:47] [02miraheze/ssl] 07MirahezeSSLBot 03e3913be - Bot: Update SSL cert for wiki.apico.buzz [00:21:21] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.00, 11.31, 10.77 [00:22:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.35, 3.55, 3.63 [00:24:27] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.61, 11.95, 11.49 [00:24:41] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.50, 3.75, 3.68 [00:26:24] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.72, 11.31, 11.34 [00:26:26] PROBLEM - thestories.kr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'thestories.kr' expires in 15 day(s) (Mon 14 Nov 2022 00:06:19 GMT +0000). [00:26:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.73, 3.50, 3.61 [00:27:14] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.52, 11.65, 11.22 [00:27:32] PROBLEM - opendatascot.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'opendatascot.org' expires in 15 day(s) (Mon 14 Nov 2022 00:11:40 GMT +0000). [00:27:55] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/e3913be9af82...90772f56571e [00:27:57] [02miraheze/ssl] 07MirahezeSSLBot 0390772f5 - Bot: Update SSL cert for thestories.kr [00:28:22] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.79, 12.35, 11.69 [00:28:24] PROBLEM - www.opendatascot.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'opendatascot.org' expires in 15 day(s) (Mon 14 Nov 2022 00:11:40 GMT +0000). [00:29:42] RECOVERY - correypedia.org - LetsEncrypt on sslhost is OK: OK - Certificate 'correypedia.org' will expire on Thu 26 Jan 2023 23:06:11 GMT +0000. [00:30:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.05, 11.49, 11.46 [00:30:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.98, 2.42, 3.16 [00:32:10] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/90772f56571e...a26fa6361c8a [00:32:13] [02miraheze/ssl] 07MirahezeSSLBot 03a26fa63 - Bot: Update SSL cert for opendatascot.org [00:33:40] PROBLEM - wiki.digitaldesignhq.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.digitaldesignhq.com' expires in 15 day(s) (Mon 14 Nov 2022 00:25:05 GMT +0000). [00:34:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 16.15, 13.13, 12.05 [00:35:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.15, 11.52, 11.22 [00:36:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.40, 11.53, 11.62 [00:37:02] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.46, 11.26, 11.17 [00:38:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.83, 12.05, 11.76 [00:38:59] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.89, 12.22, 11.52 [00:39:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a26fa6361c8a...528b61fab7df [00:39:27] [02miraheze/ssl] 07MirahezeSSLBot 03528b61f - Bot: Update SSL cert for wiki.digitaldesignhq.com [00:40:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.49, 11.85, 11.49 [00:42:36] PROBLEM - www.obeymewiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'www.obeymewiki.com' expires in 15 day(s) (Mon 14 Nov 2022 00:17:44 GMT +0000). [00:45:03] RECOVERY - wiki.apico.buzz - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.apico.buzz' will expire on Thu 26 Jan 2023 23:16:40 GMT +0000. [00:45:30] PROBLEM - with.cpt-ra.bid - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'with.cpt-ra.bid' expires in 15 day(s) (Mon 14 Nov 2022 00:13:49 GMT +0000). [00:46:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.73, 10.14, 11.45 [00:47:18] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/528b61fab7df...2b856b815123 [00:47:19] [02miraheze/ssl] 07MirahezeSSLBot 032b856b8 - Bot: Update SSL cert for www.obeymewiki.com [00:48:45] PROBLEM - steamdecklinux.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'steamdecklinux.wiki' expires in 15 day(s) (Mon 14 Nov 2022 00:26:24 GMT +0000). [00:48:47] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.88, 8.16, 9.88 [00:53:17] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/2b856b815123...c84c4465f84e [00:53:18] [02miraheze/ssl] 07MirahezeSSLBot 03c84c446 - Bot: Update SSL cert for with.cpt-ra.bid [00:55:34] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c84c4465f84e...205fd8f43aab [00:55:36] [02miraheze/ssl] 07MirahezeSSLBot 03205fd8f - Bot: Update SSL cert for steamdecklinux.wiki [00:56:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.71, 9.36, 10.20 [00:57:15] RECOVERY - opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Thu 26 Jan 2023 23:32:05 GMT +0000. [00:58:14] RECOVERY - www.opendatascot.org - LetsEncrypt on sslhost is OK: OK - Certificate 'opendatascot.org' will expire on Thu 26 Jan 2023 23:32:05 GMT +0000. [01:00:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.62, 10.61, 10.48 [01:00:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.80, 10.07, 9.65 [01:02:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.57, 9.36, 10.04 [01:02:29] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.17, 9.24, 9.42 [01:12:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.98, 9.99, 9.88 [01:12:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.67, 3.94, 3.12 [01:12:29] RECOVERY - www.obeymewiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.obeymewiki.com' will expire on Thu 26 Jan 2023 23:47:12 GMT +0000. [01:14:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.36, 9.60, 9.75 [01:14:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.60, 3.15, 2.93 [01:15:14] RECOVERY - swiftobject115 NTP time on swiftobject115 is OK: NTP OK: Offset -0.02417427301 secs [01:15:27] RECOVERY - with.cpt-ra.bid - LetsEncrypt on sslhost is OK: OK - Certificate 'with.cpt-ra.bid' will expire on Thu 26 Jan 2023 23:53:11 GMT +0000. [01:17:56] RECOVERY - steamdecklinux.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'steamdecklinux.wiki' will expire on Thu 26 Jan 2023 23:55:28 GMT +0000. [01:18:05] PROBLEM - gluster122 Current Load on gluster122 is CRITICAL: CRITICAL - load average: 4.11, 3.23, 2.57 [01:18:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.27, 10.38, 9.86 [01:18:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.07, 10.53, 10.15 [01:20:05] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.60, 3.01, 2.57 [01:20:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.46, 10.82, 10.27 [01:22:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.11, 10.57, 10.25 [01:23:56] RECOVERY - thestories.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'thestories.kr' will expire on Thu 26 Jan 2023 23:27:49 GMT +0000. [01:24:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.24, 9.83, 10.02 [01:30:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.63, 11.11, 10.56 [01:31:47] RECOVERY - wiki.digitaldesignhq.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitaldesignhq.com' will expire on Thu 26 Jan 2023 23:39:20 GMT +0000. [01:34:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 16.71, 12.66, 11.28 [01:36:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.66, 3.97, 3.20 [01:36:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.80, 11.47, 11.02 [01:38:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.22, 11.83, 10.99 [01:38:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 15.03, 13.08, 11.68 [01:40:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.99, 2.95, 2.97 [01:40:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.74, 10.91, 10.75 [01:46:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.03, 11.33, 11.00 [01:48:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.41, 11.11, 10.97 [01:48:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.28, 11.25, 11.55 [01:52:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.51, 11.56, 11.52 [01:52:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.25, 12.27, 11.47 [01:56:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.85, 11.67, 11.70 [02:00:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.31, 11.68, 11.73 [02:12:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.13, 10.74, 10.59 [02:14:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.97, 10.95, 10.69 [02:16:50] !log [reception@mwtask141] sudo -u www-data php /srv/mediawiki/w/maintenance/deleteBatch.php --wiki=monstergirlencyclopediawiki --r=Requested at [[phab:T9754 [02:16:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:17:11] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 8.34, 4.59, 2.49 [02:20:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.37, 11.32, 10.80 [02:20:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.81, 3.41, 2.85 [02:22:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.98, 4.06, 3.16 [02:23:08] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 0.91, 3.54, 2.87 [02:24:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.73, 11.23, 10.89 [02:24:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.77, 8.80, 9.90 [02:24:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.36, 3.40, 3.03 [02:25:06] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.70, 2.59, 2.60 [02:30:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.99, 11.00, 10.54 [02:34:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.00, 11.57, 11.08 [02:36:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.14, 10.69, 10.83 [02:40:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.64, 11.56, 10.91 [02:42:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.67, 11.09, 10.91 [02:45:33] PROBLEM - ns1 NTP time on ns1 is WARNING: NTP WARNING: Offset 0.2879128754 secs [02:50:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.64, 11.17, 11.26 [02:52:16] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.20, 12.06, 11.57 [02:53:33] RECOVERY - ns1 NTP time on ns1 is OK: NTP OK: Offset -0.02662694454 secs [02:54:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.41, 11.89, 11.58 [02:56:13] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.50, 3.57, 3.03 [02:58:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.69, 11.88, 11.93 [03:00:09] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.31, 2.88, 2.94 [03:03:44] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.86, 2.74, 2.08 [03:04:02] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.21, 4.85, 3.87 [03:05:43] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 2.95, 2.99, 2.27 [03:06:00] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.88, 3.68, 3.55 [03:07:57] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.89, 2.99, 3.30 [03:08:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.95, 8.47, 10.10 [03:18:16] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.03, 11.28, 10.84 [03:20:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.09, 11.06, 10.82 [03:23:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.63, 3.02 [03:23:06] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.20, 11.25, 10.44 [03:24:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.69, 3.70, 3.24 [03:25:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.16, 11.12, 10.50 [03:26:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.41, 3.82, 3.36 [03:28:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.16, 4.66, 3.72 [03:28:59] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.43, 9.79, 10.10 [03:29:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.62, 3.86, 3.00 [03:30:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.16, 3.83, 3.54 [03:31:25] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.70, 3.88, 3.12 [03:32:16] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.26, 9.06, 10.01 [03:32:23] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 5.31, 3.58, 2.65 [03:32:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.01, 2.92, 3.25 [03:34:18] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 7.35, 4.19, 2.87 [03:34:21] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.19, 3.48, 2.73 [03:36:15] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.88, 3.52, 2.78 [03:36:20] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.01, 2.89, 2.60 [03:37:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.26, 3.54, 3.19 [03:39:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.02, 3.32, 3.15 [03:39:42] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.04, 11.07, 10.38 [03:40:08] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.17, 3.88, 3.05 [03:40:30] PROBLEM - gluster122 Current Load on gluster122 is WARNING: WARNING - load average: 3.45, 3.16, 2.61 [03:42:05] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.55, 2.90, 2.79 [03:42:29] RECOVERY - gluster122 Current Load on gluster122 is OK: OK - load average: 2.45, 2.81, 2.55 [03:43:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.01, 10.42, 10.36 [03:45:35] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.31, 10.87, 10.51 [03:48:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.57, 3.33 [03:50:12] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.72, 4.06, 3.52 [03:54:03] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.41, 3.89, 3.64 [03:55:23] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.64, 11.91, 11.26 [03:56:16] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.77, 10.60, 10.13 [03:57:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.79, 3.71, 4.00 [03:57:21] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.98, 12.41, 11.50 [03:59:19] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.57, 11.62, 11.34 [03:59:48] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.44, 3.91, 3.68 [04:00:16] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.02, 10.20, 10.10 [04:01:44] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.74, 3.42, 3.52 [04:03:39] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.77, 2.84, 3.30 [04:04:15] PROBLEM - wiki.nj.cn.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.nj.cn.eu.org All nameservers failed to answer the query. [04:04:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 3.64, 4.09, 3.18 [04:07:09] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.96, 11.16, 11.00 [04:08:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.10, 3.72, 3.26 [04:09:07] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.97, 9.87, 10.56 [04:10:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.56, 2.92, 3.02 [04:11:04] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.04, 11.21, 10.94 [04:13:02] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.23, 11.03, 10.94 [04:13:02] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.86, 2.69, 3.23 [04:16:57] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.00, 8.70, 10.03 [04:23:39] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 4.16, 3.40, 2.58 [04:24:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.21, 3.69, 3.25 [04:25:38] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.63, 2.72, 2.42 [04:26:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.43, 3.55, 3.25 [04:28:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.09, 3.38, 3.22 [04:34:02] RECOVERY - wiki.nj.cn.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.nj.cn.eu.org reverse DNS resolves to cp23.miraheze.org - CNAME OK [05:57:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 2.88, 2.28 [05:57:50] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 5.10, 3.59, 2.46 [05:59:48] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.84, 3.44, 2.55 [06:01:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.44, 3.28, 2.56 [06:01:47] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 6.89, 4.67, 3.10 [06:05:02] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.75, 3.02, 2.61 [06:05:44] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 2.58, 3.77, 3.12 [06:08:03] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.43, 3.35, 2.34 [06:10:03] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.61, 2.74, 2.23 [06:11:39] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.92, 3.21, 3.08 [06:16:03] [02ManageWiki] 07AgentIsai opened pull request 03#370: Prevent deletion of global wiki - 13https://github.com/miraheze/ManageWiki/pull/370 [06:19:01] miraheze/ManageWiki - AgentIsai the build passed. [06:25:30] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.52, 3.54, 2.37 [06:27:59] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 3.81, 4.50, 2.55 [06:28:45] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 2.74, 3.63, 2.27 [06:29:53] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.49, 4.06, 2.83 [06:29:58] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.67, 3.12, 2.27 [06:30:44] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.24, 2.74, 2.10 [06:31:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.99, 2.98, 2.65 [06:31:48] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.32, 3.16, 2.64 [06:54:56] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.91, 3.52, 2.79 [07:00:49] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.84, 3.46, 3.22 [07:02:47] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.76, 2.53, 2.91 [07:24:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.69, 2.89, 2.35 [07:26:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.01, 3.79, 2.73 [07:28:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.63, 3.33, 2.69 [07:48:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.68, 3.09 [07:50:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.85, 3.37, 3.04 [07:58:03] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.38, 4.24, 3.50 [07:59:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.04, 3.73, 3.40 [08:07:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.56, 2.95, 3.24 [08:21:40] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.1402717829 secs [08:45:40] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset 0.08618789911 secs [09:00:19] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 9.91, 6.16, 3.76 [09:04:16] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.98, 3.64, 3.25 [09:06:15] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.32, 3.00, 3.08 [09:28:03] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.42, 3.02, 1.60 [09:28:59] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 8.54, 4.82, 3.37 [09:29:59] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.16, 3.56, 2.87 [09:32:03] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.49, 3.51, 2.15 [09:32:59] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.63, 3.54, 3.21 [09:33:51] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.60, 3.30, 3.00 [09:34:03] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.54, 3.13, 2.18 [09:34:59] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.23, 2.78, 2.97 [09:45:24] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.80, 3.46, 2.11 [09:47:23] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.53, 3.45, 2.27 [09:48:59] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.72, 3.13, 2.84 [09:49:22] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.10, 2.64, 2.12 [09:50:59] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.04, 2.86, 2.79 [09:53:16] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.13, 3.45, 2.38 [09:55:48] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 27.97, 14.33, 7.55 [09:57:11] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.46, 3.34, 2.63 [10:02:41] PROBLEM - test131 MediaWiki Rendering on test131 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [10:03:48] PROBLEM - test131 PowerDNS Recursor on test131 is CRITICAL: CRITICAL - Plugin timed out while executing system call [10:05:45] RECOVERY - test131 PowerDNS Recursor on test131 is OK: DNS OK: 0.678 seconds response time. miraheze.org returns 109.228.51.216,217.174.247.33,2a00:da00:1800:326::1,2a00:da00:1800:328::1 [10:06:48] RECOVERY - test131 MediaWiki Rendering on test131 is OK: HTTP OK: HTTP/1.1 200 OK - 8191 bytes in 0.652 second response time [10:35:21] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 1.49, 1.45, 3.99 [10:39:18] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 1.22, 1.24, 3.31 [10:47:07] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 10.26, 4.58, 2.63 [10:53:05] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 1.33, 3.92, 3.16 [10:55:05] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.76, 2.84, 2.85 [11:29:53] PROBLEM - cp23 Current Load on cp23 is CRITICAL: CRITICAL - load average: 4.12, 4.18, 2.61 [11:31:53] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.45, 3.06, 2.38 [11:49:25] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.56, 3.75, 2.79 [11:51:35] PROBLEM - test131 Current Load on test131 is CRITICAL: CRITICAL - load average: 5.07, 3.20, 2.13 [11:53:02] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.33, 3.87, 3.06 [11:55:02] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.82, 3.83, 3.14 [11:55:32] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.84, 3.40, 2.48 [11:59:02] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.03, 2.92, 2.93 [11:59:53] PROBLEM - cp23 Current Load on cp23 is WARNING: WARNING - load average: 3.81, 2.96, 2.31 [12:01:25] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.92, 3.37, 3.31 [12:01:53] RECOVERY - cp23 Current Load on cp23 is OK: OK - load average: 1.70, 2.55, 2.24 [12:21:15] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 7.51, 4.02, 2.65 [12:22:00] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/1a105aa9097c [12:22:01] [02miraheze/puppet] 07paladox 031a105aa - swift: set con_timeout for proxy [12:22:04] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [12:22:06] [02puppet] 07paladox opened pull request 03#2973: swift: set con_timeout for proxy - 13https://github.com/miraheze/puppet/pull/2973 [12:23:13] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.07, 3.69, 2.71 [12:27:08] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.77, 2.48, 2.47 [12:28:35] [02puppet] 07paladox synchronize pull request 03#2973: swift: set con_timeout for proxy - 13https://github.com/miraheze/puppet/pull/2973 [12:28:36] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1a105aa9097c...96bf41a0983c [12:28:39] [02miraheze/puppet] 07paladox 0396bf41a - Update proxy-server.conf.erb [12:31:05] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 3.88, 2.85, 2.02 [12:31:58] PROBLEM - swiftproxy131 HTTPS on swiftproxy131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 500 Internal Server Error [12:32:03] PROBLEM - swiftproxy131 HTTP on swiftproxy131 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host: HTTP/1.1 500 Internal Server Error [12:32:05] PROBLEM - swiftproxy111 HTTPS on swiftproxy111 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host on port 443: HTTP/1.1 500 Internal Server Error [12:32:46] PROBLEM - swiftproxy111 HTTP on swiftproxy111 is CRITICAL: HTTP CRITICAL - Invalid HTTP response received from host: HTTP/1.1 500 Internal Server Error [12:33:05] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.65, 2.82, 2.11 [12:35:48] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.71, 3.31, 2.47 [12:37:47] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.05, 2.42, 2.24 [12:44:16] [02puppet] 07paladox synchronize pull request 03#2973: swift: set con_timeout for proxy - 13https://github.com/miraheze/puppet/pull/2973 [12:44:18] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/96bf41a0983c...3419c0313a36 [12:44:21] [02miraheze/puppet] 07paladox 033419c03 - Update proxy-server.conf.erb [12:45:58] RECOVERY - swiftproxy131 HTTPS on swiftproxy131 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 367 bytes in 0.038 second response time [12:46:03] RECOVERY - swiftproxy131 HTTP on swiftproxy131 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 400 bytes in 0.024 second response time [12:46:05] RECOVERY - swiftproxy111 HTTPS on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 367 bytes in 0.024 second response time [12:46:45] RECOVERY - swiftproxy111 HTTP on swiftproxy111 is OK: HTTP OK: Status line output matched "HTTP/1.1 404" - 400 bytes in 0.019 second response time [13:09:10] [02puppet] 07paladox closed pull request 03#2973: swift: set con_timeout for proxy - 13https://github.com/miraheze/puppet/pull/2973 [13:09:11] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [13:09:13] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [13:09:14] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/7b5fab20737f...89366b832167 [13:09:16] [02miraheze/puppet] 07paladox 0389366b8 - swift: set con_timeout for proxy (#2973) [13:15:34] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.59, 3.32, 2.28 [13:17:29] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.61, 2.98, 2.27 [13:25:32] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/a2b7edeea358 [13:25:35] [02miraheze/mw-config] 07paladox 03a2b7ede - Switching wikis beginning with d to swift [13:25:36] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [13:25:39] [02mw-config] 07paladox opened pull request 03#4953: Switching wikis beginning with d to swift - 13https://github.com/miraheze/mw-config/pull/4953 [13:25:44] [02mw-config] 07paladox closed pull request 03#4953: Switching wikis beginning with d to swift - 13https://github.com/miraheze/mw-config/pull/4953 [13:25:46] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/2bdb05d04236...192a16de1fcb [13:25:49] [02miraheze/mw-config] 07paladox 03192a16d - Switching wikis beginning with d to swift (#4953) [13:25:51] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [13:25:54] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [13:26:04] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [13:26:08] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:26:13] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 9s [13:26:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:26:26] !log [paladox@mwtask141] starting deploy of {'config': True} to all [13:26:32] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [13:26:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:26:33] !log [paladox@mwtask141] finished deploy of {'config': True} to all - SUCCESS in 7s [13:26:34] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 2s [13:26:40] !log [paladox@test131] starting deploy of {'config': True} to all [13:26:40] miraheze/mw-config - paladox the build passed. [13:26:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:26:41] !log [paladox@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [13:26:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:26:48] miraheze/mw-config - paladox the build passed. [13:26:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:26:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:27:03] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [13:31:05] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/6347041aa502 [13:31:06] [02miraheze/puppet] 07paladox 036347041 - swift proxy: Set logrotate for nginx to 2 [13:31:09] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [13:31:12] [02puppet] 07paladox opened pull request 03#2974: swift proxy: Set logrotate for nginx to 2 - 13https://github.com/miraheze/puppet/pull/2974 [13:31:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/6347041aa502...9f529d32b20a [13:31:33] [02miraheze/puppet] 07paladox 039f529d3 - Update swiftproxy131.yaml [13:31:36] [02puppet] 07paladox synchronize pull request 03#2974: swift proxy: Set logrotate for nginx to 2 - 13https://github.com/miraheze/puppet/pull/2974 [13:31:42] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/9f529d32b20a...06fab7473331 [13:31:45] [02miraheze/puppet] 07paladox 0306fab74 - Update swiftproxy131.yaml [13:31:46] [02puppet] 07paladox synchronize pull request 03#2974: swift proxy: Set logrotate for nginx to 2 - 13https://github.com/miraheze/puppet/pull/2974 [13:32:05] [02puppet] 07paladox closed pull request 03#2974: swift proxy: Set logrotate for nginx to 2 - 13https://github.com/miraheze/puppet/pull/2974 [13:32:06] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [13:32:09] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/puppet/compare/89366b832167...205073ad98cd [13:32:11] [02miraheze/puppet] 07paladox 03205073a - swift proxy: Set logrotate for nginx to 2 (#2974) [13:32:13] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [13:32:59] [02puppet] 07paladox closed pull request 03#2955: matomo: upgrade to 4.12.3 - 13https://github.com/miraheze/puppet/pull/2955 [13:33:01] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/205073ad98cd...8acbc1e0a54b [13:33:04] [02miraheze/puppet] 07Universal-Omega 038acbc1e - matomo: upgrade to 4.12.3 (#2955) [13:33:05] [02miraheze/puppet] 07paladox deleted branch 03matomo-4.12.3 [13:33:07] [02puppet] 07paladox deleted branch 03matomo-4.12.3 - 13https://github.com/miraheze/puppet [13:54:40] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.69, 4.06, 2.74 [14:00:40] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.68, 3.86, 3.05 [14:02:40] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.73, 3.03, 2.84 [14:03:48] PROBLEM - cp22 Current Load on cp22 is CRITICAL: CRITICAL - load average: 4.08, 2.80, 1.95 [14:05:47] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 1.22, 2.12, 1.81 [14:22:11] PROBLEM - apeirology.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - apeirology.com All nameservers failed to answer the query. [14:51:22] RECOVERY - apeirology.com - reverse DNS on sslhost is OK: SSL OK - apeirology.com reverse DNS resolves to cp23.miraheze.org - NS RECORDS OK [15:24:51] [02puppet] 07Universal-Omega closed pull request 03#2940: matomo: deny access to proxy - 13https://github.com/miraheze/puppet/pull/2940 [15:24:54] [02miraheze/puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [15:24:56] [02puppet] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/puppet [15:44:22] PROBLEM - cp22 Current Load on cp22 is WARNING: WARNING - load average: 3.46, 2.86, 2.34 [15:46:19] RECOVERY - cp22 Current Load on cp22 is OK: OK - load average: 0.84, 2.13, 2.14 [15:52:01] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.3622151911 secs [16:08:01] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.02232393622 secs [16:18:25] [02miraheze/mediawiki] 07paladox pushed 031 commit to 03REL1_38 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/59510770d10c...9087a430b2c9 [16:18:26] [02miraheze/mediawiki] 07paladox 039087a43 - Update WikiSEO [16:20:01] !log [paladox@mwtask141] starting deploy of {'pull': 'world', 'world': True, 'l10n': True} to all [16:20:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:20:19] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.85, 3.39, 2.79 [16:22:16] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 3.18, 3.08, 2.73 [16:26:04] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.58, 3.19, 2.74 [16:32:04] RECOVERY - test131 Current Load on test131 is OK: OK - load average: 2.43, 2.90, 2.78 [16:37:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.04, 10.28, 9.35 [16:37:25] !log [paladox@mwtask141] finished deploy of {'pull': 'world', 'world': True, 'l10n': True} to all - SUCCESS in 1044s [16:37:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:38:27] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.47, 3.24, 2.56 [16:39:15] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.31, 8.89, 8.95 [16:40:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.47, 2.98, 2.55 [16:42:16] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/a0aa7ef3620b [16:42:17] [02miraheze/puppet] 07paladox 03a0aa7ef - jobrunner: increase default memory limit to 300M [16:42:18] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [16:42:20] [02puppet] 07paladox opened pull request 03#2975: jobrunner: increase default memory limit to 300M - 13https://github.com/miraheze/puppet/pull/2975 [16:44:51] [02puppet] 07paladox synchronize pull request 03#2975: jobrunner: increase default memory limit to 300M - 13https://github.com/miraheze/puppet/pull/2975 [16:44:54] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a0aa7ef3620b...1f864d67b35c [16:44:55] [02miraheze/puppet] 07paladox 031f864d6 - Update jobrunner.json.erb [16:47:22] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1f864d67b35c...85e57b1106a2 [16:47:23] [02miraheze/puppet] 07paladox 0385e57b1 - Update jobrunner-hi.json.erb [16:47:26] [02puppet] 07paladox synchronize pull request 03#2975: jobrunner: increase default memory limit to 300M - 13https://github.com/miraheze/puppet/pull/2975 [16:47:45] [02puppet] 07paladox edited pull request 03#2975: jobrunner: increase default memory limit to 300M - 13https://github.com/miraheze/puppet/pull/2975 [16:49:33] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 8.96, 4.09, 2.70 [16:51:29] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.54, 3.93, 2.83 [16:55:23] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.29, 3.28, 2.83 [16:55:25] PROBLEM - wiki.lu9.io - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.lu9.io. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:56:38] [02puppet] 07paladox synchronize pull request 03#2975: jobrunner: increase default memory limit to 300M - 13https://github.com/miraheze/puppet/pull/2975 [16:56:39] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/85e57b1106a2...17b6b13555da [16:56:42] [02miraheze/puppet] 07paladox 0317b6b13 - Update jobrunner-hi.json.erb [16:58:54] PROBLEM - test131 Current Load on test131 is WARNING: WARNING - load average: 3.66, 3.41, 3.10 [16:59:16]