[00:01:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1202555895 secs [00:04:16] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.08361583948 secs [00:05:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.09910213947 secs [00:20:18] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1385751069 secs [00:26:16] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1602132916 secs [00:30:33] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.04, 6.48, 4.85 [00:32:17] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.0947291553 secs [00:32:56] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zymonic.com All nameservers failed to answer the query. [00:36:31] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 4.95, 7.83, 6.22 [00:38:15] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.06939461827 secs [00:40:29] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 4.82, 6.44, 6.00 [01:00:16] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset -0.1145945489 secs [01:00:17] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset -0.1152637899 secs [01:02:57] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406166076660156 seconds [01:08:17] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.09158211946 secs [01:12:16] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.06858927011 secs [01:36:47] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/79478056f427 [01:36:50] [02miraheze/mw-config] 07paladox 037947805 - Set wgThumbnailEpoch [01:36:53] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [01:36:55] [02mw-config] 07paladox opened pull request 03#5201: Set wgThumbnailEpoch - 13https://github.com/miraheze/mw-config/pull/5201 [01:37:52] miraheze/mw-config - paladox the build passed. [01:38:01] [02mw-config] 07paladox synchronize pull request 03#5201: Set wgThumbnailEpoch - 13https://github.com/miraheze/mw-config/pull/5201 [01:38:02] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/79478056f427...8d4ea0169e52 [01:38:05] [02miraheze/mw-config] 07paladox 038d4ea01 - Update GlobalSettings.php [01:38:12] [02mw-config] 07paladox closed pull request 03#5201: Set wgThumbnailEpoch - 13https://github.com/miraheze/mw-config/pull/5201 [01:38:14] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/40e37fcfbeed...12ee50874155 [01:38:17] [02miraheze/mw-config] 07paladox 0312ee508 - Set wgThumbnailEpoch (#5201) [01:38:20] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [01:38:22] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://github.com/miraheze/mw-config [01:38:25] !log [paladox@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [01:38:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:38:32] !log [paladox@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 6s [01:38:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:38:48] !log [paladox@test131] starting deploy of {'pull': 'config', 'config': True} to all [01:38:49] !log [paladox@test131] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 1s [01:38:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:38:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:39:09] miraheze/mw-config - paladox the build passed. [01:39:14] miraheze/mw-config - paladox the build passed. [02:10:37] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [02:12:36] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [02:26:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.26, 3.47, 2.52 [02:28:15] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.20, 3.21, 2.55 [02:40:17] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.1126380563 secs [02:48:17] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset 0.08876737952 secs [03:03:17] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 10.02, 5.62, 3.53 [03:07:09] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.15, 3.78, 3.23 [03:09:05] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.48, 3.25, 3.09 [03:11:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.02, 9.24, 7.71 [03:13:35] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.15, 8.37, 7.58 [03:18:26] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.32, 4.84, 3.12 [03:20:16] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1850486696 secs [03:20:25] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 9.62, 6.69, 4.02 [03:22:24] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.86, 6.01, 4.14 [03:23:35] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.23, 9.61, 8.17 [03:25:35] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 10.00, 9.48, 8.28 [03:29:35] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.09, 10.87, 9.07 [03:31:35] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.88, 8.95, 8.59 [03:32:15] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.05150395632 secs [03:46:16] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset -0.1156331897 secs [03:48:15] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset -0.08043426275 secs [03:56:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.59, 3.02, 2.37 [03:58:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.27, 2.59, 2.29 [03:58:30] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.21, 11.37, 9.52 [04:00:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.21, 10.74, 9.53 [04:04:15] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.56, 10.33, 8.69 [04:06:09] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.11, 9.58, 8.60 [04:06:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.08, 9.96, 9.67 [04:24:15] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.95, 3.54, 2.48 [04:26:14] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.47, 3.70, 2.69 [04:28:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.08, 3.15, 2.61 [04:38:15] PROBLEM - cp32 NTP time on cp32 is WARNING: NTP WARNING: Offset 0.3171522617 secs [04:54:47] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.53, 5.62, 3.36 [04:56:46] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.01, 5.52, 3.61 [04:57:33] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.64, 3.51, 2.64 [04:59:29] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.48, 2.76, 2.46 [05:06:15] RECOVERY - cp32 NTP time on cp32 is OK: NTP OK: Offset -0.03683525324 secs [05:28:26] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.63, 10.22, 8.79 [05:30:25] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.78, 8.99, 8.51 [05:49:25] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:04:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.39, 10.86, 8.14 [06:06:00] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.41, 9.53, 7.98 [06:19:00] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [06:48:34] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:59:57] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2298952043 secs [07:08:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 9.07, 4.52, 2.49 [07:09:53] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [07:11:52] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [07:13:53] [02mw-config] 07ugochimobi opened pull request 03#5202: T10743: Add 'editblacklisted' user right for csydeswiki - 13https://github.com/miraheze/mw-config/pull/5202 [07:14:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.94, 3.10, 2.68 [07:29:57] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.02419996262 secs [07:58:04] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.30, 3.45, 2.31 [08:00:00] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 0.97, 2.58, 2.13 [08:08:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.57, 2.90, 1.95 [08:12:17] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.93, 7.05, 3.64 [08:12:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.63, 2.70, 2.14 [08:16:17] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 5.08, 6.38, 4.21 [08:17:18] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [08:27:38] PROBLEM - db142 Backups SQL on db142 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864216 seconds old and 1879 bytes [08:28:20] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [08:29:03] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.04, 4.07, 2.65 [08:30:47] RECOVERY - cp33 APT on cp33 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [08:32:55] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 1.74, 3.59, 2.83 [08:34:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.58, 2.87, 2.65 [08:46:53] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [08:51:30] !log [alex@mwtask141] sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=sagan4betawiki (END - exit=0) [08:51:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:51:39] !log [alex@mwtask141] starting deploy of {'files': '../mediawiki/w/extensions/SemanticMediaWiki/.smw.json'} to all [08:51:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:51:50] !log [alex@mwtask141] finished deploy of {'files': '../mediawiki/w/extensions/SemanticMediaWiki/.smw.json'} to all - SUCCESS in 11s [08:51:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:00:32] [02mw-config] 07redbluegreenhat closed pull request 03#5202: T10743: Add 'editblacklisted' user right for csydeswiki - 13https://github.com/miraheze/mw-config/pull/5202 [09:00:33] [02miraheze/mw-config] 07redbluegreenhat pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/12ee50874155...5e5c3170a565 [09:00:35] [02miraheze/mw-config] 07ugochimobi 035e5c317 - T10743: Add 'editblacklisted' user right for csydeswiki (#5202) [09:01:22] !log [alex@mwtask141] starting deploy of {'pull': 'config', 'config': True} to all [09:01:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:01:30] !log [alex@mwtask141] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 7s [09:01:30] miraheze/mw-config - redbluegreenhat the build passed. [09:01:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:10:29] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 16.86, 6.51, 3.00 [09:10:38] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [09:12:37] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [09:16:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.77, 3.00, 2.63 [09:18:16] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1310886741 secs [09:20:17] PROBLEM - cp22 NTP time on cp22 is WARNING: NTP WARNING: Offset 0.2376813591 secs [09:27:40] !log [@test131] starting deploy of {'config': True} to all [09:27:41] !log [@test131] finished deploy of {'config': True} to all - SUCCESS in 0s [09:27:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:27:49] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:28:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.24, 3.05, 1.69 [09:30:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.41, 2.37, 1.60 [09:30:15] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.0888235867 secs [09:38:17] RECOVERY - cp22 NTP time on cp22 is OK: NTP OK: Offset -0.02151548862 secs [10:58:14] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.77, 3.16, 1.87 [11:00:14] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.52, 2.43, 1.75 [11:06:16] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1207801998 secs [11:08:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.77, 2.67, 1.59 [11:09:53] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:10:42] [02miraheze/landing] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/landing/compare/c496b3bd9827...3f36e053d0ad [11:10:43] [02miraheze/landing] 07translatewiki 033f36e05 - Localisation updates from https://translatewiki.net. [11:10:44] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±5] 13https://github.com/miraheze/MirahezeMagic/compare/364489d2763f...0d045376e643 [11:10:46] [02miraheze/MirahezeMagic] 07translatewiki 030d04537 - Localisation updates from https://translatewiki.net. [11:11:36] miraheze/landing - translatewiki the build passed. [11:12:15] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.08707684278 secs [11:12:32] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 11.47, 5.07, 2.70 [11:14:50] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [11:16:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.21, 3.90, 2.88 [11:18:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.98, 2.94, 2.65 [11:19:27] miraheze/MirahezeMagic - translatewiki the build passed. [11:39:36] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [11:40:26] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 6.06, 3.92, 2.58 [11:44:38] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [11:46:26] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 1.81, 3.95, 3.22 [11:47:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/da11aa0a8a34...22da8aa6ae14 [11:47:36] [02miraheze/ssl] 07MirahezeSSLBot 0322da8aa - Bot: Add SSL cert for studio.niuboss123.com [11:48:26] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.15, 3.09, 3.00 [11:49:44] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/22da8aa6ae14...33a1c931751a [11:49:45] [02miraheze/ssl] 07MirahezeSSLBot 0333a1c93 - Bot: Add SSL cert for elephants.ggreig.com [11:51:10] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/33a1c931751a...83198100ba6b [11:51:13] [02miraheze/ssl] 07MirahezeSSLBot 038319810 - Bot: Add SSL cert for wiki.theinverse.co.uk [11:51:17] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/a8b32e54d633...349a88ba1fb7 [11:51:19] [02miraheze/dns] 07Reception123 03349a88b - add dodgecircle.com zone [11:53:14] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.96, 7.41, 4.75 [11:53:47] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.2078153491 secs [11:55:35] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/83198100ba6b...d59b6c599d67 [11:55:37] [02miraheze/ssl] 07MirahezeSSLBot 03d59b6c5 - Bot: Add SSL cert for dodgecircle.com [11:55:52] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.33, 2.71, 1.78 [11:57:11] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 2.28, 6.39, 5.10 [11:59:51] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.15, 3.64, 2.54 [12:00:54] PROBLEM - test131 Puppet on test131 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx] [12:01:50] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.62, 2.93, 2.41 [12:13:55] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.34, 11.16, 9.25 [12:14:09] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.03, 9.78, 8.42 [12:15:21] PROBLEM - wiki.trfurs.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.trfurs.net could not be found [12:16:07] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.67, 9.73, 8.57 [12:20:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.27, 11.00, 9.33 [12:22:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.90, 10.40, 9.31 [12:22:53] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset -0.009758740664 secs [12:23:49] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.08, 11.23, 10.52 [12:24:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.92, 9.71, 9.18 [12:27:34] PROBLEM - trfurs.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for trfurs.net could not be found [12:27:48] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.43, 9.97, 10.16 [12:32:22] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zymonic.com All nameservers failed to answer the query. [12:40:16] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 2.87, 5.02, 3.32 [12:44:13] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.12, 3.58, 3.12 [12:46:12] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 0.96, 2.69, 2.84 [12:51:49] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [12:59:26] RECOVERY - test131 Puppet on test131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [13:01:41] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.403240442276001 seconds [13:09:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 1.66, 4.21, 3.07 [13:11:50] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 2.77, 3.68, 3.00 [13:12:42] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 12.54, 6.67, 3.67 [13:13:48] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.68, 2.97, 2.82 [13:16:42] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 5.67, 7.47, 4.78 [13:18:42] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.07, 5.16, 4.26 [13:21:09] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:50:28] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [13:56:48] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 4.60, 3.52, 2.22 [13:57:37] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [13:58:47] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.07, 3.09, 2.23 [13:59:39] RECOVERY - cp33 APT on cp33 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [14:02:23] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.43, 10.20, 9.35 [14:04:14] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.75, 9.67, 9.24 [14:06:08] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.96, 10.56, 9.31 [14:08:11] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.55, 11.10, 9.89 [14:12:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.46, 11.98, 10.58 [14:13:46] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.71, 9.85, 9.55 [14:20:06] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.24, 11.91, 10.86 [14:22:06] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.99, 11.57, 10.87 [14:22:23] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.08, 11.64, 10.45 [14:24:17] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.42, 10.98, 10.37 [14:26:12] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 5.79, 9.23, 9.80 [14:28:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.35, 7.82, 9.59 [14:41:56] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.66, 10.66, 9.74 [14:42:47] RECOVERY - wiki.trfurs.net - reverse DNS on sslhost is OK: SSL OK - wiki.trfurs.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [14:43:55] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.69, 9.62, 9.47 [14:58:20] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.49, 3.89, 3.21 [14:59:03] !log graylog121: install mongodb-org-shell [14:59:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [15:00:19] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.49, 3.07, 3.00 [15:07:16] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 4.00, 3.24, 2.14 [15:08:55] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+2/-0/±19] 13https://github.com/miraheze/puppet/compare/5b50776eba31...4dd5626cd686 [15:08:58] [02miraheze/puppet] 07paladox 034dd5626 - mongodb: update module to 4.2.0 [15:09:14] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.48, 2.54, 2.02 [15:11:48] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/73ad6ec3dffb [15:11:51] [02miraheze/puppet] 07paladox 0373ad6ec - graylog: upgrade MongoDB and graylog to v5 [15:11:52] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [15:11:54] [02puppet] 07paladox opened pull request 03#3193: graylog: upgrade MongoDB and graylog to v5 - 13https://github.com/miraheze/puppet/pull/3193 [15:11:58] [02puppet] 07paladox closed pull request 03#3193: graylog: upgrade MongoDB and graylog to v5 - 13https://github.com/miraheze/puppet/pull/3193 [15:12:00] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [15:12:02] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [15:12:03] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/4dd5626cd686...1de2fd70de10 [15:12:06] [02miraheze/puppet] 07paladox 031de2fd7 - graylog: upgrade MongoDB and graylog to v5 (#3193) [15:19:56] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:31:26] PROBLEM - graylog121 Puppet on graylog121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Mongodb_conn_validator[mongodb] [15:33:10] PROBLEM - graylog121 HTTPS on graylog121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.012 second response time [15:35:12] RECOVERY - graylog121 HTTPS on graylog121 is OK: HTTP OK: HTTP/1.1 200 OK - 1367 bytes in 1.858 second response time [15:35:24] RECOVERY - graylog121 Puppet on graylog121 is OK: OK: Puppet is currently enabled, last run 54 seconds ago with 0 failures [15:39:12] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 7.88, 5.17, 2.30 [15:42:27] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.74, 10.41, 9.38 [15:43:12] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.85, 3.74, 2.34 [15:44:26] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.30, 9.70, 9.26 [15:47:12] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 2.63, 3.23, 2.47 [15:49:29] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [15:51:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.39, 9.32, 8.37 [15:53:19] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.39, 8.90, 8.33 [15:55:11] PROBLEM - graylog121 Puppet on graylog121 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Mongodb_conn_validator[mongodb] [15:56:47] PROBLEM - cp33 APT on cp33 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [15:57:53] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 6.82, 4.48, 2.96 [15:59:08] RECOVERY - cp33 APT on cp33 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [16:01:51] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.93, 3.40, 2.88 [16:02:18] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.85, 10.30, 9.75 [16:04:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.43, 9.99, 9.71 [16:11:32] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1de2fd70de10...adc115520d0d [16:11:34] [02miraheze/puppet] 07paladox 03adc1155 - Revert "graylog: upgrade MongoDB and graylog to v5 (#3193)" [16:12:42] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 11.22, 6.56, 3.50 [16:16:42] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 3.61, 6.35, 4.20 [16:17:10] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.43, 10.07, 9.82 [16:17:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.80, 10.77, 9.72 [16:21:08] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.06, 11.30, 10.35 [16:21:46] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.98, 11.29, 10.11 [16:22:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-2/±19] 13https://github.com/miraheze/puppet/compare/adc115520d0d...c25b3d2bc3cb [16:22:27] [02miraheze/puppet] 07paladox 03c25b3d2 - Revert "mongodb: update module to 4.2.0" [16:23:08] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.16, 10.49, 10.18 [16:23:41] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.91, 9.97, 9.77 [16:25:07] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.16, 10.12, 10.09 [16:25:13] RECOVERY - graylog121 Puppet on graylog121 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [16:25:41] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: CRITICAL - load average: 8.22, 4.50, 3.18 [16:29:47] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.46, 3.75, 3.01 [16:31:10] PROBLEM - graylog121 HTTPS on graylog121 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.011 second response time [16:31:22] PROBLEM - graylog121 Current Load on graylog121 is WARNING: WARNING - load average: 2.15, 3.50, 3.25 [16:31:47] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.07, 3.11, 2.86 [16:33:16] RECOVERY - graylog121 Current Load on graylog121 is OK: OK - load average: 1.96, 2.94, 3.07 [16:34:23] [02dns] 07paladox created branch 03paladox-patch-2 - 13https://github.com/miraheze/dns [16:34:26] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/1769d7af84cd [16:34:28] [02miraheze/dns] 07paladox 031769d7a - Add graylog131 to dns [16:34:31] [02dns] 07paladox opened pull request 03#404: Add graylog131 to dns - 13https://github.com/miraheze/dns/pull/404 [16:34:33] [02dns] 07paladox closed pull request 03#404: Add graylog131 to dns - 13https://github.com/miraheze/dns/pull/404 [16:34:36] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/349a88ba1fb7...4fef87335fba [16:34:38] [02miraheze/dns] 07paladox 034fef873 - Add graylog131 to dns (#404) [16:34:39] [02dns] 07paladox deleted branch 03paladox-patch-2 - 13https://github.com/miraheze/dns [16:34:40] [02miraheze/dns] 07paladox deleted branch 03paladox-patch-2 [16:38:55] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [16:39:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.04, 10.11, 9.90 [16:39:01] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.99, 3.76, 2.28 [16:40:53] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [16:40:59] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.21, 11.18, 10.34 [16:42:58] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 2.12, 3.11, 2.37 [16:42:58] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 11.16, 11.40, 10.54 [16:55:47] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.26, 5.04, 3.52 [16:56:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 15.49, 12.51, 11.34 [16:57:19] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 11.33, 10.33, 9.51 [16:57:47] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.10, 3.94, 3.30 [16:58:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.90, 10.88, 10.88 [16:59:19] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.69, 9.32, 9.24 [16:59:24] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+1/-0/±0] 13https://github.com/miraheze/puppet/commit/102cc4659c90 [16:59:26] [02miraheze/puppet] 07paladox 03102cc46 - Create graylog131.yaml [16:59:28] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [16:59:29] [02puppet] 07paladox opened pull request 03#3194: Create graylog131.yaml - 13https://github.com/miraheze/puppet/pull/3194 [16:59:47] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.71, 3.21, 3.11 [16:59:52] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/102cc4659c90...6bb0c044513d [16:59:55] [02miraheze/puppet] 07paladox 036bb0c04 - Update site.pp [16:59:57] [02puppet] 07paladox synchronize pull request 03#3194: Create graylog131.yaml - 13https://github.com/miraheze/puppet/pull/3194 [17:00:01] [02puppet] 07paladox edited pull request 03#3194: Install graylog131 - 13https://github.com/miraheze/puppet/pull/3194 [17:02:50] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.92, 9.02, 10.12 [17:04:05] [02puppet] 07paladox closed pull request 03#3194: Install graylog131 - 13https://github.com/miraheze/puppet/pull/3194 [17:04:06] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/puppet/compare/c25b3d2bc3cb...1bddbd6a08bc [17:04:09] [02miraheze/puppet] 07paladox 031bddbd6 - Install graylog131 (#3194) [17:04:10] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [17:04:12] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [17:08:30] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/4fef87335fba...3600bfff0974 [17:08:33] [02miraheze/dns] 07paladox 033600bff - Switch graylog.m.org to use graylog131 [17:09:25] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/1bddbd6a08bc...2478a86bca12 [17:09:28] [02miraheze/puppet] 07paladox 032478a86 - Switch graylog121 to graylog131 [17:13:38] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.59, 10.77, 10.38 [17:15:37] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.02, 10.15, 10.19 [17:19:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 14.30, 10.63, 9.55 [17:21:15] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.42, 9.45, 9.27 [17:22:10] PROBLEM - cp22 APT on cp22 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [17:24:06] RECOVERY - cp22 APT on cp22 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [17:24:27] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.70, 10.53, 10.23 [17:24:27] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 3.32, 3.57, 2.93 [17:24:29] PROBLEM - graylog131 Puppet on graylog131 is WARNING: WARNING: Puppet is currently disabled, message: paladox, last run 7 minutes ago with 0 failures [17:26:24] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 9.06, 9.66, 9.93 [17:26:24] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 1.93, 3.01, 2.80 [17:40:54] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.95, 10.43, 9.96 [17:44:48] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.59, 11.19, 10.41 [17:48:21] PROBLEM - db142 Current Load on db142 is CRITICAL: CRITICAL - load average: 8.09, 6.88, 4.49 [17:48:41] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.94, 9.92, 10.10 [17:50:13] RECOVERY - graylog131 Puppet on graylog131 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [17:50:21] PROBLEM - db142 Current Load on db142 is WARNING: WARNING - load average: 7.38, 7.28, 4.95 [17:52:21] RECOVERY - db142 Current Load on db142 is OK: OK - load average: 1.72, 5.21, 4.48 [17:52:45] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/b5363a0ed9ca [17:52:48] [02miraheze/puppet] 07paladox 03b5363a0 - graylog: set ignore_migration_failures [17:52:51] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [17:52:52] [02puppet] 07paladox opened pull request 03#3195: graylog: set ignore_migration_failures - 13https://github.com/miraheze/puppet/pull/3195 [17:52:57] [02puppet] 07paladox closed pull request 03#3195: graylog: set ignore_migration_failures - 13https://github.com/miraheze/puppet/pull/3195 [17:52:59] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [17:53:02] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/2478a86bca12...970e3b0b73d9 [17:53:04] [02miraheze/puppet] 07paladox 03970e3b0 - graylog: set ignore_migration_failures (#3195) [17:53:07] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [17:53:48] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-1/±0] 13https://github.com/miraheze/puppet/commit/a9761f8836fb [17:53:51] [02miraheze/puppet] 07paladox 03a9761f8 - Remove graylog121 [17:53:52] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [17:53:55] [02puppet] 07paladox opened pull request 03#3196: Remove graylog121 - 13https://github.com/miraheze/puppet/pull/3196 [17:54:31] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/a9761f8836fb...237c3be85571 [17:54:33] [02miraheze/puppet] 07paladox 03237c3be - Update site.pp [17:54:35] [02puppet] 07paladox synchronize pull request 03#3196: Remove graylog121 - 13https://github.com/miraheze/puppet/pull/3196 [17:54:37] [02puppet] 07paladox closed pull request 03#3196: Remove graylog121 - 13https://github.com/miraheze/puppet/pull/3196 [17:54:38] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [17:54:39] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [17:54:41] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-1/±1] 13https://github.com/miraheze/puppet/compare/970e3b0b73d9...ec57129e8214 [17:54:44] [02miraheze/puppet] 07paladox 03ec57129 - Remove graylog121 (#3196) [17:55:52] [02miraheze/dns] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/dns/compare/3600bfff0974...bbab8f542df8 [17:55:55] [02miraheze/dns] 07paladox 03bbab8f5 - Remove graylog121 from dns [17:58:00] [02miraheze/puppet] 07paladox pushed 032 commits to 03master [+2/-0/±20] 13https://github.com/miraheze/puppet/compare/ec57129e8214...434a8c7a572e [17:58:01] [02miraheze/puppet] 07paladox 0376ae1ed - Revert "Revert "mongodb: update module to 4.2.0"" [17:58:03] [02miraheze/puppet] 07paladox 03434a8c7 - Revert "Revert "graylog: upgrade MongoDB and graylog to v5 (#3193)"" [17:59:07] PROBLEM - graylog121 SSH on graylog121 is CRITICAL: connect to address 2a10:6740::6:305 and port 22: No route to host [17:59:12] PROBLEM - graylog121 Current Load on graylog121 is CRITICAL: connect to address 2a10:6740::6:305 port 5666: No route to hostconnect to host 2a10:6740::6:305 port 5666: No route to host [17:59:12] PROBLEM - graylog121 Disk Space on graylog121 is CRITICAL: connect to address 2a10:6740::6:305 port 5666: No route to hostconnect to host 2a10:6740::6:305 port 5666: No route to host [17:59:24] PROBLEM - ping6 on graylog121 is CRITICAL: CRITICAL - Destination Unreachable (2a10:6740::6:305) [17:59:27] PROBLEM - graylog121 ferm_active on graylog121 is CRITICAL: connect to address 2a10:6740::6:305 port 5666: No route to hostconnect to host 2a10:6740::6:305 port 5666: No route to host [17:59:45] PROBLEM - Host graylog121 is DOWN: CRITICAL - Destination Unreachable (2a10:6740::6:305) [17:59:45] PROBLEM - graylog121 NTP time on graylog121 is CRITICAL: connect to address 2a10:6740::6:305 port 5666: No route to hostconnect to host 2a10:6740::6:305 port 5666: No route to host [18:01:57] PROBLEM - graylog131 HTTPS on graylog131 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 295 bytes in 0.016 second response time [18:06:48] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/commit/0a4aefc7c7d2 [18:06:50] [02miraheze/puppet] 07paladox 030a4aefc - graylog: use built in java version [18:06:53] [02puppet] 07paladox created branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [18:06:55] [02puppet] 07paladox opened pull request 03#3197: graylog: use built in java version - 13https://github.com/miraheze/puppet/pull/3197 [18:08:51] PROBLEM - cp32 Current Load on cp32 is CRITICAL: CRITICAL - load average: 5.08, 3.57, 2.37 [18:09:56] RECOVERY - graylog131 HTTPS on graylog131 is OK: HTTP OK: HTTP/1.1 200 OK - 1567 bytes in 0.190 second response time [18:10:00] PROBLEM - cp32 APT on cp32 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds. [18:10:50] PROBLEM - cp32 Current Load on cp32 is WARNING: WARNING - load average: 3.65, 3.66, 2.55 [18:12:23] RECOVERY - cp32 APT on cp32 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [18:12:48] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 8.94, 4.90, 2.68 [18:14:46] RECOVERY - cp32 Current Load on cp32 is OK: OK - load average: 1.43, 2.77, 2.46 [18:18:31] [02puppet] 07paladox synchronize pull request 03#3197: graylog: use built in java version - 13https://github.com/miraheze/puppet/pull/3197 [18:18:33] [02miraheze/puppet] 07paladox pushed 031 commit to 03paladox-patch-5 [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/0a4aefc7c7d2...7ef6cc875317 [18:18:36] [02miraheze/puppet] 07paladox 037ef6cc8 - Update graylog-server-default [18:18:41] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 1.06, 3.07, 2.70 [18:18:43] [02puppet] 07paladox closed pull request 03#3197: graylog: use built in java version - 13https://github.com/miraheze/puppet/pull/3197 [18:18:44] [02miraheze/puppet] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/434a8c7a572e...04e2e5a5f85c [18:18:47] [02miraheze/puppet] 07paladox 0304e2e5a - graylog: use built in java version (#3197) [18:18:49] [02miraheze/puppet] 07paladox deleted branch 03paladox-patch-5 [18:18:50] [02puppet] 07paladox deleted branch 03paladox-patch-5 - 13https://github.com/miraheze/puppet [18:24:37] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 2.98, 4.25, 3.38 [18:25:36] PROBLEM - cp23 NTP time on cp23 is WARNING: NTP WARNING: Offset 0.1133568585 secs [18:26:11] PROBLEM - cp33 Current Load on cp33 is CRITICAL: CRITICAL - load average: 5.78, 3.63, 2.60 [18:26:32] PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 1.73, 3.42, 3.18 [18:27:32] RECOVERY - cp23 NTP time on cp23 is OK: NTP OK: Offset 0.08449405432 secs [18:28:11] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.81, 3.25, 2.58 [18:28:27] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 1.26, 2.70, 2.94 [18:49:15] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [19:00:16] PROBLEM - cp33 Current Load on cp33 is WARNING: WARNING - load average: 2.32, 3.62, 2.84 [19:02:16] RECOVERY - cp33 Current Load on cp33 is OK: OK - load average: 2.18, 3.17, 2.77 [19:02:32] !log delete graylog121 on cloud12 [19:02:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:06:48] [02miraheze/dns] 07paladox pushed 031 commit to 03paladox-patch-2 [+0/-0/±1] 13https://github.com/miraheze/dns/commit/f4daa253829e [19:06:49] [02miraheze/dns] 07paladox 03f4daa25 - Add matomo121 to dns [19:06:51]