[00:05:48] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.28, 6.92, 5.44 [00:07:53] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.52, 6.30, 5.40 [00:14:13] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.49, 1.71, 1.33 [00:16:22] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.28, 1.56, 1.32 [00:31:49] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [00:33:39] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.50, 4.60, 2.96 [00:33:50] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.12, 6.16, 5.32 [00:35:48] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 5.03, 4.63, 3.17 [00:35:53] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.74, 5.96, 5.37 [00:45:40] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [00:55:01] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [01:00:41] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.17, 7.84, 6.59 [01:01:23] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 9.70, 8.04, 6.67 [01:02:53] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 9.27, 8.60, 7.05 [01:03:39] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.96, 7.43, 5.92 [01:08:58] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [01:11:44] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.45, 7.45, 7.48 [01:12:33] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.73, 7.63, 7.46 [01:18:19] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [01:19:10] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.50, 7.53, 7.40 [01:20:31] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.40, 5.84, 6.66 [01:20:57] PROBLEM - cp12 APT on cp12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [01:21:15] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 8.23, 7.16, 7.26 [01:22:16] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.27, 2.45, 1.74 [01:23:07] RECOVERY - cp12 APT on cp12 is OK: APT OK: 27 packages available for upgrade (0 critical updates). [01:24:27] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.21, 1.99, 1.67 [01:25:07] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.83, 7.21, 7.04 [01:28:42] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.97, 1.48, 1.54 [01:29:52] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.99, 7.47, 7.47 [01:31:48] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.15, 7.41, 6.27 [01:32:08] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [01:33:54] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.32, 7.55, 6.44 [01:34:30] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.05, 7.64, 7.34 [01:35:57] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.34, 7.21, 6.47 [01:36:43] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.43, 7.62, 7.38 [01:38:03] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.55, 6.73, 6.39 [01:38:26] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 5.28, 5.91, 6.78 [01:40:10] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.47, 5.90, 6.62 [01:40:26] !sre https://meta.miraheze.org/wiki/Special:RequestWikiQueue/18609 produces 502 Gateway [01:40:35] Hopefully just intermittent [01:41:17] Seems to be resolved, but load times are sluggish [01:41:18] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [01:41:40] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.22, 2.09, 1.65 [01:43:49] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.79, 1.89, 1.63 [01:44:49] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.82, 6.84, 6.84 [01:45:24] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.50, 8.22, 7.68 [01:46:54] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.27, 6.54, 6.75 [01:47:33] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.42, 7.88, 7.62 [01:48:00] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.17, 1.55, 1.55 [01:49:46] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.01, 8.03, 7.72 [01:51:56] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.63, 7.70, 7.65 [01:52:36] PROBLEM - cp12 Current Load on cp12 is CRITICAL: CRITICAL - load average: 2.55, 2.17, 1.79 [01:53:46] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.75, 6.85, 6.72 [01:54:58] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [01:56:48] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.45, 1.85, 1.76 [01:58:06] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.19, 7.35, 6.96 [02:00:12] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.71, 7.06, 6.90 [02:01:02] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 1.05, 1.42, 1.60 [02:01:32] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.24, 6.82, 6.68 [02:02:14] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.50, 6.64, 6.75 [02:02:36] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.46, 5.58, 6.62 [02:04:09] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [02:05:48] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.82, 6.04, 6.42 [02:14:16] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.58, 7.20, 6.93 [02:22:47] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.95, 6.50, 6.70 [02:38:32] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [02:45:04] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.72, 1.87, 1.50 [02:47:10] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.31, 1.28, 1.33 [02:47:14] PROBLEM - cp12 HTTP 4xx/5xx ERROR Rate on cp12 is CRITICAL: CRITICAL - NGINX Error Rate is 99% [02:47:53] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 51.222.25.132/cpweb, 2607:5300:205:200::1c30/cpweb [02:47:54] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 2 datacenters are down: 51.222.25.132/cpweb, 2607:5300:205:200::1c30/cpweb [02:48:03] PROBLEM - cp12 HTTPS on cp12 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 344 bytes in 0.326 second response time [02:48:23] PROBLEM - cp12 Varnish Backends on cp12 is WARNING: No backends detected. If this is an error, see readme.txt [02:59:47] PROBLEM - cp3 Current Load on cp3 is WARNING: WARNING - load average: 1.51, 1.87, 1.06 [03:01:59] RECOVERY - cp3 Current Load on cp3 is OK: OK - load average: 0.34, 1.32, 0.97 [03:08:37] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [03:22:20] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [03:45:26] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [04:22:46] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 12.24, 7.89, 6.23 [04:24:22] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 10.04, 7.85, 6.14 [04:39:29] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 5.48, 7.12, 7.33 [04:41:58] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 4.88, 7.31, 7.80 [04:43:43] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.03, 5.61, 6.68 [04:48:22] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.97, 4.76, 6.44 [05:01:09] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [05:16:48] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [05:23:39] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JGimm [05:23:41] [02miraheze/DataDump] 07Universal-Omega 033ac16c1 - Fix getting file name when downloading dumps on private wikis. [05:23:43] [02DataDump] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fhhKV [05:23:44] [02DataDump] 07Universal-Omega opened pull request 03#29: Fix getting file name when downloading dumps on private wikis. - 13https://git.io/JGims [05:24:44] miraheze/DataDump - Universal-Omega the build has errored. [05:30:26] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [05:33:34] [02DataDump] 07Universal-Omega commented on pull request 03#29: Fix getting file name when downloading dumps on private wikis. - 13https://git.io/JGisp [05:33:36] [02DataDump] 07Universal-Omega closed pull request 03#29: Fix getting file name when downloading dumps on private wikis. - 13https://git.io/JGims [05:33:38] [02DataDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fhhKV [05:33:40] [02miraheze/DataDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [05:38:41] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JGiZM [05:38:42] [02miraheze/DataDump] 07Universal-Omega 032fe8f8b - Set Content-Disposition header to correctly save file with filename [05:38:44] [02DataDump] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://git.io/fhhKV [05:38:45] [02DataDump] 07Universal-Omega opened pull request 03#30: Set Content-Disposition header to correctly save file with filename - 13https://git.io/JGiZy [05:39:29] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [05:39:43] miraheze/DataDump - Universal-Omega the build passed. [05:53:10] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [05:57:05] [02DataDump] 07Reception123 closed pull request 03#30: Set Content-Disposition header to correctly save file with filename - 13https://git.io/JGiZy [05:57:07] [02miraheze/DataDump] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JGiBx [05:57:08] [02miraheze/DataDump] 07Universal-Omega 03174d118 - Set Content-Disposition header to correctly save file with filename (#30) [05:57:57] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JGiRc [05:57:58] [02miraheze/mediawiki] 07Reception123 03794d233 - Update DataDump [05:58:01] [02DataDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/fhhKV [05:58:03] [02miraheze/DataDump] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [05:58:11] miraheze/DataDump - Reception123 the build passed. [06:02:10] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [06:03:55] !log [reception@jobrunner3] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki argobdpwiki /home/reception/argo_bdpfandomcom-20210603-history.xml --username-prefix=fandom:argo-bdp [06:03:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:05:28] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_35 [+0/-0/±1] 13https://git.io/JGiuW [06:05:29] [02miraheze/mediawiki] 07Reception123 03457cc1b - Update DataDump [06:15:55] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [06:25:04] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [06:37:23] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-4 [+0/-0/±1] 13https://git.io/JGiXc [06:37:25] [02miraheze/mw-config] 07Universal-Omega 037a3f639 - Set wgTimelineFontDirectory [06:37:26] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3 [06:37:28] [02mw-config] 07Universal-Omega opened pull request 03#3939: Set wgTimelineFontDirectory - 13https://git.io/JGiXW [06:38:21] miraheze/mw-config - Universal-Omega the build passed. [06:38:44] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [06:39:43] [02mw-config] 07Universal-Omega edited pull request 03#3939: Set wgTimelineFontDirectory - 13https://git.io/JGiXW [06:40:42] [02mw-config] 07Universal-Omega closed pull request 03#3939: Set wgTimelineFontDirectory - 13https://git.io/JGiXW [06:40:43] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03REL1_36 [+0/-0/±1] 13https://git.io/JGi1M [06:40:45] [02miraheze/mw-config] 07Universal-Omega 03ab6ff87 - Set wgTimelineFontDirectory (#3939) [06:40:46] [02mw-config] 07Universal-Omega synchronize pull request 03#3824: Update config for 1.36 - 13https://git.io/JYjbk [06:40:48] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 [06:40:49] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 - 13https://git.io/vbvb3 [06:41:00] PROBLEM - jobrunner4 Puppet on jobrunner4 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:41:07] PROBLEM - mw8 Puppet on mw8 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:41:43] miraheze/mw-config - Universal-Omega the build passed. [06:41:47] PROBLEM - mw11 Puppet on mw11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 2 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:42:08] PROBLEM - jobrunner3 Puppet on jobrunner3 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:42:17] PROBLEM - mw10 Puppet on mw10 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:43:06] PROBLEM - mw9 Puppet on mw9 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Exec[git_pull_MediaWiki core] [06:47:43] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [07:03:30] RECOVERY - mw10 Puppet on mw10 is OK: OK: Puppet is currently enabled, last run 13 seconds ago with 0 failures [07:04:18] RECOVERY - mw9 Puppet on mw9 is OK: OK: Puppet is currently enabled, last run 30 seconds ago with 0 failures [07:04:25] RECOVERY - mw8 Puppet on mw8 is OK: OK: Puppet is currently enabled, last run 46 seconds ago with 0 failures [07:04:31] RECOVERY - jobrunner4 Puppet on jobrunner4 is OK: OK: Puppet is currently enabled, last run 42 seconds ago with 0 failures [07:04:41] RECOVERY - mw11 Puppet on mw11 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [07:05:00] RECOVERY - jobrunner3 Puppet on jobrunner3 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [07:13:45] [02miraheze/DataDump] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JGiA9 [07:13:47] [02miraheze/DataDump] 07Universal-Omega 03972c224 - add `use MediaWiki\MediaWikiServices;` to fix fatal [07:14:38] miraheze/DataDump - Universal-Omega the build passed. [07:21:45] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [07:35:11] [02miraheze/services] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JGPIT [07:35:13] [02miraheze/services] 07MirahezeSSLBot 03f2613ec - BOT: Updating services config for wikis [07:37:29] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [07:51:35] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [08:14:34] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [08:28:18] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [08:50:57] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [08:58:05] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.65, 3.40, 2.21 [09:02:33] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 0.90, 2.69, 2.29 [09:18:31] PROBLEM - wiki.villagecollaborative.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.villagecollaborative.net could not be found [09:18:36] PROBLEM - datacrondatabase.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for datacrondatabase.com could not be found [09:18:42] PROBLEM - spiral.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for spiral.wiki could not be found [09:18:58] PROBLEM - tot.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tot.wiki could not be found [09:18:59] PROBLEM - miraheze.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.tk could not be found [09:19:07] PROBLEM - enc.for.uz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for enc.for.uz could not be found [09:19:07] PROBLEM - de.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for de.gyaanipedia.com could not be found [09:19:07] PROBLEM - www.permanentfuturelab.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.permanentfuturelab.wiki could not be found [09:19:11] PROBLEM - ping6 on dbbackup1 is CRITICAL: PING CRITICAL - Packet loss = 100% [09:19:12] PROBLEM - www.sdiy.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.sdiy.info could not be found [09:19:15] PROBLEM - isv.orain.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for isv.orain.org could not be found [09:19:21] PROBLEM - halloween.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for halloween.gyaanipedia.com could not be found [09:19:22] PROBLEM - wiki.grottocenter.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.grottocenter.org could not be found [09:19:36] PROBLEM - publictestwiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for publictestwiki.com could not be found [09:19:38] PROBLEM - en.famepedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.famepedia.org could not be found [09:19:39] PROBLEM - vise.dayid.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vise.dayid.org could not be found [09:19:41] PROBLEM - heavyironmodding.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for heavyironmodding.org could not be found [09:20:05] PROBLEM - permanentfuturelab.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for permanentfuturelab.wiki could not be found [09:20:17] PROBLEM - wiki.raghuveer.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.raghuveer.net could not be found [09:20:25] PROBLEM - ping6 on ns1 is CRITICAL: PING CRITICAL - Packet loss = 100% [09:20:26] PROBLEM - kk.uncyc.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for kk.uncyc.tk could not be found [09:20:30] PROBLEM - es.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for es.gyaanipedia.com could not be found [09:20:42] PROBLEM - wiki.meeusen.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.meeusen.net could not be found [09:20:43] PROBLEM - portalsofphereon.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for portalsofphereon.com could not be found [09:20:45] PROBLEM - rothwell-leeds.co.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rothwell-leeds.co.uk could not be found [09:20:51] PROBLEM - biblestrength.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for biblestrength.net could not be found [09:20:52] PROBLEM - miraheze.gq - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.gq could not be found [09:20:52] PROBLEM - guia.esporo.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for guia.esporo.net could not be found [09:20:53] PROBLEM - hi.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for hi.gyaanipedia.com could not be found [09:20:59] PROBLEM - www.trollpasta.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.trollpasta.com could not be found [09:21:02] PROBLEM - wiki.mxlinuxusers.de - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mxlinuxusers.de could not be found [09:21:03] PROBLEM - mrlove.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for mrlove.wiki could not be found [09:21:03] PROBLEM - wiki.fourta.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.fourta.org could not be found [09:21:09] PROBLEM - rupowerrangersfanon.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rupowerrangersfanon.tk could not be found [09:21:30] PROBLEM - johanloopmans.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for johanloopmans.nl could not be found [09:21:44] PROBLEM - wiki.vinesh.eu.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.vinesh.eu.org could not be found [09:21:47] PROBLEM - madzebrascience.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for madzebrascience.wiki could not be found [09:21:48] PROBLEM - wmworld.sktz.live - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wmworld.sktz.live could not be found [09:21:50] PROBLEM - www.highdeologywiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.highdeologywiki.com could not be found [09:21:51] PROBLEM - zh.internetpedia.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for zh.internetpedia.tk could not be found [09:21:52] PROBLEM - podpedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for podpedia.org could not be found [09:22:02] PROBLEM - www.johanloopmans.nl - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.johanloopmans.nl could not be found [09:22:09] PROBLEM - www.marinebiodiversitymatrix.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.marinebiodiversitymatrix.org could not be found [09:22:09] PROBLEM - www.rothwell-leeds.co.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.rothwell-leeds.co.uk could not be found [09:22:10] PROBLEM - www.tradwiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.tradwiki.org could not be found [09:22:23] PROBLEM - thelonsdalebattalion.co.uk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for thelonsdalebattalion.co.uk could not be found [09:22:31] PROBLEM - www.erikapedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.erikapedia.com could not be found [09:22:32] PROBLEM - savage-wiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for savage-wiki.com could not be found [09:22:42] PROBLEM - wiki.macc.nyc - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.macc.nyc could not be found [09:22:46] PROBLEM - tensegritywiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for tensegritywiki.com could not be found [09:22:59] PROBLEM - wiki.rebirthofthenight.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.rebirthofthenight.com could not be found [09:23:07] PROBLEM - trollpasta.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for trollpasta.com could not be found [09:23:11] PROBLEM - stablestate.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for stablestate.org could not be found [09:23:12] PROBLEM - miraheze.ml - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.ml could not be found [09:23:29] PROBLEM - n64brew.dev - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for n64brew.dev could not be found [09:23:42] PROBLEM - speleo.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for speleo.wiki could not be found [09:23:43] PROBLEM - egoish.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for egoish.org could not be found [09:23:44] PROBLEM - www.portalsofphereon.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.portalsofphereon.com could not be found [09:23:48] PROBLEM - infectowiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for infectowiki.com could not be found [09:23:49] PROBLEM - iceria.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for iceria.org could not be found [09:23:56] PROBLEM - commons.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for commons.gyaanipedia.com could not be found [09:23:58] PROBLEM - db12 Puppet on db12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Mount[/mnt/dbbackup1-c3] [09:24:06] PROBLEM - inourownwords.online - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for inourownwords.online could not be found [09:24:12] PROBLEM - chouverse.cludisciples.cyou - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for chouverse.cludisciples.cyou could not be found [09:24:15] PROBLEM - viileapedia.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for viileapedia.ga could not be found [09:24:16] PROBLEM - wikilukas.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikilukas.tk could not be found [09:24:18] PROBLEM - test2.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for test2.miraheze.org could not be found [09:24:19] PROBLEM - www.lukaibrisimovic.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.lukaibrisimovic.org could not be found [09:24:20] PROBLEM - marinebiodiversitymatrix.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for marinebiodiversitymatrix.org could not be found [09:24:24] PROBLEM - private.revi.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for private.revi.wiki could not be found [09:24:24] PROBLEM - allthetropes.orain.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for allthetropes.orain.org could not be found [09:24:25] PROBLEM - wlhmn.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wlhmn.tk could not be found [09:24:25] PROBLEM - wiki.worlduniversityandschool.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.worlduniversityandschool.org could not be found [09:24:25] PROBLEM - froggy.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for froggy.info could not be found [09:24:25] PROBLEM - vortekspedia.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for vortekspedia.tk could not be found [09:24:25] PROBLEM - animatedfeet.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for animatedfeet.miraheze.org could not be found [09:24:28] PROBLEM - wiki.zaoace.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.zaoace.com could not be found [09:24:31] PROBLEM - worldsanskrit.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for worldsanskrit.net could not be found [09:24:31] PROBLEM - wiki.mastodon.kr - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.mastodon.kr could not be found [09:24:36] PROBLEM - www.iceria.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.iceria.org could not be found [09:24:36] PROBLEM - www.wikilukas.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.wikilukas.tk could not be found [09:24:37] PROBLEM - wiki.qadrishattari.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.qadrishattari.xyz could not be found [09:24:38] PROBLEM - miraheze.ga - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for miraheze.ga could not be found [09:24:38] PROBLEM - archive.a2b2.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for archive.a2b2.org could not be found [09:24:40] PROBLEM - electrowiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for electrowiki.org could not be found [09:24:43] PROBLEM - wikipariksha.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wikipariksha.com could not be found [09:24:55] PROBLEM - munwiki.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for munwiki.info could not be found [09:25:02] PROBLEM - bharatwiki.online - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for bharatwiki.online could not be found [09:25:06] PROBLEM - orain.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for orain.org could not be found [09:25:06] PROBLEM - erikapedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for erikapedia.com could not be found [09:25:07] PROBLEM - wiki.conworlds.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.conworlds.org could not be found [09:25:11] PROBLEM - www.rangpurpedia.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.rangpurpedia.xyz could not be found [09:25:12] PROBLEM - runzeppelin.ru - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for runzeppelin.ru could not be found [09:25:12] PROBLEM - ndg.nenawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for ndg.nenawiki.org could not be found [09:25:24] PROBLEM - meta.gyaanipedia.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for meta.gyaanipedia.com could not be found [09:25:31] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [09:25:35] PROBLEM - monarchia.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for monarchia.wiki could not be found [09:25:35] PROBLEM - sdiy.info - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for sdiy.info could not be found [09:25:36] PROBLEM - rangpurpedia.xyz - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for rangpurpedia.xyz could not be found [09:25:37] PROBLEM - db11 Puppet on db11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Mount[/mnt/dbbackup1-c2] [09:25:58] RECOVERY - miraheze.tk - reverse DNS on sslhost is OK: rDNS OK - miraheze.tk reverse DNS resolves to cp13.miraheze.org [09:26:03] PROBLEM - db13 Puppet on db13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Mount[/mnt/dbbackup1-c4] [09:26:18] RECOVERY - de.gyaanipedia.com - reverse DNS on sslhost is OK: rDNS OK - de.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org [09:26:20] RECOVERY - wiki.grottocenter.org - reverse DNS on sslhost is OK: rDNS OK - wiki.grottocenter.org reverse DNS resolves to cp13.miraheze.org [09:26:34] RECOVERY - isv.orain.org - reverse DNS on sslhost is OK: rDNS OK - isv.orain.org reverse DNS resolves to cp13.miraheze.org [09:26:40] RECOVERY - publictestwiki.com - reverse DNS on sslhost is OK: rDNS OK - publictestwiki.com reverse DNS resolves to cp13.miraheze.org [09:26:44] paladox, Southparkfan: ping [09:27:00] I joined RN IRC Channel about the ping6 alerts [09:27:05] But cp12 not sure [09:27:07] PROBLEM - cyberlaw.ccdcoe.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cyberlaw.ccdcoe.org could not be found [09:27:08] PROBLEM - debilepedie.gq - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for debilepedie.gq could not be found [09:27:10] PROBLEM - cubashpedia.cf - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for cubashpedia.cf could not be found [09:27:18] RECOVERY - permanentfuturelab.wiki - reverse DNS on sslhost is OK: rDNS OK - permanentfuturelab.wiki reverse DNS resolves to cp13.miraheze.org [09:27:25] RECOVERY - wiki.raghuveer.net - reverse DNS on sslhost is OK: rDNS OK - wiki.raghuveer.net reverse DNS resolves to cp13.miraheze.org [09:27:28] RECOVERY - kk.uncyc.tk - reverse DNS on sslhost is OK: rDNS OK - kk.uncyc.tk reverse DNS resolves to cp13.miraheze.org [09:27:38] RECOVERY - ping6 on ns1 is OK: PING OK - Packet loss = 0%, RTA = 87.25 ms [09:27:44] RECOVERY - es.gyaanipedia.com - reverse DNS on sslhost is OK: rDNS OK - es.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org [09:27:46] RECOVERY - portalsofphereon.com - reverse DNS on sslhost is OK: rDNS OK - portalsofphereon.com reverse DNS resolves to cp13.miraheze.org [09:27:49] RECOVERY - wiki.meeusen.net - reverse DNS on sslhost is OK: rDNS OK - wiki.meeusen.net reverse DNS resolves to cp13.miraheze.org [09:27:53] RECOVERY - guia.esporo.net - reverse DNS on sslhost is OK: rDNS OK - guia.esporo.net reverse DNS resolves to cp13.miraheze.org [09:27:56] RECOVERY - hi.gyaanipedia.com - reverse DNS on sslhost is OK: rDNS OK - hi.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org [09:27:56] RECOVERY - rothwell-leeds.co.uk - reverse DNS on sslhost is OK: rDNS OK - rothwell-leeds.co.uk reverse DNS resolves to cp13.miraheze.org [09:27:59] RECOVERY - wiki.fourta.org - reverse DNS on sslhost is OK: rDNS OK - wiki.fourta.org reverse DNS resolves to cp13.miraheze.org [09:28:08] RECOVERY - biblestrength.net - reverse DNS on sslhost is OK: rDNS OK - biblestrength.net reverse DNS resolves to cp13.miraheze.org [09:28:09] RECOVERY - mrlove.wiki - reverse DNS on sslhost is OK: rDNS OK - mrlove.wiki reverse DNS resolves to cp13.miraheze.org [09:28:10] RECOVERY - miraheze.gq - reverse DNS on sslhost is OK: rDNS OK - miraheze.gq reverse DNS resolves to cp13.miraheze.org [09:28:12] RECOVERY - www.trollpasta.com - reverse DNS on sslhost is OK: rDNS OK - www.trollpasta.com reverse DNS resolves to cp13.miraheze.org [09:28:18] RECOVERY - wiki.mxlinuxusers.de - reverse DNS on sslhost is OK: rDNS OK - wiki.mxlinuxusers.de reverse DNS resolves to cp13.miraheze.org [09:28:25] RECOVERY - rupowerrangersfanon.tk - reverse DNS on sslhost is OK: rDNS OK - rupowerrangersfanon.tk reverse DNS resolves to cp13.miraheze.org [09:28:27] RECOVERY - johanloopmans.nl - reverse DNS on sslhost is OK: rDNS OK - johanloopmans.nl reverse DNS resolves to cp13.miraheze.org [09:28:35] RECOVERY - wiki.vinesh.eu.org - reverse DNS on sslhost is OK: rDNS OK - wiki.vinesh.eu.org reverse DNS resolves to cp13.miraheze.org [09:28:42] PROBLEM - www.opendatascot.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.opendatascot.org could not be found [09:28:47] RECOVERY - wmworld.sktz.live - reverse DNS on sslhost is OK: rDNS OK - wmworld.sktz.live reverse DNS resolves to cp13.miraheze.org [09:28:50] RECOVERY - podpedia.org - reverse DNS on sslhost is OK: rDNS OK - podpedia.org reverse DNS resolves to cp13.miraheze.org [09:28:51] RECOVERY - zh.internetpedia.tk - reverse DNS on sslhost is OK: rDNS OK - zh.internetpedia.tk reverse DNS resolves to cp13.miraheze.org [09:28:51] RECOVERY - madzebrascience.wiki - reverse DNS on sslhost is OK: rDNS OK - madzebrascience.wiki reverse DNS resolves to cp13.miraheze.org [09:28:52] RECOVERY - www.highdeologywiki.com - reverse DNS on sslhost is OK: rDNS OK - www.highdeologywiki.com reverse DNS resolves to cp13.miraheze.org [09:28:57] RECOVERY - ping6 on dbbackup1 is OK: PING OK - Packet loss = 0%, RTA = 91.48 ms [09:29:05] RECOVERY - www.tradwiki.org - reverse DNS on sslhost is OK: rDNS OK - www.tradwiki.org reverse DNS resolves to cp13.miraheze.org [09:29:07] RECOVERY - www.johanloopmans.nl - reverse DNS on sslhost is OK: rDNS OK - www.johanloopmans.nl reverse DNS resolves to cp13.miraheze.org [09:29:14] RECOVERY - www.marinebiodiversitymatrix.org - reverse DNS on sslhost is OK: rDNS OK - www.marinebiodiversitymatrix.org reverse DNS resolves to cp13.miraheze.org [09:29:21] RECOVERY - www.rothwell-leeds.co.uk - reverse DNS on sslhost is OK: rDNS OK - www.rothwell-leeds.co.uk reverse DNS resolves to cp13.miraheze.org [09:29:23] RECOVERY - thelonsdalebattalion.co.uk - reverse DNS on sslhost is OK: rDNS OK - thelonsdalebattalion.co.uk reverse DNS resolves to cp13.miraheze.org [09:29:39] RECOVERY - savage-wiki.com - reverse DNS on sslhost is OK: rDNS OK - savage-wiki.com reverse DNS resolves to cp13.miraheze.org [09:29:44] RECOVERY - www.erikapedia.com - reverse DNS on sslhost is OK: rDNS OK - www.erikapedia.com reverse DNS resolves to cp13.miraheze.org [09:29:48] RECOVERY - tensegritywiki.com - reverse DNS on sslhost is OK: rDNS OK - tensegritywiki.com reverse DNS resolves to cp13.miraheze.org [09:29:50] RECOVERY - wiki.macc.nyc - reverse DNS on sslhost is OK: rDNS OK - wiki.macc.nyc reverse DNS resolves to cp13.miraheze.org [09:29:51] RECOVERY - wiki.rebirthofthenight.com - reverse DNS on sslhost is OK: rDNS OK - wiki.rebirthofthenight.com reverse DNS resolves to cp13.miraheze.org [09:30:07] RECOVERY - stablestate.org - reverse DNS on sslhost is OK: rDNS OK - stablestate.org reverse DNS resolves to cp13.miraheze.org [09:30:07] RECOVERY - trollpasta.com - reverse DNS on sslhost is OK: rDNS OK - trollpasta.com reverse DNS resolves to cp13.miraheze.org [09:30:13] RECOVERY - miraheze.ml - reverse DNS on sslhost is OK: rDNS OK - miraheze.ml reverse DNS resolves to cp13.miraheze.org [09:30:23] RECOVERY - n64brew.dev - reverse DNS on sslhost is OK: rDNS OK - n64brew.dev reverse DNS resolves to cp13.miraheze.org [09:30:34] RECOVERY - egoish.org - reverse DNS on sslhost is OK: rDNS OK - egoish.org reverse DNS resolves to cp13.miraheze.org [09:30:45] RECOVERY - speleo.wiki - reverse DNS on sslhost is OK: rDNS OK - speleo.wiki reverse DNS resolves to cp13.miraheze.org [09:30:51] RECOVERY - iceria.org - reverse DNS on sslhost is OK: rDNS OK - iceria.org reverse DNS resolves to cp13.miraheze.org [09:30:52] RECOVERY - commons.gyaanipedia.com - reverse DNS on sslhost is OK: rDNS OK - commons.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org [09:30:52] RECOVERY - infectowiki.com - reverse DNS on sslhost is OK: rDNS OK - infectowiki.com reverse DNS resolves to cp13.miraheze.org [09:30:53] RECOVERY - www.portalsofphereon.com - reverse DNS on sslhost is OK: rDNS OK - www.portalsofphereon.com reverse DNS resolves to cp13.miraheze.org [09:31:03] RECOVERY - test2.miraheze.org - reverse DNS on sslhost is OK: rDNS OK - test2.miraheze.org reverse DNS resolves to cp13.miraheze.org [09:31:03] RECOVERY - inourownwords.online - reverse DNS on sslhost is OK: rDNS OK - inourownwords.online reverse DNS resolves to cp13.miraheze.org [09:31:08] RECOVERY - private.revi.wiki - reverse DNS on sslhost is OK: rDNS OK - private.revi.wiki reverse DNS resolves to cp13.miraheze.org [09:31:09] RECOVERY - viileapedia.ga - reverse DNS on sslhost is OK: rDNS OK - viileapedia.ga reverse DNS resolves to cp13.miraheze.org [09:31:10] RECOVERY - vortekspedia.tk - reverse DNS on sslhost is OK: rDNS OK - vortekspedia.tk reverse DNS resolves to cp13.miraheze.org [09:31:10] RECOVERY - wikilukas.tk - reverse DNS on sslhost is OK: rDNS OK - wikilukas.tk reverse DNS resolves to cp13.miraheze.org [09:31:12] RECOVERY - chouverse.cludisciples.cyou - reverse DNS on sslhost is OK: rDNS OK - chouverse.cludisciples.cyou reverse DNS resolves to cp13.miraheze.org [09:31:14] RECOVERY - animatedfeet.miraheze.org - reverse DNS on sslhost is OK: rDNS OK - animatedfeet.miraheze.org reverse DNS resolves to cp13.miraheze.org [09:31:15] RECOVERY - wlhmn.tk - reverse DNS on sslhost is OK: rDNS OK - wlhmn.tk reverse DNS resolves to cp13.miraheze.org [09:31:15] RECOVERY - wiki.worlduniversityandschool.org - reverse DNS on sslhost is OK: rDNS OK - wiki.worlduniversityandschool.org reverse DNS resolves to cp13.miraheze.org [09:31:20] icinga-miraheze: relax [09:31:21] RECOVERY - www.lukaibrisimovic.org - reverse DNS on sslhost is OK: rDNS OK - www.lukaibrisimovic.org reverse DNS resolves to cp13.miraheze.org [09:31:21] RECOVERY - marinebiodiversitymatrix.org - reverse DNS on sslhost is OK: rDNS OK - marinebiodiversitymatrix.org reverse DNS resolves to cp13.miraheze.org [09:31:27] RECOVERY - worldsanskrit.net - reverse DNS on sslhost is OK: rDNS OK - worldsanskrit.net reverse DNS resolves to cp13.miraheze.org [09:31:27] RECOVERY - froggy.info - reverse DNS on sslhost is OK: rDNS OK - froggy.info reverse DNS resolves to cp13.miraheze.org [09:31:28] RECOVERY - allthetropes.orain.org - reverse DNS on sslhost is OK: rDNS OK - allthetropes.orain.org reverse DNS resolves to cp13.miraheze.org [09:31:29] RECOVERY - miraheze.ga - reverse DNS on sslhost is OK: rDNS OK - miraheze.ga reverse DNS resolves to cp13.miraheze.org [09:31:30] RECOVERY - archive.a2b2.org - reverse DNS on sslhost is OK: rDNS OK - archive.a2b2.org reverse DNS resolves to cp13.miraheze.org [09:31:30] RECOVERY - wiki.zaoace.com - reverse DNS on sslhost is OK: rDNS OK - wiki.zaoace.com reverse DNS resolves to cp13.miraheze.org [09:31:37] RECOVERY - www.wikilukas.tk - reverse DNS on sslhost is OK: rDNS OK - www.wikilukas.tk reverse DNS resolves to cp13.miraheze.org [09:31:38] RECOVERY - wiki.mastodon.kr - reverse DNS on sslhost is OK: rDNS OK - wiki.mastodon.kr reverse DNS resolves to cp13.miraheze.org [09:31:39] RECOVERY - www.iceria.org - reverse DNS on sslhost is OK: rDNS OK - www.iceria.org reverse DNS resolves to cp13.miraheze.org [09:31:39] RECOVERY - wiki.qadrishattari.xyz - reverse DNS on sslhost is OK: rDNS OK - wiki.qadrishattari.xyz reverse DNS resolves to cp13.miraheze.org [09:31:42] RECOVERY - electrowiki.org - reverse DNS on sslhost is OK: rDNS OK - electrowiki.org reverse DNS resolves to cp13.miraheze.org [09:31:49] RECOVERY - wikipariksha.com - reverse DNS on sslhost is OK: rDNS OK - wikipariksha.com reverse DNS resolves to cp13.miraheze.org [09:31:58] RECOVERY - erikapedia.com - reverse DNS on sslhost is OK: rDNS OK - erikapedia.com reverse DNS resolves to cp13.miraheze.org [09:32:00] RECOVERY - munwiki.info - reverse DNS on sslhost is OK: rDNS OK - munwiki.info reverse DNS resolves to cp13.miraheze.org [09:32:00] RECOVERY - bharatwiki.online - reverse DNS on sslhost is OK: rDNS OK - bharatwiki.online reverse DNS resolves to cp13.miraheze.org [09:32:03] RECOVERY - wiki.conworlds.org - reverse DNS on sslhost is OK: rDNS OK - wiki.conworlds.org reverse DNS resolves to cp13.miraheze.org [09:32:11] RECOVERY - www.rangpurpedia.xyz - reverse DNS on sslhost is OK: rDNS OK - www.rangpurpedia.xyz reverse DNS resolves to cp13.miraheze.org [09:32:14] RECOVERY - orain.org - reverse DNS on sslhost is OK: rDNS OK - orain.org reverse DNS resolves to cp13.miraheze.org [09:32:15] RECOVERY - runzeppelin.ru - reverse DNS on sslhost is OK: rDNS OK - runzeppelin.ru reverse DNS resolves to cp13.miraheze.org [09:32:18] RECOVERY - ndg.nenawiki.org - reverse DNS on sslhost is OK: rDNS OK - ndg.nenawiki.org reverse DNS resolves to cp13.miraheze.org [09:32:23] RECOVERY - meta.gyaanipedia.com - reverse DNS on sslhost is OK: rDNS OK - meta.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org [09:32:28] RECOVERY - sdiy.info - reverse DNS on sslhost is OK: rDNS OK - sdiy.info reverse DNS resolves to cp13.miraheze.org [09:32:29] RECOVERY - spiral.wiki - reverse DNS on sslhost is OK: rDNS OK - spiral.wiki reverse DNS resolves to cp13.miraheze.org [09:32:33] RECOVERY - rangpurpedia.xyz - reverse DNS on sslhost is OK: rDNS OK - rangpurpedia.xyz reverse DNS resolves to cp13.miraheze.org [09:32:38] RECOVERY - wiki.villagecollaborative.net - reverse DNS on sslhost is OK: rDNS OK - wiki.villagecollaborative.net reverse DNS resolves to cp13.miraheze.org [09:32:39] RECOVERY - monarchia.wiki - reverse DNS on sslhost is OK: rDNS OK - monarchia.wiki reverse DNS resolves to cp13.miraheze.org [09:32:40] RECOVERY - datacrondatabase.com - reverse DNS on sslhost is OK: rDNS OK - datacrondatabase.com reverse DNS resolves to cp13.miraheze.org [09:33:03] RECOVERY - www.permanentfuturelab.wiki - reverse DNS on sslhost is OK: rDNS OK - www.permanentfuturelab.wiki reverse DNS resolves to cp13.miraheze.org [09:33:16] RECOVERY - tot.wiki - reverse DNS on sslhost is OK: rDNS OK - tot.wiki reverse DNS resolves to cp13.miraheze.org [09:33:25] RECOVERY - enc.for.uz - reverse DNS on sslhost is OK: rDNS OK - enc.for.uz reverse DNS resolves to cp13.miraheze.org [09:33:25] RECOVERY - www.sdiy.info - reverse DNS on sslhost is OK: rDNS OK - www.sdiy.info reverse DNS resolves to cp13.miraheze.org [09:33:31] RECOVERY - vise.dayid.org - reverse DNS on sslhost is OK: rDNS OK - vise.dayid.org reverse DNS resolves to cp13.miraheze.org [09:33:39] .op [09:33:39] Attempting to OP... [09:33:39] RECOVERY - halloween.gyaanipedia.com - reverse DNS on sslhost is OK: rDNS OK - halloween.gyaanipedia.com reverse DNS resolves to cp13.miraheze.org [09:33:46] RECOVERY - heavyironmodding.org - reverse DNS on sslhost is OK: rDNS OK - heavyironmodding.org reverse DNS resolves to cp13.miraheze.org [09:33:51] RECOVERY - en.famepedia.org - reverse DNS on sslhost is OK: rDNS OK - en.famepedia.org reverse DNS resolves to cp13.miraheze.org [09:33:59] RECOVERY - cyberlaw.ccdcoe.org - reverse DNS on sslhost is OK: rDNS OK - cyberlaw.ccdcoe.org reverse DNS resolves to cp13.miraheze.org [09:34:01] RECOVERY - debilepedie.gq - reverse DNS on sslhost is OK: rDNS OK - debilepedie.gq reverse DNS resolves to cp13.miraheze.org [09:34:08] RECOVERY - cubashpedia.cf - reverse DNS on sslhost is OK: rDNS OK - cubashpedia.cf reverse DNS resolves to cp13.miraheze.org [09:34:34] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [09:35:35] RECOVERY - www.opendatascot.org - reverse DNS on sslhost is OK: rDNS OK - www.opendatascot.org reverse DNS resolves to cp13.miraheze.org [09:48:11] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [09:49:00] RECOVERY - db12 Puppet on db12 is OK: OK: Puppet is currently enabled, last run 24 seconds ago with 0 failures [09:49:21] RECOVERY - db11 Puppet on db11 is OK: OK: Puppet is currently enabled, last run 10 seconds ago with 0 failures [09:53:38] RECOVERY - db13 Puppet on db13 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [09:54:03] That's good [09:54:10] Maybe network stopped being stupid [09:55:10] It did [10:08:25] RECOVERY - cp12 Varnish Backends on cp12 is OK: All 7 backends are healthy [10:08:32] !log restart varnish on cp12 - childs were not running [10:08:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [10:09:18] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [10:09:28] RECOVERY - cp12 HTTP 4xx/5xx ERROR Rate on cp12 is OK: OK - NGINX Error Rate is 1% [10:10:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [10:10:14] RECOVERY - cp12 HTTPS on cp12 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 2263 bytes in 0.389 second response time [10:10:52] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [10:24:40] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [10:47:21] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [11:00:57] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: rDNS OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org [11:06:41] Universal_Omega RhinosF1 paladox Reception|away https://phabricator.miraheze.org/T7407 [11:07:43] there's no need to ping everyone unless it's an absolute emergency, we check Phabricator [11:08:06] MarioMario456: and please mention a wiki URL too [11:08:21] as you might think it's happening on all wikis but it might not be so it's useful for us to have a URL where we can test it out [11:08:52] add [11:11:05] MarioMario456: works for me [11:11:11] I was able to edit my title here - https://crappygames.miraheze.org/wiki/Talk:Crappy_Games_Wiki [11:11:24] could you try clearing your cache? [11:12:28] as I said the bug is completely random. sometimes it happens, sometimes it doesn't [11:13:13] Hmm, well that is quite hard to reproduce then and might be an issue on your side rather than ours unless you know for a fact that someone else is also having it [11:13:30] could you still try to clear your cache? And if it happens again mention it on the task [11:15:27]