[00:01:14] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 27.59, 23.52, 22.06 [00:16:29] PROBLEM - mw11 Disk Space on mw11 is CRITICAL: DISK CRITICAL - free space: / 1128 MB (5% inode=75%); [00:18:29] PROBLEM - mw11 Disk Space on mw11 is WARNING: DISK WARNING - free space: / 1263 MB (6% inode=75%); [00:24:32] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.76, 5.31, 4.65 [00:28:50] PROBLEM - zh.internetpedia.tk - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for zh.internetpedia.tk could not be found [00:28:51] PROBLEM - wiki.worlduniversityandschool.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.worlduniversityandschool.org could not be found [00:28:52] PROBLEM - spiral.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for spiral.wiki could not be found [00:28:53] PROBLEM - marinebiodiversitymatrix.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for marinebiodiversitymatrix.org could not be found [00:28:54] PROBLEM - pt.graalmilitary.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for pt.graalmilitary.com could not be found [00:28:55] PROBLEM - wiki.zymonic.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.zymonic.com could not be found [00:28:59] PROBLEM - wiki.wilderyogi.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.wilderyogi.eu could not be found [00:30:16] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.69, 5.77, 5.12 [00:34:57] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.43, 6.95, 5.27 [00:35:33] RECOVERY - zh.internetpedia.tk - reverse DNS on sslhost is OK: SSL OK - zh.internetpedia.tk reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:35:35] RECOVERY - wiki.worlduniversityandschool.org - reverse DNS on sslhost is OK: SSL OK - wiki.worlduniversityandschool.org reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:35:42] RECOVERY - pt.graalmilitary.com - reverse DNS on sslhost is OK: SSL OK - pt.graalmilitary.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:35:42] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.16, 6.58, 5.48 [00:35:45] RECOVERY - wiki.zymonic.com - reverse DNS on sslhost is OK: SSL OK - wiki.zymonic.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:35:52] RECOVERY - spiral.wiki - reverse DNS on sslhost is OK: SSL OK - spiral.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:35:54] RECOVERY - wiki.wilderyogi.eu - reverse DNS on sslhost is OK: SSL OK - wiki.wilderyogi.eu reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:35:55] RECOVERY - marinebiodiversitymatrix.org - reverse DNS on sslhost is OK: SSL OK - marinebiodiversitymatrix.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [00:36:09] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.00, 4.96, 5.03 [00:36:57] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.72, 6.64, 5.38 [00:37:38] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.71, 5.86, 5.34 [00:43:25] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [00:44:08] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.07, 5.29, 5.17 [00:46:08] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.59, 6.23, 5.54 [00:52:20] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [00:59:18] RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 78821 MB (11% inode=99%); [01:00:07] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.60, 5.93, 5.97 [01:02:07] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.46, 6.40, 6.12 [01:03:18] PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 78533 MB (10% inode=99%); [01:04:07] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.21, 5.50, 5.82 [01:06:10] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [01:12:07] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.77, 4.31, 5.09 [01:18:10] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.24, 5.01, 5.13 [01:22:09] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.17, 4.82, 5.04 [01:29:00] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 148, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 129, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 66, in check_records nameserversans = dns_resolver.query(root_domain, 'NS') File "/usr/lib/python3/ [01:29:00] packages/dns/resolver.py", line 1002, in query raise NXDOMAIN(qnames=qnames_to_try, responses=nxdomain_responses)dns.resolver.NXDOMAIN: None of DNS query names exist: zfc.id.lv., zfc.id.lv. [01:30:07] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.50, 5.52, 5.29 [01:34:07] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.67, 4.79, 5.07 [01:41:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.30, 22.20, 23.75 [01:43:08] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 26.01, 23.06, 23.83 [01:45:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.91, 22.07, 23.36 [01:49:07] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 35.20, 25.97, 24.42 [01:52:07] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.22, 6.50, 5.41 [01:54:07] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.01, 5.99, 5.36 [01:59:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 17.37, 22.23, 23.64 [02:00:07] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.58, 5.71, 5.37 [02:02:07] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.68, 5.66, 5.39 [02:05:07] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 36.45, 26.53, 24.70 [02:09:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 16.46, 22.12, 23.41 [02:12:08] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.78, 4.11, 4.86 [02:17:10] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 11.40, 16.40, 20.16 [02:31:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 17.54, 20.93, 20.63 [02:35:07] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 27.86, 23.17, 21.51 [02:37:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.69, 22.26, 21.45 [02:37:26] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.07, 5.48, 5.01 [02:41:18] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.86, 5.06, 4.94 [02:49:08] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.53, 18.40, 20.07 [03:05:43] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 26.37, 23.19, 20.87 [03:07:37] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.90, 22.90, 21.00 [03:09:08] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.66, 5.16, 4.74 [03:11:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.24, 5.49, 4.91 [03:12:58] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.69, 4.52, 4.63 [03:15:16] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 30.91, 24.89, 22.16 [03:16:49] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.28, 5.73, 5.15 [03:17:11] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.17, 22.21, 21.49 [03:18:44] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.21, 5.04, 4.98 [03:21:07] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.27, 18.51, 20.14 [03:25:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.49, 20.67, 20.69 [03:27:07] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 19.30, 19.94, 20.39 [03:35:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.21, 21.02, 20.41 [03:37:43] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 19.17, 19.93, 20.05 [03:57:28] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.51, 20.67, 19.38 [04:03:16] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.00, 20.28, 19.70 [04:07:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.90, 21.82, 20.55 [04:08:07] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.52, 5.41, 4.63 [04:09:07] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.95, 20.09, 20.04 [04:10:07] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.79, 4.55, 4.42 [04:14:07] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.93, 5.85, 4.97 [04:15:08] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.85, 20.44, 20.11 [04:17:08] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.34, 21.92, 20.66 [04:21:08] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.24, 23.80, 21.92 [04:25:07] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 32.87, 26.76, 23.40 [04:26:59] PROBLEM - wiki.wilderyogi.eu - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.wilderyogi.eu could not be found [04:29:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.58, 22.32, 22.21 [04:31:07] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.55, 24.09, 22.89 [04:32:08] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.15, 5.64, 5.83 [04:33:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.10, 22.22, 22.33 [04:33:52] RECOVERY - wiki.wilderyogi.eu - reverse DNS on sslhost is OK: SSL OK - wiki.wilderyogi.eu reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:35:07] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 26.75, 23.40, 22.72 [04:37:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 18.73, 20.68, 21.76 [04:41:07] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.66, 22.58, 22.22 [04:42:48] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [04:43:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 14.62, 20.24, 21.48 [04:44:07] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.79, 4.12, 4.90 [04:46:54] PROBLEM - tot.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'tot.wiki' expires in 15 day(s) (Mon 26 Jul 2021 04:39:18 GMT +0000). [04:51:41] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [04:53:07] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.77, 22.63, 21.83 [04:53:30] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JcAwd [04:53:32] [02miraheze/ssl] 07MirahezeSSLBot 032b6d236 - Bot: Update SSL cert for tot.wiki [04:54:08] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.27, 5.47, 5.08 [04:55:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 15.28, 20.40, 21.16 [04:56:07] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.57, 4.86, 4.92 [05:03:08] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 28.78, 22.47, 21.37 [05:07:09] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.77, 23.83, 22.27 [05:09:11] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.73, 23.69, 22.37 [05:11:08] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 17.51, 21.32, 21.66 [05:17:07] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.31, 17.81, 20.17 [05:24:07] PROBLEM - cp12 Current Load on cp12 is WARNING: WARNING - load average: 1.99, 1.65, 0.99 [05:25:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.91, 19.98, 20.10 [05:26:06] RECOVERY - cp12 Current Load on cp12 is OK: OK - load average: 0.86, 1.31, 0.94 [05:27:07] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 12.56, 16.98, 18.99 [05:34:48] RECOVERY - tot.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'tot.wiki' will expire on Fri 08 Oct 2021 03:53:23 GMT +0000. [05:51:40] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.36, 20.74, 19.92 [05:53:04] [02ssl] 07Universal-Omega commented on pull request 03#419: kk.uncyc.tk: wiki does not exist - 13https://git.io/JcAMR [05:55:32] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 18.56, 20.26, 19.98 [06:12:12] !log [reception@jobrunner4] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki pjmaskswiki /home/reception/pjmasks_pages_full.xml --username-prefix=wikia:pj-masks [06:12:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:17:56] [02miraheze/ssl] 07Reception123 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JcA9w [06:17:58] [02miraheze/ssl] 07Reception123 039a6131c - Update mwcosmos.com.crt [06:21:58] PROBLEM - wiki.miraheze.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.miraheze.org could not be found [06:21:59] PROBLEM - www.fossilfighterswiki.com - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for www.fossilfighterswiki.com could not be found [06:26:47] RECOVERY - mw8 Disk Space on mw8 is OK: DISK OK - free space: / 2105 MB (11% inode=74%); [06:28:41] RECOVERY - wiki.miraheze.org - reverse DNS on sslhost is OK: SSL OK - wiki.miraheze.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [06:28:41] RECOVERY - www.fossilfighterswiki.com - reverse DNS on sslhost is OK: SSL OK - www.fossilfighterswiki.com reverse DNS resolves to cp13.miraheze.org - CNAME OK [06:33:47] !log [reception@jobrunner3] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki thebestmusicandsongswikiawiki /home/reception/bestmusicandsongs_pages_full.xml --username-prefix=wikia:bestmusic [06:33:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [06:34:29] PROBLEM - mw11 Disk Space on mw11 is CRITICAL: DISK CRITICAL - free space: / 1119 MB (5% inode=75%); [06:36:27] [02miraheze/mediawiki] 07Reception123 pushed 031 commit to 03REL1_36 [+0/-0/±2] 13https://git.io/JcA7l [06:36:28] [02miraheze/mediawiki] 07Reception123 030a35cc4 - switch PageForms to master [06:36:29] PROBLEM - mw11 Disk Space on mw11 is WARNING: DISK WARNING - free space: / 1283 MB (6% inode=75%); [06:36:54] !log sudo rm -rf /tmp/* on mw* [06:37:55] RECOVERY - mw9 Disk Space on mw9 is OK: DISK OK - free space: / 6225 MB (32% inode=75%); [06:38:29] RECOVERY - mw11 Disk Space on mw11 is OK: DISK OK - free space: / 7255 MB (38% inode=75%); [06:52:44] PROBLEM - guia.esporo.net - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for guia.esporo.net could not be found [06:53:07] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 16.71, 22.15, 18.77 [06:55:07] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.21, 19.06, 18.02 [06:59:25] RECOVERY - guia.esporo.net - reverse DNS on sslhost is OK: SSL OK - guia.esporo.net reverse DNS resolves to cp13.miraheze.org - CNAME OK [07:10:11] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [07:19:02] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [07:32:54] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [07:41:46] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [07:55:37] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [09:53:24] PROBLEM - cp3 Current Load on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [09:53:31] PROBLEM - cp3 SSH on cp3 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [09:53:36] PROBLEM - cp3 Stunnel Http for mw8 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [09:53:42] PROBLEM - cp3 Disk Space on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [09:53:53] PROBLEM - cp3 PowerDNS Recursor on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [09:53:53] PROBLEM - cp3 Stunnel Http for mon2 on cp3 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [09:54:20] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 128.199.139.216/cpweb, 2400:6180:0:d0::403:f001/cpweb [09:54:29] PROBLEM - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is WARNING: WARNING - NGINX Error Rate is 42% [09:54:30] PROBLEM - cp3 Varnish Backends on cp3 is CRITICAL: 4 backends are down. mw8 mw9 mw10 mw11 [09:55:22] RECOVERY - cp3 Current Load on cp3 is OK: OK - load average: 0.08, 0.12, 0.24 [09:55:29] RECOVERY - cp3 SSH on cp3 is OK: SSH OK - OpenSSH_7.9p1 Debian-10+deb10u2 (protocol 2.0) [09:55:33] RECOVERY - cp3 Stunnel Http for mw8 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 15417 bytes in 0.946 second response time [09:55:40] RECOVERY - cp3 Disk Space on cp3 is OK: DISK OK - free space: / 4711 MB (19% inode=94%); [09:55:49] RECOVERY - cp3 Stunnel Http for mon2 on cp3 is OK: HTTP OK: HTTP/1.1 200 OK - 39653 bytes in 0.977 second response time [09:55:52] RECOVERY - cp3 PowerDNS Recursor on cp3 is OK: DNS OK: 0.505 seconds response time. miraheze.org returns 128.199.139.216,2400:6180:0:d0::403:f001 [09:56:19] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [09:56:29] RECOVERY - cp3 Varnish Backends on cp3 is OK: All 7 backends are healthy [09:56:30] RECOVERY - cp3 HTTP 4xx/5xx ERROR Rate on cp3 is OK: OK - NGINX Error Rate is 4% [10:01:19] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 148, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 129, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 66, in check_records nameserversans = dns_resolver.query(root_domain, 'NS') File "/usr/lib/python3/ [10:01:19] packages/dns/resolver.py", line 1002, in query raise NXDOMAIN(qnames=qnames_to_try, responses=nxdomain_responses)dns.resolver.NXDOMAIN: None of DNS query names exist: zfc.id.lv., zfc.id.lv. [11:16:24] PROBLEM - www.burnout.wiki - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - www.burnout.wiki All nameservers failed to answer the query. [11:21:14] PROBLEM - cloud5 Current Load on cloud5 is CRITICAL: CRITICAL - load average: 52.64, 32.42, 20.91 [11:24:45] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 10.50, 4.83, 2.96 [11:28:41] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.17, 3.86, 2.97 [11:30:42] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.23, 3.16, 2.81 [11:38:51] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [12:08:40] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [12:22:30] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [12:38:30] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [14:01:38] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:04:45] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.01, 6.76, 5.89 [14:06:45] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.34, 5.99, 5.70 [14:12:04] PROBLEM - cloud5 Current Load on cloud5 is WARNING: WARNING - load average: 7.79, 13.74, 22.28 [14:16:04] RECOVERY - cloud5 Current Load on cloud5 is OK: OK - load average: 9.96, 11.50, 19.37 [14:17:25] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [14:31:16] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [14:40:07] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [14:53:58] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [15:37:21] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.85, 6.31, 5.34 [15:37:31] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [15:37:42] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.43, 19.71, 16.24 [15:39:21] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.77, 5.98, 5.34 [15:39:37] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 12.48, 16.93, 15.63 [15:51:25] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [16:14:11] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [16:36:18] PROBLEM - en.famepedia.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.famepedia.org could not be found [16:36:20] PROBLEM - wiki.ssij.se - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for wiki.ssij.se could not be found [16:36:21] PROBLEM - en.petrawiki.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for en.petrawiki.org could not be found [16:36:22] PROBLEM - iceria.org - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for iceria.org could not be found [16:36:24] PROBLEM - bots1.miraheze.wiki - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for bots1.miraheze.wiki could not be found [16:43:06] RECOVERY - en.famepedia.org - reverse DNS on sslhost is OK: SSL OK - en.famepedia.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [16:43:09] RECOVERY - en.petrawiki.org - reverse DNS on sslhost is OK: SSL OK - en.petrawiki.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [16:43:10] RECOVERY - iceria.org - reverse DNS on sslhost is OK: SSL OK - iceria.org reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [16:43:10] RECOVERY - wiki.ssij.se - reverse DNS on sslhost is OK: SSL OK - wiki.ssij.se reverse DNS resolves to cp13.miraheze.org - CNAME OK [16:43:17] RECOVERY - bots1.miraheze.wiki - reverse DNS on sslhost is OK: SSL OK - bots1.miraheze.wiki reverse DNS resolves to cp13.miraheze.org - NS RECORDS OK [16:55:41] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [17:04:32] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [17:59:59] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [18:15:47] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [18:29:37] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [18:45:25] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [18:49:13] [02MirahezeMagic] 07R4356th opened pull request 03#271: Replace Freenode with Libera.Chat - 13https://git.io/JcpNM [18:50:04] miraheze/MirahezeMagic - R4356th the build passed. [19:34:47] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.12, 6.35, 5.15 [19:35:25] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.22, 7.54, 5.93 [19:36:46] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.93, 5.81, 5.10 [19:37:23] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.01, 7.03, 5.94 [19:39:22] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.33, 6.75, 5.96 [19:45:22] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.72, 7.08, 6.29 [19:47:21] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.47, 6.58, 6.21 [19:51:22] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.84, 7.07, 6.53 [19:55:21] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.10, 6.51, 6.46 [20:03:24] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.91, 7.04, 6.61 [20:07:22] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.66, 6.72, 6.63 [20:32:06] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.58, 7.37, 6.84 [20:34:04] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 14.57, 9.47, 7.63 [20:35:37] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.10, 6.93, 5.69 [20:37:34] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 6.00, 6.57, 5.71 [20:41:50] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.07, 7.44, 7.51 [20:45:03] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.64, 6.75, 5.76 [20:47:39] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.74, 5.52, 6.62 [20:49:03] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.81, 5.98, 5.69 [20:49:30] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.83, 6.31, 5.57 [20:53:25] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.42, 6.36, 5.84 [20:57:17] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.31, 6.84, 6.17 [20:59:14] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.70, 6.25, 6.04 [23:09:48] PROBLEM - wiki.wikimedia.cat - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.wikimedia.cat All nameservers failed to answer the query. [23:23:29] RECOVERY - wiki.wikimedia.cat - reverse DNS on sslhost is OK: SSL OK - wiki.wikimedia.cat reverse DNS resolves to cp13.miraheze.org - CNAME OK [23:29:12] RECOVERY - lcn.zfc.id.lv - reverse DNS on sslhost is OK: SSL OK - lcn.zfc.id.lv reverse DNS resolves to cp13.miraheze.org - CNAME OK [23:38:03] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found