[00:00:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 5.26, 6.03, 5.27 [00:02:51] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.64, 22.10, 18.69 [00:03:03] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.16, 4.85, 3.71 [00:05:00] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.75, 4.30, 3.64 [00:06:51] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 17.78, 20.26, 18.76 [00:08:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 2.69, 5.41, 5.81 [00:10:41] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.21, 2.28, 1.59 [00:12:07] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 2.13, 3.67, 5.00 [00:12:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 0.65, 1.73, 1.48 [00:12:48] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.90, 7.54, 6.32 [00:12:53] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 31.21, 24.14, 20.69 [00:14:41] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.65, 1.39, 1.38 [00:14:42] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 9.84, 7.20, 5.11 [00:14:46] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.44, 6.93, 6.26 [00:15:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.24, 4.52, 3.73 [00:16:17] PROBLEM - cp31 Stunnel Http for mw9 on cp31 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:16:31] PROBLEM - cp20 Stunnel Http for mw9 on cp20 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:16:40] PROBLEM - cp30 Stunnel Http for mw9 on cp30 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [00:16:48] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 2 datacenters are down: 2001:41d0:801:2000::4c25/cpweb, 2001:41d0:801:2000::1b80/cpweb [00:17:10] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.78, 3.94, 3.62 [00:17:10] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 1 datacenter is down: 198.244.148.90/cpweb [00:17:39] alerting : [FIRING:1] (mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:18:44] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.98, 6.75, 6.35 [00:19:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.48, 4.26, 3.78 [00:20:31] RECOVERY - cp31 Stunnel Http for mw9 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 8.589 second response time [00:20:43] RECOVERY - cp20 Stunnel Http for mw9 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 6.298 second response time [00:20:53] RECOVERY - cp30 Stunnel Http for mw9 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14564 bytes in 2.542 second response time [00:21:09] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:22:14] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.87, 6.77, 6.21 [00:24:14] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.61, 6.13, 6.06 [00:24:49] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:25:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.13, 3.83, 3.76 [00:30:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 6.39, 6.60, 5.08 [00:30:51] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.15, 22.97, 23.90 [00:32:25] PROBLEM - bn.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [00:32:25] NS entry for bn.gyaanipedia.com could not be found [00:32:55] PROBLEM - en.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [00:32:55] NS entry for en.gyaanipedia.com could not be found [00:34:15] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.32, 5.82, 5.94 [00:36:44] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JSDgM [00:36:46] [02miraheze/mw-config] 07paladox 0372ca98c - Switch memcached to use MemcachedPeclBagOStuff [00:36:47] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3 [00:36:49] [02mw-config] 07paladox opened pull request 03#4339: Switch memcached to use MemcachedPeclBagOStuff - 13https://git.io/JSDgy [00:37:55] miraheze/mw-config - paladox the build passed. [00:39:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.01, 3.74, 3.72 [00:40:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 1.80, 5.02, 5.50 [00:40:43] [02mw-config] 07paladox closed pull request 03#4339: Switch memcached to use MemcachedPeclBagOStuff - 13https://git.io/JSDgy [00:40:44] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [00:40:46] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3 [00:40:47] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JSD24 [00:40:49] [02miraheze/mw-config] 07paladox 033ec9f82 - Switch memcached to use MemcachedPeclBagOStuff (#4339) [00:41:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.50, 3.68, 3.70 [00:41:20] !log [paladox@mw11] starting deploy of {'config': True} to all [00:41:35] !log [paladox@mw11] finished deploy of {'config': True} to all - SUCCESS in 14s [00:41:49] miraheze/mw-config - paladox the build passed. [00:42:00] !log [paladox@mwtask111] starting deploy of {'config': True} to scsvg [00:42:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:42:07] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 1.74, 3.94, 5.04 [00:42:22] !log [paladox@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 21s [00:42:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:44:51] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 15.68, 17.69, 20.29 [00:45:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.60, 4.19, 3.92 [00:47:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.41, 3.98, 3.88 [00:47:20] !log [@test101] starting deploy of {'config': True} to skip [00:47:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:47:26] !log [@test101] finished deploy of {'config': True} to skip - SUCCESS in 6s [00:47:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:47:45] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JSDa4 [00:47:46] [02miraheze/mw-config] 07paladox 03bbf0883 - Revert "Switch memcached to use MemcachedPeclBagOStuff (#4339)" [00:48:15] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.54, 4.72, 5.08 [00:48:44] !log [paladox@mw11] starting deploy of {'config': True} to all [00:48:59] miraheze/mw-config - paladox the build passed. [00:49:00] !log [paladox@mw11] finished deploy of {'config': True} to all - SUCCESS in 16s [00:49:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:49:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:51:11] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.57, 4.88, 4.23 [00:51:41] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.84, 7.32, 6.43 [00:51:42] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.18, 21.98, 21.31 [00:51:58] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 5 datacenters are down: 51.195.220.68/cpweb, 198.244.148.90/cpweb, 149.56.141.75/cpweb, 2607:5300:201:3100::929a/cpweb, 2607:5300:201:3100::5ebc/cpweb [00:52:15] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.55, 4.94, 5.13 [00:53:26] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::1b80/cpweb [00:53:39] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 22.79, 21.88, 21.34 [00:53:41] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.42, 7.01, 6.43 [00:53:58] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [00:55:10] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.69, 3.85, 3.94 [00:55:41] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.60, 7.36, 6.61 [00:57:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.29, 4.04, 4.00 [00:57:14] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [00:57:41] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.48, 7.03, 6.58 [00:59:15] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.86, 7.12, 6.33 [00:59:41] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.41, 6.52, 6.46 [01:00:15] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.76, 4.42, 4.90 [01:01:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.09, 3.96, 3.99 [01:03:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.83, 4.02, 3.99 [01:03:15] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.70, 6.63, 6.34 [01:03:24] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.96, 19.01, 20.39 [01:07:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:12:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:13:10] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.84, 3.78, 3.97 [01:14:12] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JSDo8 [01:14:14] [02miraheze/mw-config] 07paladox 0391c315a - Use MemcachedPeclBagOStuff on new mediawiki infra [01:14:15] [02mw-config] 07paladox created branch 03paladox-patch-1 - 13https://git.io/vbvb3 [01:14:17] [02mw-config] 07paladox opened pull request 03#4340: Use MemcachedPeclBagOStuff on new mediawiki infra - 13https://git.io/JSDo4 [01:14:34] [02miraheze/mw-config] 07paladox pushed 031 commit to 03paladox-patch-1 [+0/-0/±1] 13https://git.io/JSDoB [01:14:36] [02miraheze/mw-config] 07paladox 03a72a676 - Update GlobalCache.php [01:14:37] [02mw-config] 07paladox synchronize pull request 03#4340: Use MemcachedPeclBagOStuff on new mediawiki infra - 13https://git.io/JSDo4 [01:14:44] [02mw-config] 07paladox closed pull request 03#4340: Use MemcachedPeclBagOStuff on new mediawiki infra - 13https://git.io/JSDo4 [01:14:45] [02miraheze/mw-config] 07paladox deleted branch 03paladox-patch-1 [01:14:47] [02mw-config] 07paladox deleted branch 03paladox-patch-1 - 13https://git.io/vbvb3 [01:14:48] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JSDou [01:14:50] [02miraheze/mw-config] 07paladox 03bb9e5e0 - Use MemcachedPeclBagOStuff on new mediawiki infra (#4340) [01:15:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.37, 4.03, 4.04 [01:15:14] !log [paladox@mwtask111] starting deploy of {'config': True} to scsvg [01:15:20] [02mw-config] 07Universal-Omega commented on pull request 03#4340: Use MemcachedPeclBagOStuff on new mediawiki infra - 13https://git.io/JSDoi [01:15:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:15:28] paladox: ^ [01:15:29] miraheze/mw-config - paladox the build passed. [01:15:38] miraheze/mw-config - paladox the build passed. [01:15:56] miraheze/mw-config - paladox the build passed. [01:15:58] !log [paladox@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 44s [01:16:03] !log [paladox@test101] starting deploy of {'config': True} to skip [01:16:04] !log [paladox@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s [01:16:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:16:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:16:24] CosmicAlpha: oh! [01:16:25] thanks! [01:16:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:16:43] No problem! [01:16:43] [02miraheze/mw-config] 07paladox pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JSDoQ [01:16:45] [02miraheze/mw-config] 07paladox 0358eea6f - Fix [01:16:47] !log [paladox@test101] starting deploy of {'config': True} to skip [01:16:48] !log [paladox@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s [01:16:51] !log [paladox@mwtask111] starting deploy of {'config': True} to scsvg [01:16:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:16:56] !log [paladox@mwtask111] finished deploy of {'config': True} to scsvg - SUCCESS in 5s [01:17:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:17:10] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:17:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:17:54] miraheze/mw-config - paladox the build passed. [01:19:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.03, 3.80, 3.98 [01:22:33] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.23, 7.04, 6.46 [01:23:13] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.25, 1.79, 1.19 [01:24:10] !log [@test3] starting deploy of {'config': True} to skip [01:24:12] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 1s [01:24:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:24:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:25:12] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.62, 1.37, 1.11 [01:26:30] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.44, 7.51, 6.75 [01:27:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.77, 3.88, 3.89 [01:28:29] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.53, 7.23, 6.75 [01:30:28] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.68, 6.78, 6.65 [01:32:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:40:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:40:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.78, 1.56, 1.15 [01:41:48] !log [@mw11] starting deploy of {'config': True} to ovlon [01:42:11] !log [@mw11] finished deploy of {'config': True} to ovlon - SUCCESS in 22s [01:42:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:42:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:42:58] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.04, 1.37, 1.12 [01:43:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.19, 3.69, 3.96 [01:49:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.49, 3.81, 3.89 [01:51:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.61, 3.83, 3.90 [01:53:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.56, 4.37, 4.08 [01:55:00] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 6.27, 7.67, 5.59 [01:56:52] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2001:41d0:801:2000::4c25/cpweb [01:57:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.19, 3.59, 3.86 [01:58:09] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.04, 7.14, 6.49 [01:58:49] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [01:59:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.05, 3.78, 3.89 [02:01:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.37, 3.76, 3.88 [02:02:06] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.95, 6.60, 6.43 [02:02:40] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 3.16, 5.44, 5.43 [02:04:35] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.13, 5.91, 5.55 [02:05:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:06:30] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 3.56, 4.93, 5.24 [02:07:38] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wildbowliteraryuniversewiki /home/universalomega/Worm_Wiki.xml --username-prefix=wikia:worm --no-updates --report=1 (START) [02:07:41] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wildbowliteraryuniversewiki /home/universalomega/Worm_Wiki.xml --username-prefix=wikia:worm --no-updates --report=1 (END - exit=256) [02:07:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:07:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:08:25] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 3.13, 4.38, 5.00 [02:09:27] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wildbowliteraryuniversewiki /home/universalomega/Worm_Wiki.xml --username-prefix=wikia:worm --no-updates --report=1 (START) [02:09:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:11:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:12:16] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 3.83, 6.82, 6.20 [02:15:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.53, 3.90, 3.71 [02:17:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.85, 3.95, 3.76 [02:19:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.57, 3.98, 3.78 [02:20:42] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=wildbowliteraryuniversewiki /home/universalomega/Worm_Wiki.xml --username-prefix=wikia:worm --no-updates --report=1 (END - exit=0) [02:21:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:22:48] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=wildbowliteraryuniversewiki (START) [02:22:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:23:10] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.15, 3.80, 3.78 [02:25:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.24, 4.40, 4.01 [02:26:08] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=wildbowliteraryuniversewiki (END - exit=2) [02:26:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:33:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.25, 3.90, 3.93 [02:35:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.13, 4.19, 4.04 [02:36:26] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.82, 6.59, 5.87 [02:38:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 1.92, 3.17, 5.67 [02:40:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 6.17, 4.89, 6.02 [02:40:22] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.17, 6.57, 6.04 [02:40:32] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/rebuildall.php --wiki=wildbowliteraryuniversewiki (END - exit=0) [02:40:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:40:59] !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/initSiteStats.php --wiki=wildbowliteraryuniversewiki --active --update (END - exit=0) [02:41:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:41:43] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/JSDQN [02:41:44] [02miraheze/mw-config] 07Universal-Omega 0374daf7c - use IP for jobchron121 in SCSVG [02:42:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 3.07, 4.10, 5.59 [02:42:57] miraheze/mw-config - Universal-Omega the build passed. [02:45:57] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to scsvg [02:46:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:46:04] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to scsvg - SUCCESS in 7s [02:46:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 7.14, 7.32, 6.62 [02:46:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:46:29] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True} to skip [02:46:30] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True} to skip - SUCCESS in 1s [02:46:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:46:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:50:35] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.42, 7.07, 6.19 [02:52:34] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.94, 6.79, 6.18 [02:54:22] !log [@test3] starting deploy of {'config': True} to skip [02:54:23] !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s [02:54:33] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.77, 6.74, 6.23 [02:54:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:54:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:56:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 2.20, 4.62, 5.98 [02:56:34] PROBLEM - commons.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING [02:56:34] rse DNS entry for commons.gyaanipedia.com could not be found [02:58:09] PROBLEM - robloxapi.wiki - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - reverse [02:58:09] ntry for robloxapi.wiki could not be found [02:58:49] PROBLEM - es.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [02:58:49] NS entry for es.gyaanipedia.com could not be found [02:59:04] PROBLEM - fr.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [02:59:04] NS entry for fr.gyaanipedia.com could not be found [02:59:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.22, 3.26, 3.85 [02:59:14] PROBLEM - hi.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [02:59:14] NS entry for hi.gyaanipedia.com could not be found [03:01:34] PROBLEM - thesimswiki.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugi [03:01:34] ck_reverse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['ns1.vultr.com.', 'ns2.vultr.com.'], 'CNAME': None} [03:02:07] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 2.77, 3.29, 4.93 [03:02:24] PROBLEM - mr.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [03:02:24] NS entry for mr.gyaanipedia.com could not be found [03:02:57] PROBLEM - dreamsit.com.br - LetsEncrypt on sslhost is CRITICAL: connect to address dreamsit.com.br and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [03:03:57] PROBLEM - mwtask1 Disk Space on mwtask1 is CRITICAL: DISK CRITICAL - free space: / 2781 MB (5% inode=89%); [03:04:04] PROBLEM - meta.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - r [03:04:04] DNS entry for meta.gyaanipedia.com could not be found [03:05:04] PROBLEM - de.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [03:05:04] NS entry for de.gyaanipedia.com could not be found [03:05:10] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.62, 2.49, 3.32 [03:05:44] PROBLEM - dc-multiverse.dcwikis.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/na [03:05:44] lugins/check_reverse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['ns-cloud-a1.googledomains.com.', 'ns-cloud-a2.googledomains.c [03:05:44] 'ns-cloud-a3.googledomains.com.', 'ns-cloud-a4.googledomains.com.'], 'CNAME': None} [03:05:54] PROBLEM - dreamsit.com.br - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])rDNS WARNING - reverse DNS entry for dreamsit.com.br could not be found [03:05:59] PROBLEM - enc.for.uz - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugins/ch [03:05:59] verse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['ns3.uz.', 'ns4.uz.', 'ns2.uz.', 'ns7.uz.', 'ns.uz.'], 'CNAME': None} [03:06:59] PROBLEM - housing.wiki - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugins/ [03:06:59] reverse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['ns3.dreamhost.com.', 'ns2.dreamhost.com.', 'ns1.dreamhost.com.'], 'CNAME': [03:07:04] PROBLEM - lg.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [03:07:04] NS entry for lg.gyaanipedia.com could not be found [03:07:09] PROBLEM - egoish.org - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugins/ch [03:07:09] verse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['dns1.registrar-servers.com.', 'dns2.registrar-servers.com.'], 'CNAME': 'egoi [03:07:09] aheze.org.'} [03:07:14] PROBLEM - wiki.3805.co.uk - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugi [03:07:14] ck_reverse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['ultra104.uk2.net.', 'ultra103.uk2.net.'], 'CNAME': '3805.miraheze.org.' [03:07:19] PROBLEM - wiki.fbpml.org - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugin [03:07:19] k_reverse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['ns1.hostnet.nl.', 'ns2.hostnetbv.com.', 'ns3.hostnetbv.nl.'], 'CNAME': ' [03:07:19] miraheze.org.'} [03:07:28] PROBLEM - wiki.mastodon.kr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.mastodon.kr' expires in 9 day(s) (Fri 14 Jan 2022 05:18:13 GMT +0000). [03:07:29] PROBLEM - wiki.meower.org - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugi [03:07:29] ck_reverse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['amanda.ns.cloudflare.com.', 'augustus.ns.cloudflare.com.'], 'CNAME': 'm [03:07:29] e.wgytcraft.cf.'} [03:07:39] PROBLEM - wiki.wisrail.de - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugi [03:07:39] ck_reverse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['dns2.registrar-servers.com.', 'dns1.registrar-servers.com.'], 'CNAME': [03:07:39] il.miraheze.org.'} [03:07:44] PROBLEM - pa.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [03:07:44] NS entry for pa.gyaanipedia.com could not be found [03:07:54] PROBLEM - wiki.raghuveer.net - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])rDNS WARNING - reverse DNS entry for wiki.raghuveer.net could not be found [03:07:59] PROBLEM - wiki.hausos.co - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugin [03:07:59] k_reverse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['ns49.domaincontrol.com.', 'ns50.domaincontrol.com.'], 'CNAME': 'hausos.m [03:07:59] e.org.'} [03:08:04] PROBLEM - zh.gyaanipedia.com - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')rDNS WARNING - rev [03:08:04] NS entry for zh.gyaanipedia.com could not be found [03:08:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 6.88, 8.30, 6.60 [03:08:19] PROBLEM - wiki.pacebi.org - reverse DNS on sslhost is WARNING: /usr/lib/nagios/plugins/check_reverse_dns.py:101: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead resolved_ip_addr = str(dns_resolver.query(hostname, 'AAAA')[0])/usr/lib/nagios/plugins/check_reverse_dns.py:103: DeprecationWarning: please use dns.resolver.resolve() instead rev_host = str(resolver.query(ptr_record, "PTR")[0]).rstrip('.')/usr/lib/nagios/plugi [03:08:19] ck_reverse_dns.py:66: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead nameserversans = dns_resolver.query(root_domain, 'NS')/usr/lib/nagios/plugins/check_reverse_dns.py:79: DeprecationWarning: please use dns.resolver.Resolver.resolve() instead cname = str(dns_resolver.query(hostname, 'CNAME')[0])SSL WARNING - rDNS OK but records conflict. {'NS': ['dns1.registrar-servers.com.', 'dns2.registrar-servers.com.'], 'CNAME': [03:08:19] i.miraheze.org.'} [03:11:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.79, 4.01, 3.70 [03:11:12] !log [@mw11] starting deploy of {'config': True} to ovlon [03:11:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:11:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:12:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 2.99, 5.41, 5.80 [03:12:31] [02puppet] 07Universal-Omega synchronize pull request 03#2211: check_reverse_dns: use `dns.resolver.Resolver.resolve()` - 13https://git.io/JSvEh [03:13:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.98, 3.83, 3.66 [03:14:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:15:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.36, 4.04, 3.75 [03:17:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.51, 3.72, 3.66 [03:18:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 16.39, 8.10, 6.43 [03:19:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.24, 3.92, 3.75 [03:22:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 2.96, 5.07, 5.55 [03:24:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 13.18, 8.31, 6.65 [03:27:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.47, 3.84, 3.87 [03:28:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 2.94, 5.45, 5.85 [03:37:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.16, 3.85, 3.77 [03:38:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 16.76, 6.55, 5.76 [03:39:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.99, 3.91, 3.80 [03:43:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.01, 3.93, 3.83 [03:46:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 2.79, 5.22, 5.71 [03:47:10] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.94, 3.71, 3.77 [03:52:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.22, 6.34, 5.86 [03:54:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 3.46, 5.22, 5.51 [03:58:07] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 2.61, 3.79, 4.85 [04:01:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.68, 3.16, 3.40 [04:04:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:06:15] [02puppet] 07Universal-Omega opened pull request 03#2259: MediaWiki: install shellbox - 13https://git.io/JSDjg [04:13:39] [02puppet] 07Universal-Omega edited pull request 03#2259: MediaWiki: install shellbox - 13https://git.io/JSDjg [04:15:10] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.81, 3.20, 3.20 [04:15:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:15:44] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.13, 2.12, 1.29 [04:17:42] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.12, 1.69, 1.23 [04:20:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:21:22] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.58, 6.47, 5.42 [04:21:25] [02puppet] 07Universal-Omega edited pull request 03#2259: MediaWiki: configure shellbox - 13https://git.io/JSDjg [04:23:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.11, 3.26, 3.25 [04:23:19] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.58, 5.73, 5.27 [04:24:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:28:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 2.96, 5.12, 4.78 [04:30:07] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 3.31, 4.50, 4.58 [04:38:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 6.12, 14.35, 9.73 [04:44:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:47:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:51:50] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.93, 3.38, 3.11 [04:55:44] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.68, 3.10, 3.06 [04:58:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 2.66, 3.99, 5.81 [05:02:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 13.95, 5.98, 5.99 [05:03:30] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.21, 3.52, 3.24 [05:04:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 5.69, 5.68, 5.89 [05:07:26] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.87, 3.39, 3.26 [05:11:17] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.64, 3.50, 3.33 [05:12:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 8.20, 7.07, 6.25 [05:12:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:13:14] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.08, 3.07, 3.20 [05:14:07] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 3.38, 5.65, 5.83 [05:17:09] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.19, 3.67, 3.40 [05:19:09] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.39, 3.66, 3.44 [05:23:11] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.39, 3.34, 3.37 [05:24:07] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 7.54, 5.23, 5.42 [05:26:07] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 3.35, 4.42, 5.09 [05:29:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:34:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:50:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:53:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.58, 3.71, 3.23 [05:55:10] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.62, 3.52, 3.20 [06:00:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:01:34] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.77, 6.56, 5.41 [06:03:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.12, 3.73, 3.40 [06:03:33] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.65, 5.99, 5.35 [06:03:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:05:10] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.68, 3.49, 3.36 [06:08:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:09:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.59, 3.15, 3.27 [06:14:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:22:45] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.42, 1.83, 1.40 [06:24:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:24:43] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.88, 1.83, 1.46 [06:32:33] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.59, 1.66, 1.54 [06:39:39] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.89, 3.47, 3.29 [06:42:17] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.90, 1.82, 1.66 [06:43:33] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.58, 3.83, 3.46 [06:45:30] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.17, 3.18, 3.27 [06:46:49] PROBLEM - db121 Current Load on db121 is WARNING: WARNING - load average: 3.96, 5.56, 4.89 [06:47:37] RECOVERY - jobchron1 APT on jobchron1 is OK: APT OK: 1 packages available for upgrade (0 critical updates). [06:47:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:48:10] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 1.47, 1.64, 1.63 [06:50:39] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 3.40, 4.74, 4.73 [06:51:19] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.20, 3.44, 3.34 [06:54:04] PROBLEM - mwtask111 Current Load on mwtask111 is CRITICAL: CRITICAL - load average: 2.01, 2.02, 1.81 [06:56:01] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 1.64, 1.84, 1.77 [06:56:25] PROBLEM - db121 Current Load on db121 is CRITICAL: CRITICAL - load average: 5.91, 6.35, 5.41 [06:57:10] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.39, 3.16, 3.27 [06:58:20] RECOVERY - db121 Current Load on db121 is OK: OK - load average: 2.61, 5.01, 5.03 [06:59:57] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.77, 1.47, 1.65 [07:03:10] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.11, 3.68, 3.45 [07:05:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.19, 3.09, 3.26 [07:27:12] [02puppet] 07Universal-Omega opened pull request 03#2260: mwscript: add `cargoRecreateData.php` to longscripts - 13https://git.io/JSy9F [07:32:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:03:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:08:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:20:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:35:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:21:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:26:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:55:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:00:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:16:39] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:21:39] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:24:03] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://git.io/JSSkW [10:24:05] [02miraheze/mw-config] 07Universal-Omega 0389f8cdc - Add `$wgTemplateStylesNamespaces` to ManageWikiNamespaces [10:24:06] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://git.io/vbvb3 [10:25:08] [02mw-config] 07Universal-Omega opened pull request 03#4341: Add `$wgTemplateStylesNamespaces` to ManageWikiNamespaces - 13https://git.io/JSSk8 [10:26:20] miraheze/mw-config - Universal-Omega the build passed. [10:26:39]