[00:00:55] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.25, 3.34, 2.88 [00:01:15] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.76, 11.93, 11.00 [00:01:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.52, 11.42, 10.35 [00:02:55] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.49, 3.09, 2.85 [00:03:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.67, 10.83, 10.72 [00:03:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.97, 4.40, 3.78 [00:04:27] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.36, 9.52, 10.18 [00:05:38] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Puppet has 775 failures. Last run 4 minutes ago with 775 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg],File[/usr/local/bin/puppet-enabled],File[/etc/rsyslog.d],File[/etc/rsyslog.conf] [00:05:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.16, 11.17, 10.53 [00:06:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.32, 11.26, 10.83 [00:07:34] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.73, 3.67 [00:08:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.18, 11.14, 10.84 [00:10:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.12, 11.90, 11.16 [00:10:39] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [00:11:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.90, 11.74, 10.92 [00:12:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.28, 11.46, 11.08 [00:13:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.04, 9.08, 9.94 [00:13:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.64, 11.53, 10.94 [00:15:24] !log sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /home/universalomega/makeManageWikiConfigArray.php [00:15:29] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.87, 3.77, 3.64 [00:15:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.52, 3.34, 3.04 [00:15:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:16:27] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.84, 10.64, 10.19 [00:17:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.79, 10.96, 10.54 [00:17:27] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.57, 2.72, 2.85 [00:17:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.33, 3.17, 3.44 [00:17:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.85, 11.56, 11.03 [00:18:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.46, 12.29, 11.48 [00:19:29] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.05, 2.86, 3.29 [00:20:27] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.70, 9.55, 9.89 [00:23:32] [02mw-config] 07Universal-Omega edited pull request 03#4568: undo hack for wikipages and users type configs - 13https://github.com/miraheze/mw-config/pull/4568 [00:23:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.28, 11.36, 11.22 [00:24:02] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:25:25] [02mw-config] 07Universal-Omega closed pull request 03#4568: undo hack for wikipages and users type configs - 13https://github.com/miraheze/mw-config/pull/4568 [00:25:27] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [00:25:29] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [00:25:30] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±3] 13https://github.com/miraheze/mw-config/compare/e1d78c042bba...0407166fa636 [00:25:31] [02miraheze/mw-config] 07Universal-Omega 030407166 - undo hack for wikipages and users type configs (#4568) [00:25:33] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True} to all [00:25:47] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:25:56] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 22s [00:26:12] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:26:18] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True} to all [00:26:20] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 2s [00:26:43] miraheze/mw-config - Universal-Omega the build passed. [00:26:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:27:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:28:24] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.46, 3.44 [00:29:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.06, 10.97, 11.06 [00:30:03] !log sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /home/universalomega/makeManageWikiConfigsArray.php [00:30:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:32:21] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.26, 3.18, 3.35 [00:32:26] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/59c9a041359c...fa6c29d31629 [00:32:28] [02miraheze/ManageWiki] 07Universal-Omega 03fa6c29d - remove now-unnecessary array type casting [00:35:33] [02mw-config] 07Universal-Omega edited pull request 03#4568: undo hack for wikipages and users type configs - 13https://github.com/miraheze/mw-config/pull/4568 [00:35:42] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.06, 11.50, 11.31 [00:36:17] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.23, 4.26, 3.70 [00:37:09] miraheze/ManageWiki - Universal-Omega the build passed. [00:37:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.29, 11.82, 11.45 [00:39:21] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.30, 3.44, 2.98 [00:39:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.88, 11.20, 11.28 [00:40:10] [02mw-config] 07Universal-Omega reviewed pull request 03#4545 commit - 13https://github.com/miraheze/mw-config/pull/4545#discussion_r848974975 [00:40:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.78, 3.62, 3.57 [00:41:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.70, 9.50, 10.20 [00:41:19] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.66, 3.19, 2.95 [00:41:30] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:42:26] [02mw-config] 07Universal-Omega commented on pull request 03#4534: GeoData config for gratisdata - 13https://github.com/miraheze/mw-config/pull/4534#issuecomment-1097432421 [00:42:35] [02mw-config] 07Universal-Omega closed pull request 03#4534: GeoData config for gratisdata - 13https://github.com/miraheze/mw-config/pull/4534 [00:42:37] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/0407166fa636...a52c487dab0c [00:42:38] [02miraheze/mw-config] 07ugochimobi 03a52c487 - GeoData config for gratisdata (#4534) [00:43:12] [02mw-config] 07Universal-Omega synchronize pull request 03#4535: Set globe for coordinates added to GeoData - 13https://github.com/miraheze/mw-config/pull/4535 [00:43:30] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22335 bytes in 1.165 second response time [00:43:40] miraheze/mw-config - Universal-Omega the build passed. [00:44:14] [02mw-config] 07Universal-Omega synchronize pull request 03#4535: Set globe for coordinates added to GeoData - 13https://github.com/miraheze/mw-config/pull/4535 [00:45:00] [02mw-config] 07Universal-Omega synchronize pull request 03#4535: Set globe for coordinates added to GeoData - 13https://github.com/miraheze/mw-config/pull/4535 [00:45:12] miraheze/mw-config - Universal-Omega the build passed. [00:45:46] [02mw-config] 07Universal-Omega closed pull request 03#4535: Set globe for coordinates added to GeoData - 13https://github.com/miraheze/mw-config/pull/4535 [00:45:47] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/a52c487dab0c...affd1c55ca0c [00:45:49] [02miraheze/mw-config] 07ugochimobi 03affd1c5 - Set globe for coordinates added to GeoData (#4535) [00:45:59] miraheze/mw-config - Universal-Omega the build passed. [00:46:09] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.06, 3.08, 3.36 [00:46:44] miraheze/mw-config - Universal-Omega the build passed. [00:46:48] [02mw-config] 07Universal-Omega commented on pull request 03#4533: WBQuality constraint configs for gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4533#issuecomment-1097434766 [00:47:00] [02mw-config] 07Universal-Omega closed pull request 03#4533: WBQuality constraint configs for gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4533 [00:47:02] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/affd1c55ca0c...db7e3e5489b7 [00:47:03] [02miraheze/mw-config] 07ugochimobi 03db7e3e5 - WBQuality constraint configs for gratisdatawiki (#4533) [00:47:18] [02mw-config] 07Universal-Omega closed pull request 03#4374: Re-enable score with shellbox - 13https://github.com/miraheze/mw-config/pull/4374 [00:47:20] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-5 [00:47:22] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-5 - 13https://github.com/miraheze/mw-config [00:47:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.56, 11.09, 11.07 [00:48:11] miraheze/mw-config - Universal-Omega the build passed. [00:48:27] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.01, 10.88, 10.20 [00:49:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.78, 10.62, 10.30 [00:49:39] !log [@test101] starting deploy of {'config': True} to all [00:49:40] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [00:49:43] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.82, 1.91, 1.47 [00:49:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:50:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:51:40] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.37, 1.70, 1.44 [00:52:48] !log [@mwtask111] starting deploy of {'config': True} to all [00:53:11] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 23s [00:53:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:53:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.65, 9.66, 9.99 [00:53:25] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/8b96974a1d3c...1c78ba366ba3 [00:53:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:53:26] [02miraheze/mediawiki] 07Universal-Omega 031c78ba3 - Update ManageWiki [00:54:47] !log [universalomega@test101] starting deploy of {'world': True} to all [00:55:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:59:29] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.13, 1.84, 1.58 [00:59:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.99, 11.40, 11.55 [01:00:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.46, 11.20, 11.94 [01:00:27] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.78, 9.74, 10.09 [01:01:10] !log [universalomega@test101] finished deploy of {'world': True} to all - SUCCESS in 382s [01:01:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:02:08] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.23, 10.73, 10.28 [01:02:35] !log [universalomega@mwtask111] starting deploy of {'world': True} to all [01:02:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:03:12] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.35, 3.34, 2.93 [01:03:22] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.40, 1.72, 1.60 [01:04:02] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.86, 11.69, 11.93 [01:05:06] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.63, 3.07, 2.88 [01:05:19] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.16, 1.56, 1.56 [01:05:59] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.75, 9.84, 10.07 [01:09:39] !log [universalomega@mwtask111] finished deploy of {'world': True} to all - SUCCESS in 424s [01:09:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:11:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.08, 11.32, 11.10 [01:12:15] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.02, 10.69, 10.21 [01:13:40] [02mw-config] 07ugochimobi commented on pull request 03#4534: GeoData config for gratisdata - 13https://github.com/miraheze/mw-config/pull/4534#issuecomment-1097449906 [01:14:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.81, 11.35, 11.95 [01:14:12] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.89, 10.54, 10.23 [01:14:20] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.48, 10.12, 9.37 [01:14:24] [02puppet] 07Universal-Omega opened pull request 03#2483: CSP: add `*.betaheze.org` to all sources - 13https://github.com/miraheze/puppet/pull/2483 [01:15:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.95, 11.21, 11.14 [01:15:42] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.57, 10.35, 10.17 [01:16:16] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.78, 9.70, 9.31 [01:18:35] [02mw-config] 07ugochimobi commented on pull request 03#4533: WBQuality constraint configs for gratisdatawiki - 13https://github.com/miraheze/mw-config/pull/4533#issuecomment-1097452337 [01:19:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.04, 11.09, 11.05 [01:20:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.81, 11.99, 11.93 [01:21:30] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.38, 10.87, 10.40 [01:21:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.02, 10.69, 10.92 [01:23:26] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.36, 10.87, 10.47 [01:24:57] PROBLEM - cp31 Stunnel HTTP for mw111 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:25:01] PROBLEM - cp30 Stunnel HTTP for mw111 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:25:02] PROBLEM - mw111 MediaWiki Rendering on mw111 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:25:22] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.18, 11.17, 10.62 [01:25:41] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/db7e3e5489b7...5412fed79665 [01:25:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.45, 11.24, 11.05 [01:25:42] [02miraheze/mw-config] 07Universal-Omega 035412fed - Add associativeKey to comment [01:26:45] miraheze/mw-config - Universal-Omega the build passed. [01:26:56] RECOVERY - cp30 Stunnel HTTP for mw111 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.313 second response time [01:26:56] RECOVERY - cp31 Stunnel HTTP for mw111 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.601 second response time [01:27:04] RECOVERY - mw111 MediaWiki Rendering on mw111 is OK: HTTP OK: HTTP/1.1 200 OK - 22335 bytes in 2.853 second response time [01:27:18] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.28, 10.93, 10.58 [01:27:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.04, 11.07, 11.01 [01:29:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.90, 11.71, 11.25 [01:31:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.49, 11.10, 10.68 [01:31:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.54, 10.94, 11.03 [01:35:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.40, 11.51, 10.96 [01:37:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.36, 11.62, 11.05 [01:39:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.37, 11.31, 11.00 [01:41:23] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.23, 11.36, 10.86 [01:43:20] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.23, 11.38, 10.94 [01:44:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.56, 10.00, 9.50 [01:45:39] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.54, 10.25, 9.41 [01:45:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.08, 11.14, 10.97 [01:46:17] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.86, 1.63, 1.40 [01:46:17] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.87, 9.35, 9.34 [01:48:59] [02CreateWiki] 07Universal-Omega commented on pull request 03#315: Inject CreateWikiHookRunner - 13https://github.com/miraheze/CreateWiki/pull/315#issuecomment-1097466623 [01:49:09] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.10, 11.39, 11.02 [01:49:28] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.49, 10.05, 9.58 [01:49:53] !log [@test101] starting deploy of {'config': True} to all [01:49:54] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 0s [01:50:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.55, 11.55, 11.98 [01:50:10] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.03, 1.84, 1.53 [01:50:16] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:50:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:50:37] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [01:50:38] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/3d5324d8091e...930076fd441e [01:50:39] [02miraheze/CreateWiki] 07Universal-Omega 03930076f - warn instead of info [01:50:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:51:06] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.03, 9.99, 10.55 [01:51:37] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:51:47] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [01:51:48] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [01:51:50] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/930076fd441e...5605714ea6b7 [01:51:51] [02miraheze/CreateWiki] 07Universal-Omega 035605714 - *warning [01:52:07] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.29, 1.62, 1.49 [01:52:59] !log [@mwtask111] starting deploy of {'config': True} to all [01:53:18] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 19s [01:53:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:53:30] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:53:39] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 8.027 second response time [01:53:50] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 6.778 second response time [01:54:20] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 2.212 second response time [01:54:22] miraheze/CreateWiki - Universal-Omega the build has errored. [01:54:59] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.15, 10.49, 10.55 [01:56:47] [02CreateWiki] 07Universal-Omega synchronize pull request 03#312: Create new CreateWikiRegexConstraint class - 13https://github.com/miraheze/CreateWiki/pull/312 [01:56:48] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/5605714ea6b7...ff2d6207c926 [01:56:50] [02miraheze/CreateWiki] 07Universal-Omega 03ff2d620 - `logInvalidRegex()` -> `warnInvalidRegex()` [01:56:56] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.39, 10.14, 10.42 [01:57:40] miraheze/CreateWiki - Universal-Omega the build has errored. [01:57:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.41, 11.75, 11.60 [01:58:12] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.03, 3.82, 3.02 [01:58:52] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.31, 8.96, 9.94 [01:59:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.39, 9.41, 10.10 [02:00:09] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.47, 3.25, 2.90 [02:00:18] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:00:47] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [02:00:55] miraheze/CreateWiki - Universal-Omega the build has errored. [02:01:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.02, 12.02, 11.71 [02:02:24] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 9.574 second response time [02:02:50] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 7.838 second response time [02:03:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.85, 11.21, 10.70 [02:03:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.90, 11.51, 11.55 [02:04:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.29, 11.49, 11.46 [02:05:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.68, 10.59, 10.54 [02:05:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.81, 11.96, 11.71 [02:08:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.83, 11.73, 11.63 [02:09:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.61, 11.35, 10.83 [02:10:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.55, 11.80, 11.65 [02:11:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.86, 11.34, 10.90 [02:11:33] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.08, 10.77, 10.12 [02:11:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.82, 11.88, 11.79 [02:13:06] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [02:13:06] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [02:13:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.33, 11.40, 10.96 [02:13:30] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.66, 10.81, 10.20 [02:14:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.99, 11.85, 11.76 [02:15:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.91, 11.78, 11.16 [02:16:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.50, 12.02, 11.85 [02:16:15] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.96, 10.12, 9.54 [02:17:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.17, 11.56, 11.65 [02:18:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.02, 11.71, 11.77 [02:18:10] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 8.78, 9.35, 9.31 [02:19:19] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.69, 9.97, 10.05 [02:19:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.79, 11.75, 11.72 [02:20:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.34, 11.96, 11.85 [02:21:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.66, 11.95, 11.79 [02:22:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.00, 11.32, 11.63 [02:25:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.16, 11.40, 11.15 [02:25:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.67, 11.76, 11.77 [02:29:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.57, 11.71, 11.34 [02:30:04] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.32, 10.38, 10.11 [02:32:01] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.37, 10.10, 10.05 [02:33:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.57, 12.03, 11.49 [02:35:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.43, 11.44, 11.37 [02:35:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 14.73, 12.31, 11.88 [02:38:02] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 13.02, 11.57, 11.28 [02:39:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.17, 11.10, 11.15 [02:40:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.28, 10.85, 11.03 [02:41:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.18, 11.26, 11.21 [02:41:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.13, 11.49, 11.73 [02:41:58] [02CreateWiki] 07lens0021 commented on pull request 03#315: Inject CreateWikiHookRunner - 13https://github.com/miraheze/CreateWiki/pull/315#issuecomment-1097492874 [02:42:30] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [02:45:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.59, 11.71, 11.38 [02:45:42] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.03, 10.81, 10.16 [02:47:07] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.59, 9.33, 9.05 [02:47:38] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.60, 10.40, 10.07 [02:48:03] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.01, 9.38, 10.20 [02:48:56] [02CreateWiki] 07Universal-Omega commented on pull request 03#315: Inject CreateWikiHookRunner - 13https://github.com/miraheze/CreateWiki/pull/315#issuecomment-1097495483 [02:49:02] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.81, 9.53, 9.16 [02:49:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.44, 3.61, 3.30 [02:49:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.30, 11.76, 11.61 [02:51:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.33, 11.15, 11.33 [02:51:31] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.28, 9.91, 9.96 [02:51:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.46, 11.51, 11.54 [02:52:04] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.01, 10.42, 10.42 [02:53:29] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.70, 3.21, 3.22 [02:54:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.90, 10.01, 10.29 [02:55:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.77, 11.73, 11.61 [02:56:03] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.38, 9.78, 10.17 [02:57:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.73, 11.70, 11.61 [03:01:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.40, 11.40, 11.10 [03:02:27] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.50, 10.56, 10.19 [03:03:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.68, 11.35, 11.14 [03:03:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.57, 11.87, 11.63 [03:04:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.72, 10.54, 10.39 [03:07:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.91, 11.08, 11.40 [03:08:02] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.37, 11.13, 10.65 [03:09:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.41, 11.74, 11.33 [03:10:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.00, 10.93, 10.65 [03:10:27] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.97, 11.35, 10.62 [03:11:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.61, 11.08, 11.15 [03:14:27] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.75, 11.65, 10.97 [03:15:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.57, 10.66, 10.94 [03:16:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.49, 4.04, 3.47 [03:17:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.98, 10.97, 11.01 [03:18:02] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.16, 9.23, 10.01 [03:18:09] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.64, 3.73, 3.42 [03:19:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.68, 11.68, 11.27 [03:20:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.07, 3.10, 3.22 [03:21:03] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.73, 2.11, 1.58 [03:23:03] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.37, 1.78, 1.52 [03:23:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.65, 11.95, 11.50 [03:24:58] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.03, 11.29, 10.70 [03:25:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.07, 11.05, 11.04 [03:25:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.23, 12.00, 11.57 [03:26:27] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.13, 11.65, 10.98 [03:26:54] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.42, 10.16, 10.36 [03:27:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.25, 10.96, 11.22 [03:29:03] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.57, 1.68, 1.56 [03:29:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.39, 11.22, 11.12 [03:29:51] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.10, 2.11, 1.50 [03:31:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.65, 11.87, 11.38 [03:31:50] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.66, 1.64, 1.40 [03:32:27] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.15, 11.13, 11.07 [03:35:03] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.66, 1.73, 1.63 [03:37:03] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.43, 1.64, 1.61 [03:37:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.71, 3.60, 3.36 [03:41:48] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.76, 3.95, 3.53 [03:42:18] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.05, 3.36, 2.79 [03:42:55] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 8.39, 5.33, 3.73 [03:43:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.07, 11.05, 11.57 [03:43:14] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [03:44:31] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 10.88, 10.38, 9.73 [03:46:26] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 9.50, 10.16, 9.73 [03:49:03] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.32, 1.79, 1.60 [03:49:40] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.89, 1.55, 1.37 [03:49:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.17, 10.96, 10.66 [03:51:03] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.26, 1.59, 1.55 [03:51:09] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [03:51:39] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.05, 1.28, 1.28 [03:53:07] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22334 bytes in 3.698 second response time [03:53:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.89, 11.81, 11.11 [03:53:44] [02mw-config] 07lens0021 opened pull request 03#4569: Add ExtensionsTest.php - 13https://github.com/miraheze/mw-config/pull/4569 [03:54:27] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 9.54, 9.69, 10.19 [03:54:42] miraheze/mw-config - lens0021 the build passed. [03:57:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:59:26] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 10.49, 9.60, 8.76 [04:01:08] [02mw-config] 07Universal-Omega closed pull request 03#4569: Add ExtensionsTest.php - 13https://github.com/miraheze/mw-config/pull/4569 [04:01:10] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±2] 13https://github.com/miraheze/mw-config/compare/5412fed79665...4bcb7f57229c [04:01:11] [02miraheze/mw-config] 07lens0021 034bcb7f5 - Add ExtensionsTest (#4569) [04:01:16] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.30, 11.29, 10.88 [04:01:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.83, 11.12, 10.88 [04:02:03] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.45, 9.96, 10.18 [04:02:18] miraheze/mw-config - Universal-Omega the build passed. [04:03:26] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.80, 9.12, 8.75 [04:03:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.82, 11.07, 10.90 [04:05:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 10.40, 11.33, 11.04 [04:06:03] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.58, 11.18, 10.60 [04:07:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.05, 11.44, 11.11 [04:07:18] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.12, 11.07, 10.53 [04:08:03] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.52, 10.92, 10.58 [04:09:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.26, 10.75, 10.90 [04:09:14] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.35, 11.20, 10.65 [04:09:41] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.05, 8.71, 9.95 [04:10:02] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.41, 9.80, 10.20 [04:11:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.77, 3.62, 4.00 [04:12:39] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [04:12:39] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [04:13:08] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.93, 11.56, 10.87 [04:13:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.52, 3.93, 4.05 [04:15:04] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 10.47, 11.10, 10.78 [04:19:19] !log [@test101] starting deploy of {'config': True} to all [04:19:21] !log [@test101] finished deploy of {'config': True} to all - SUCCESS in 1s [04:19:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:19:41] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 11.53, 10.62, 10.16 [04:20:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:21:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.23, 3.83, 3.96 [04:21:49] !log [@mwtask111] starting deploy of {'config': True} to all [04:22:09] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 19s [04:22:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:22:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:22:50] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.74, 9.39, 10.08 [04:23:14] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.60, 8.82, 9.89 [04:26:46] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.34, 10.80, 10.47 [04:28:42] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.73, 10.13, 10.25 [04:30:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.64, 11.14, 10.61 [04:31:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 13.47, 10.78, 10.14 [04:31:41] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.66, 9.81, 10.12 [04:32:18] [02mw-config] 07lens0021 opened pull request 03#4570: Add missing schema and copy the descriptions - 13https://github.com/miraheze/mw-config/pull/4570 [04:32:54] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.71, 3.43, 3.89 [04:33:03] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.12, 1.81, 1.51 [04:33:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.14, 10.84, 10.25 [04:33:21] miraheze/mw-config - lens0021 the build passed. [04:34:32] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.10, 11.38, 10.86 [04:34:55] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 6.00, 4.26, 4.13 [04:35:03] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.54, 1.69, 1.50 [04:35:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.73, 11.30, 10.47 [04:35:46] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.10, 3.62, 3.63 [04:37:39] [02mw-config] 07Universal-Omega closed pull request 03#4570: Add missing schema and copy the descriptions - 13https://github.com/miraheze/mw-config/pull/4570 [04:37:41] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±4] 13https://github.com/miraheze/mw-config/compare/4bcb7f57229c...a37d05b9ef86 [04:37:42] [02miraheze/mw-config] 07lens0021 03a37d05b - Add missing schema and copy the descriptions (#4570) [04:37:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.47, 3.57 [04:38:54] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.93, 3.62, 3.90 [04:38:55] miraheze/mw-config - Universal-Omega the build passed. [04:39:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.41, 11.79, 10.90 [04:40:36] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-1/±0] 13https://github.com/miraheze/mw-config/compare/a37d05b9ef86...d9eb22eaae5e [04:40:38] [02miraheze/mw-config] 07Universal-Omega 03d9eb22e - Delete LocalSettings.php [04:40:47] PROBLEM - phab121 APT on phab121 is CRITICAL: APT CRITICAL: 45 packages available for upgrade (2 critical updates). [04:41:14] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/mw-config/compare/d9eb22eaae5e...6069a37ad493 [04:41:16] [02miraheze/mw-config] 07Universal-Omega 036069a37 - Whoops! [04:41:26] Crap! [04:41:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.17, 3.30, 3.86 [04:41:46] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.23, 2.86, 3.30 [04:41:50] miraheze/mw-config - Universal-Omega the build passed. [04:42:03] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [04:42:32] miraheze/mw-config - Universal-Omega the build passed. [04:42:35]