[00:00:19] [02puppet] 07Universal-Omega synchronize pull request 03#2399: Replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2399 [00:01:35] [02puppet] 07Universal-Omega synchronize pull request 03#2399: Replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2399 [00:02:25] [02puppet] 07Universal-Omega synchronize pull request 03#2399: Replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2399 [00:03:14] [02puppet] 07Universal-Omega synchronize pull request 03#2399: Replace `require_package` with `ensure_packages` - 13https://github.com/miraheze/puppet/pull/2399 [00:06:22] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Puppet has 303 failures. Last run 4 minutes ago with 303 failures. Failed resources (up to 3 shown): File[/etc/apt/trusted.gpg.d/puppetlabs.gpg],File[/usr/local/bin/puppet-enabled],File[authority certificates],File[/etc/apt/apt.conf.d/50unattended-upgrades] [00:09:31] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.90, 9.15, 9.86 [00:10:29] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.47, 7.88, 8.34 [00:11:36] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/13a46fb7e851...7360cc452246 [00:11:37] [02miraheze/mw-config] 07Universal-Omega 037360cc4 - Update LocalSettings.php [00:12:47] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.92, 9.89, 10.02 [00:13:44] miraheze/mw-config - Universal-Omega the build passed. [00:19:10] !log [@test101] starting deploy of {'config': True} to skip [00:19:11] !log [@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s [00:19:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:20:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:23:12] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.40, 1.93, 1.78 [00:25:44] PROBLEM - mwtask111 Current Load on mwtask111 is WARNING: WARNING - load average: 0.49, 1.15, 1.90 [00:26:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.62, 1.34, 1.57 [00:26:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/090d0af9eb37 [00:26:51] [02miraheze/mw-config] 07Universal-Omega 03090d0af - Set WANCache for betawiki [00:26:52] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://github.com/miraheze/mw-config [00:26:54] [02mw-config] 07Universal-Omega opened pull request 03#4441: Set WANCache for betawiki - 13https://github.com/miraheze/mw-config/pull/4441 [00:28:01] miraheze/mw-config - Universal-Omega the build passed. [00:28:32] [02mw-config] 07Universal-Omega closed pull request 03#4441: Set WANCache for betawiki - 13https://github.com/miraheze/mw-config/pull/4441 [00:28:33] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7360cc452246...773d53d0a0cc [00:28:35] [02miraheze/mw-config] 07Universal-Omega 03773d53d - Set WANCache for betawiki (#4441) [00:28:36] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://github.com/miraheze/mw-config [00:28:38] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [00:28:57] RECOVERY - mwtask111 Current Load on mwtask111 is OK: OK - load average: 0.02, 0.59, 1.53 [00:29:42] miraheze/mw-config - Universal-Omega the build passed. [00:32:18] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:33:48] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-3/±1] 13https://github.com/miraheze/mediawiki/compare/3d2d09e3efae...3aa6719a3bcf [00:33:49] [02miraheze/mediawiki] 07Universal-Omega 033aa6719 - Revert "install ES extensions" [00:34:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:35:03] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True} to skip [00:35:05] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True} to skip - SUCCESS in 1s [00:35:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:35:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:36:13] !log [universalomega@test101] starting deploy of {'world': True, 'l10n': True, 'extensionlist': True, 'force': True} to skip [00:36:36] !log [universalomega@mwtask111] starting deploy of {'world': True, 'l10n': True, 'extensionlist': True, 'force': True} to all [00:36:48] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:37:00] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:41:03] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.08, 8.84, 9.79 [00:41:28] 503 Backend fetch failed xD [00:41:33] !log [universalomega@test101] finished deploy of {'world': True, 'l10n': True, 'extensionlist': True, 'force': True} to skip - SUCCESS in 319s [00:41:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:50:16] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.14, 11.08, 10.23 [01:01:09] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+1/-0/±1] 13https://github.com/miraheze/mediawiki/compare/3aa6719a3bcf...de26f10ad812 [01:01:10] [02miraheze/mediawiki] 07Universal-Omega 03de26f10 - Install SemanticMediaWiki (T7000) [01:06:27] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.22, 9.14, 9.83 [01:06:53] !log [universalomega@mwtask111] finished deploy of {'world': True, 'l10n': True, 'extensionlist': True, 'force': True} to all - SUCCESS in 1816s [01:07:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:09:32] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.24, 9.39, 9.74 [01:10:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 3.87, 3.49 [01:12:44] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.35, 9.39, 9.69 [01:18:57] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.87, 10.46, 9.98 [01:22:36] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.32, 2.96, 3.27 [01:24:42] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [01:29:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:31:59] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/de26f10ad812...d7b58847655d [01:32:00] [02miraheze/mediawiki] 07Universal-Omega 03d7b5884 - Update non-rel-extensions [01:33:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:35:29] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True, 'force': True} to all [01:35:43] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:36:01] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True, 'force': True} to all - SUCCESS in 32s [01:36:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:36:46] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.92, 9.43, 8.87 [01:37:23] !log [universalomega@test101] starting deploy of {'world': True, 'extensionlist': True, 'force': True} to skip [01:37:46] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.39, 9.38, 9.89 [01:37:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:39:56] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.94, 9.61, 9.01 [01:40:12] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.36, 9.62, 8.93 [01:40:51] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.72, 10.56, 10.27 [01:41:09] !log [universalomega@test101] finished deploy of {'world': True, 'extensionlist': True, 'force': True} to skip - SUCCESS in 225s [01:41:18] PROBLEM - db111 Current Load on db111 is WARNING: WARNING - load average: 2.22, 4.00, 7.96 [01:41:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:42:53] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.75, 9.79, 9.21 [01:43:08] !log [universalomega@mwtask111] starting deploy of {'world': True, 'extensionlist': True, 'force': True} to all [01:43:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:45:04] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±2] 13https://github.com/miraheze/mediawiki/commit/0998d9325ae0 [01:45:05] [02miraheze/mediawiki] 07Universal-Omega 030998d93 - Switch Maps back to master [01:45:07] [02mediawiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mediawiki [01:45:49] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-3 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/64800e8a1167 [01:45:51] [02miraheze/mw-config] 07Universal-Omega 0364800e8 - add SemanticMediaWiki to extension-list [01:45:52] [02mw-config] 07Universal-Omega created branch 03Universal-Omega-patch-3 - 13https://github.com/miraheze/mw-config [01:45:54] [02mw-config] 07Universal-Omega opened pull request 03#4442: add SemanticMediaWiki to extension-list - 13https://github.com/miraheze/mw-config/pull/4442 [01:46:04] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.49, 9.53, 9.19 [01:46:44] [02mediawiki] 07Universal-Omega opened pull request 03#5129: Switch Maps back to master - 13https://github.com/miraheze/mediawiki/pull/5129 [01:47:00] miraheze/mw-config - Universal-Omega the build passed. [01:47:14] RECOVERY - db111 Current Load on db111 is OK: OK - load average: 1.78, 2.62, 6.05 [01:47:18] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/0998d9325ae0...b5f019513bec [01:47:19] [02miraheze/mediawiki] 07Universal-Omega 03b5f0195 - Update non-rel-extensions [01:47:21] [02mediawiki] 07Universal-Omega synchronize pull request 03#5129: Switch Maps back to master - 13https://github.com/miraheze/mediawiki/pull/5129 [01:48:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:48:45] [02mw-config] 07Universal-Omega closed pull request 03#4442: add SemanticMediaWiki to extension-list - 13https://github.com/miraheze/mw-config/pull/4442 [01:48:47] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/773d53d0a0cc...59c51a92f1a7 [01:48:49] [02miraheze/mw-config] 07Universal-Omega 0359c51a9 - add SemanticMediaWiki to extension-list (#4442) [01:48:50] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 [01:48:51] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-3 - 13https://github.com/miraheze/mw-config [01:48:53] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 17.84, 12.94, 10.52 [01:48:58] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True} to skip [01:48:59] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True} to skip - SUCCESS in 1s [01:49:16] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True, 'force': True} to skip [01:49:17] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True, 'force': True} to skip - SUCCESS in 0s [01:49:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:49:37] !log [universalomega@test101] starting deploy of {'l10n': True, 'force': True} to skip [01:49:47] miraheze/mw-config - Universal-Omega the build passed. [01:50:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:51:07] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:51:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:51:22] !log [universalomega@mwtask111] finished deploy of {'world': True, 'extensionlist': True, 'force': True} to all - SUCCESS in 492s [01:51:36] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True, 'force': True} to all [01:51:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:51:57] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True, 'force': True} to all - SUCCESS in 21s [01:52:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:52:14] !log [universalomega@mwtask111] starting deploy of {'l10n': True, 'force': True} to all [01:52:20] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.46, 7.75, 8.48 [01:52:26] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:52:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:52:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:52:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:53:13] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures [01:57:59] [02mediawiki] 07Universal-Omega closed pull request 03#5129: Switch Maps back to master - 13https://github.com/miraheze/mediawiki/pull/5129 [01:58:00] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±3] 13https://github.com/miraheze/mediawiki/compare/d7b58847655d...aa855911e180 [01:58:02] [02miraheze/mediawiki] 07Universal-Omega 03aa85591 - Switch Maps back to master (#5129) [01:58:03] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mediawiki [01:58:05] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [02:02:19] !log [universalomega@test101] finished deploy of {'l10n': True, 'force': True} to skip - SUCCESS in 762s [02:02:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:02:55] !log [universalomega@test101] starting deploy of {'world': True, 'force': True} to skip [02:03:04] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:04:40] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.33, 2.89 [02:06:24] !log [universalomega@test101] finished deploy of {'world': True, 'force': True} to skip - SUCCESS in 208s [02:06:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:07:04] !log [universalomega@test101] starting deploy of {'l10n': True, 'force': True} to skip [02:07:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:07:42] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.75, 9.55, 8.50 [02:10:21] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.61, 8.38, 8.48 [02:10:58] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.43, 9.37, 8.65 [02:14:02] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.52, 2.81, 2.91 [02:14:06] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.73, 8.81, 8.29 [02:14:11] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.49, 8.40, 8.41 [02:14:12] !log [universalomega@mwtask111] finished deploy of {'l10n': True, 'force': True} to all - SUCCESS in 1318s [02:14:19] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:14:37] !log [universalomega@mwtask111] starting deploy of {'world': True, 'l10n': True, 'force': True} to all [02:14:42] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:19:43] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.09, 8.41, 8.50 [02:20:09] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.09, 8.90, 8.41 [02:21:01] !log [universalomega@test101] finished deploy of {'l10n': True, 'force': True} to skip - SUCCESS in 836s [02:21:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:23:17] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.18, 9.02, 8.55 [02:29:21] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.90, 7.91, 8.23 [02:29:48] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.10, 9.14, 8.76 [02:32:52] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.74, 9.19, 8.84 [02:32:59] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.71, 9.29, 9.94 [02:35:46] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.08, 8.75, 8.70 [02:36:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.20, 9.76, 9.14 [02:36:23] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 15.59, 12.89, 11.24 [02:38:10] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.05, 8.64, 9.55 [02:39:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.94, 7.93, 8.38 [02:39:25] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.69, 9.02, 8.97 [02:40:15] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 7.97, 10.08, 9.25 [02:42:32] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.77, 9.38, 9.07 [02:43:25] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.08, 8.26, 8.70 [02:43:34] !log [universalomega@mwtask111] finished deploy of {'world': True, 'l10n': True, 'force': True} to all - SUCCESS in 1737s [02:43:40] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:44:19] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.09, 1.79, 1.56 [02:45:49] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.58, 9.35, 9.98 [02:47:19] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.01, 1.39, 1.45 [02:47:19] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.06, 10.40, 9.98 [02:48:26] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.16, 8.57, 8.78 [02:48:41] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.12, 9.15, 9.77 [02:51:32] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.04, 9.29, 9.76 [02:52:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:53:22] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.22, 3.58, 3.28 [02:53:55] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.41, 1.99, 1.67 [02:54:05] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/CreateWiki/sql/cw_wikis.sql [02:54:14] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/CreateWiki/sql/cw_requests.sql [02:54:17] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:54:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:54:30] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/CreateWiki/sql/cw_comments.sql [02:54:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:55:37] !log INSERT INTO cw_wikis (wiki_dbname, wiki_sitename, wiki_language, wiki_private, wiki_creation, wiki_url, wiki_closed, wiki_closed_timestamp, wiki_deleted, wiki_deleted_timestamp, wiki_locked, wiki_inactive, wiki_inactive_timestamp, wiki_inactive_exempt, wiki_inactive_exempt_reason, wiki_settings, wiki_dbcluster, wiki_category, wiki_extensions, wiki_experimental) VALUES ('betawiki', 'Betaheze', 'en', 0, 20211219102330, [02:55:37] 'https://beta.betaheze.org', 0, NULL, 0, NULL, 0, 0, NULL, 1, NULL, NULL, 'c4', 'software', NULL, 1); on testglobal [02:55:38] [url] Wiki Not Found | beta.betaheze.org [02:55:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:56:19] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.89, 3.34, 3.25 [02:56:26] [02mw-config] 07Universal-Omega closed pull request 03#4326: Setup CreateWiki on betaheze - 13https://github.com/miraheze/mw-config/pull/4326 [02:56:28] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/mw-config [02:56:29] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [02:56:31] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/59c51a92f1a7...321f2151c7db [02:56:32] [02miraheze/mw-config] 07Universal-Omega 03321f215 - Setup CreateWiki on betaheze (#4326) [02:56:47] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True, 'force': True} to skip [02:56:49] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True, 'force': True} to skip - SUCCESS in 1s [02:56:54] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:56:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [02:57:32] miraheze/mw-config - Universal-Omega the build passed. [02:58:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:59:51] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.18, 1.96, 1.80 [03:00:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.67, 7.99, 8.36 [03:02:41] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.13, 8.77, 9.78 [03:05:16] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/ManageWiki/sql/mw_namespaces.sql [03:05:22] sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/ManageWiki/sql/mw_permissions.sql [03:05:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:05:31] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/ManageWiki/sql/mw_permissions.sql [03:05:41] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:05:44] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/ManageWiki/sql/mw_settings.sql [03:05:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:06:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.19, 7.33, 8.33 [03:06:59] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.83, 7.90, 8.40 [03:08:49] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.69, 1.98, 1.82 [03:09:00] [02mw-config] 07Universal-Omega closed pull request 03#4372: Change MatomoAnalytics database for betaheze - 13https://github.com/miraheze/mw-config/pull/4372 [03:09:01] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 - 13https://github.com/miraheze/mw-config [03:09:03] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-4 [03:09:04] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/321f2151c7db...3682a09de8dc [03:09:06] [02miraheze/mw-config] 07Universal-Omega 033682a09 - Change MatomoAnalytics database for betaheze (#4372) [03:09:46] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True, 'force': True} to skip [03:09:47] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True, 'force': True} to skip - SUCCESS in 0s [03:09:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:09:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:10:06] miraheze/mw-config - Universal-Omega the build passed. [03:10:11] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/MatomoAnalytics/sql/matomo.sql [03:10:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:10:43] [02mw-config] 07Universal-Omega closed pull request 03#4333: Change IncidentReporting database for betaheze - 13https://github.com/miraheze/mw-config/pull/4333 [03:10:44] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/3682a09de8dc...9eef7f7eed1a [03:10:46] [02miraheze/mw-config] 07Universal-Omega 039eef7f7 - Change IncidentReporting database for betaheze (#4333) [03:10:47] [02mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 - 13https://github.com/miraheze/mw-config [03:10:49] [02miraheze/mw-config] 07Universal-Omega deleted branch 03Universal-Omega-patch-2 [03:11:01] [02ManageWiki] 07lens0021 synchronize pull request 03#329: Add a new type 'integers' - 13https://github.com/miraheze/ManageWiki/pull/329 [03:11:49] miraheze/mw-config - Universal-Omega the build passed. [03:12:07] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True, 'force': True} to skip [03:12:08] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True, 'force': True} to skip - SUCCESS in 1s [03:12:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:12:27] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/IncidentReporting/sql/incidents.sql [03:12:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:12:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:12:33] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/IncidentReporting/sql/incidents_log.sql [03:12:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:12:47] [02ManageWiki] 07lens0021 commented on pull request 03#329: Add a new type 'integers' - 13https://github.com/miraheze/ManageWiki/pull/329#issuecomment-1022806300 [03:12:52] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/IncidentReporting/sql/incidents_reviewer.sql [03:12:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:13:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:13:47] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.50, 8.58, 8.55 [03:13:52] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki --wikidb=testglobal /srv/mediawiki/w/extensions/GlobalNewFiles/sql/gnf_files.sql [03:13:57] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:14:08] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.57, 1.77, 1.46 [03:15:51] miraheze/ManageWiki - lens0021 the build passed. [03:16:10] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True, 'force': True} to mw101 [03:16:15] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True, 'force': True} to mw101 - SUCCESS in 6s [03:16:16] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:16:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:16:46] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.19, 8.14, 8.37 [03:17:07] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 3.30, 2.16, 1.63 [03:17:19] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.37, 7.20, 8.29 [03:17:24] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True, 'force': True} to mw121 [03:17:26] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True, 'force': True} to mw121 - SUCCESS in 2s [03:17:28] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:17:34] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:17:42] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.84, 1.33, 1.60 [03:17:49] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True, 'force': True} to all [03:17:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:17:57] !log [universalomega@mwtask111] finished deploy of {'pull': 'config', 'config': True, 'force': True} to all - SUCCESS in 8s [03:18:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:19:04] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.75, 8.88, 9.93 [03:19:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:20:02] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.97, 1.60, 1.50 [03:21:36] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.69, 8.57, 8.30 [03:24:27] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.47, 2.22, 1.94 [03:24:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:27:21] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.74, 1.91, 1.85 [03:27:30] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 4.70, 6.41, 8.32 [03:30:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.11, 8.14, 8.33 [03:31:31] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/extensions/CreateWiki/sql/cw_requests.sql [03:31:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:31:40] !log sudo -u www-data php /srv/mediawiki/w/maintenance/sql.php --wiki=betawiki /srv/mediawiki/w/extensions/CreateWiki/sql/cw_comments.sql [03:31:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [03:33:10] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 3.84, 2.15, 1.91 [03:34:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:36:08] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.88, 1.53, 1.71 [03:37:05] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.40, 8.91, 8.63 [03:39:05] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.18, 1.55, 1.69 [03:39:08] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.08, 9.40, 8.72 [03:39:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.78, 9.06, 8.72 [03:42:02] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.89, 9.53, 8.92 [03:45:55] PROBLEM - test101 MediaWiki Rendering on test101 is WARNING: HTTP WARNING: HTTP/1.1 404 Not Found - 2550 bytes in 0.104 second response time [03:47:56] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.85, 9.07, 8.65 [03:48:55] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.18, 9.66, 9.09 [03:50:52] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.74, 10.13, 9.15 [03:51:32] [02ManageWiki] 07Universal-Omega closed pull request 03#329: Add a new type 'integers' - 13https://github.com/miraheze/ManageWiki/pull/329 [03:51:33] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±5] 13https://github.com/miraheze/ManageWiki/compare/951c544fd192...8ad4792956a8 [03:51:35] [02miraheze/ManageWiki] 07lens0021 038ad4792 - Add a new type 'integers' (#329) [03:51:49] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.27, 9.13, 8.99 [03:51:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.68, 8.57, 7.75 [03:53:45] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.74, 9.26, 8.99 [03:53:48] miraheze/ManageWiki - Universal-Omega the build has errored. [03:53:48] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.56, 9.81, 9.23 [03:56:39] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.23, 9.06, 9.05 [03:57:38] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.53, 7.49, 7.60 [03:57:54] [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/9eef7f7eed1a...434e8b812fe4 [03:57:55] [02miraheze/mw-config] 07Universal-Omega 03434e8b8 - +integers [03:58:58] miraheze/mw-config - Universal-Omega the build passed. [03:59:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:00:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.45, 7.90, 8.41 [04:00:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 0.97, 2.14, 2.09 [04:02:20] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/aa855911e180...63576a21e944 [04:02:22] [02miraheze/mediawiki] 07Universal-Omega 0363576a2 - Update ManageWiki [04:02:54] !log [universalomega@test101] starting deploy of {'world': True, 'force': True} to skip [04:03:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:03:21] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True, 'world': True, 'force': True} to mw101 [04:03:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:03:37] !log [universalomega@mwtask111] starting deploy of {'pull': 'config', 'config': True, 'world': True, 'force': True} to all [04:03:50] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.03, 1.56, 1.87 [04:03:55] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:05:03] !log [universalomega@mwtask111] starting deploy of {'pull': 'config,world', 'config': True, 'world': True, 'force': True} to all [04:05:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:05:21] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.87, 9.73, 9.10 [04:06:27] !log [universalomega@test101] finished deploy of {'world': True, 'force': True} to skip - SUCCESS in 212s [04:06:32] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:06:48] !log [universalomega@test101] starting deploy of {'pull': 'config', 'config': True, 'force': True} to skip [04:06:49] !log [universalomega@test101] finished deploy of {'pull': 'config', 'config': True, 'force': True} to skip - SUCCESS in 1s [04:06:52] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.03, 1.22, 1.67 [04:06:53] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:06:58] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:08:15] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.90, 9.10, 8.96 [04:08:21] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.43, 9.63, 9.09 [04:08:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:09:58] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.73, 8.87, 7.95 [04:10:30] !log [universalomega@mwtask111] finished deploy of {'pull': 'config,world', 'config': True, 'world': True, 'force': True} to all - SUCCESS in 326s [04:10:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [04:11:19] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.85, 9.66, 9.24 [04:12:54] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.71, 8.83, 8.13 [04:14:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.87, 9.29, 8.88 [04:15:52] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.98, 8.43, 8.08 [04:17:01] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.09, 9.29, 8.93 [04:19:27] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.80, 3.50, 3.17 [04:19:54] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.12, 8.30, 8.62 [04:20:02] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 9.84, 10.46, 9.76 [04:22:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.05, 2.86, 2.97 [04:22:48] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.54, 7.76, 8.35 [04:22:58] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.75, 9.59, 9.57 [04:23:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:28:39] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.80, 9.80, 9.63 [04:31:38] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.82, 9.67, 9.63 [04:32:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:34:17] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.86, 7.67, 8.26 [04:34:31] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.19, 9.39, 9.50 [04:35:13] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.17, 8.89, 8.74 [04:35:22] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.40, 3.03, 2.24 [04:37:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.26, 9.62, 9.58 [04:37:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:41:32] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.71, 8.86, 8.34 [04:42:47] [02ManageWiki] 07lens0021 opened pull request 03#331: Blacklist -> Excludes in local variables - 13https://github.com/miraheze/ManageWiki/pull/331 [04:43:48] [02ManageWiki] 07Universal-Omega commented on pull request 03#331: Blacklist -> Excludes in local variables - 13https://github.com/miraheze/ManageWiki/pull/331#issuecomment-1022843569 [04:43:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.43, 9.49, 8.94 [04:43:52] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.03, 9.66, 8.94 [04:44:29] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.36, 9.48, 8.67 [04:44:46] [02ManageWiki] 07Universal-Omega edited a comment on pull request 03#331: Blacklist -> Excludes in local variables - 13https://github.com/miraheze/ManageWiki/pull/331#issuecomment-1022843569 [04:45:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:46:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.76, 8.98, 8.87 [04:46:44] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.37, 8.88, 8.78 [04:46:53] miraheze/ManageWiki - lens0021 the build passed. [04:47:26] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.47, 8.85, 8.58 [04:50:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:54:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.02, 7.83, 8.41 [04:55:56] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.96, 8.36, 8.50 [04:56:54] [02ManageWiki] 07lens0021 opened pull request 03#332: cleanup: Use for loop instead of each() function - 13https://github.com/miraheze/ManageWiki/pull/332 [04:57:59] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.85, 8.01, 8.46 [04:58:00] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.47, 7.38, 8.20 [04:58:16] [02ManageWiki] 07lens0021 synchronize pull request 03#331: Blacklist -> Excludes in local variables - 13https://github.com/miraheze/ManageWiki/pull/331 [04:58:39] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.20, 1.65, 1.99 [04:59:28] [02ManageWiki] 07lens0021 edited pull request 03#331: Blacklist -> Excluded in local variables - 13https://github.com/miraheze/ManageWiki/pull/331 [05:01:53] miraheze/ManageWiki - lens0021 the build passed. [05:04:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:04:37] [02ManageWiki] 07Universal-Omega closed pull request 03#331: Blacklist -> Excluded in local variables - 13https://github.com/miraheze/ManageWiki/pull/331 [05:04:38] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ManageWiki/compare/8ad4792956a8...d5f738ac0b34 [05:04:40] miraheze/ManageWiki - lens0021 the build passed. [05:04:40] [02miraheze/ManageWiki] 07lens0021 03d5f738a - Blacklist -> Excluded in local variables (#331) [05:06:37] [02ManageWiki] 07Universal-Omega closed pull request 03#332: cleanup: Use for loop instead of each() function - 13https://github.com/miraheze/ManageWiki/pull/332 [05:06:38] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/d5f738ac0b34...6def4872139d [05:06:40] [02miraheze/ManageWiki] 07lens0021 036def487 - cleanup: Use for loop instead of each() function (#332) [05:07:04] miraheze/ManageWiki - Universal-Omega the build has errored. [05:07:13] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.35, 1.53, 1.74 [05:08:30] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/4531fe3475a9 [05:08:32] [02miraheze/ManageWiki] 07Universal-Omega 034531fe3 - Fix linting [05:08:33] [02ManageWiki] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/ManageWiki [05:08:35] [02ManageWiki] 07Universal-Omega opened pull request 03#333: Fix linting - 13https://github.com/miraheze/ManageWiki/pull/333 [05:08:48] miraheze/ManageWiki - Universal-Omega the build has errored. [05:10:02] [02miraheze/ManageWiki] 07github-actions[bot] pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/4531fe3475a9...f77a1faaf947 [05:10:03] [02miraheze/ManageWiki] 07github-actions 03f77a1fa - CI: lint code to MediaWiki standards [05:10:05] [02ManageWiki] 07github-actions[bot] synchronize pull request 03#333: Fix linting - 13https://github.com/miraheze/ManageWiki/pull/333 [05:10:10] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.16, 1.43, 1.67 [05:10:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.75, 8.42, 8.14 [05:11:03] [02miraheze/ManageWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/compare/f77a1faaf947...e474b8dd718d [05:11:04] [02miraheze/ManageWiki] 07Universal-Omega 03e474b8d - Update ManageWikiTypes.php [05:11:06] [02ManageWiki] 07Universal-Omega synchronize pull request 03#333: Fix linting - 13https://github.com/miraheze/ManageWiki/pull/333 [05:14:30] !log reception@test101:~$ sudo -u www-data php /srv/mediawiki/w/extensions/ManageWiki/maintenance/populateGroupPermissionsWithDefaults.php --wiki betawiki [05:14:36] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:14:38] !log reception@test101:~$ sudo -u www-data php /srv/mediawiki/w/extensions/ManageWiki/maintenance/populateNamespacesWithDefaults.php --wiki betawiki [05:14:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [05:15:31] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.31, 8.52, 8.36 [05:16:00]