[00:01:15] [02miraheze/CreateWiki] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-2 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/compare/7a06f8f0dddd...5fff0121b6dc [00:01:17] [02miraheze/CreateWiki] 07Universal-Omega 035fff012 - Update mediawiki-tests.yml [00:01:18] [02CreateWiki] 07Universal-Omega synchronize pull request 03#301: Create InsertWikiTest.php - 13https://github.com/miraheze/CreateWiki/pull/301 [00:03:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.28, 9.60, 9.44 [00:03:21] miraheze/MirahezeMagic - Universal-Omega the build has errored. [00:03:33] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03revert-319-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/6b6ed8012f99...b217aca3f861 [00:03:35] [02miraheze/MirahezeMagic] 07Universal-Omega 03b217aca - Update globals.php [00:03:36] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#323: Revert "Fix ci" - 13https://github.com/miraheze/MirahezeMagic/pull/323 [00:03:59] [02MirahezeMagic] 07Universal-Omega closed pull request 03#320: CI: don't catch errors - 13https://github.com/miraheze/MirahezeMagic/pull/320 [00:04:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.96, 9.36, 9.91 [00:04:02] [02MirahezeMagic] 07Universal-Omega deleted branch 03RhinosF1-patch-2 - 13https://github.com/miraheze/MirahezeMagic [00:04:02] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.85, 4.21, 3.56 [00:04:03] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03RhinosF1-patch-2 [00:04:36] PROBLEM - mw101 Puppet on mw101 is CRITICAL: CRITICAL: Puppet has 454 failures. Last run 3 minutes ago with 454 failures. Failed resources (up to 3 shown): File[stablestate.org],File[stablestate.org_private],File[wiki.joust.ro],File[wiki.joust.ro_private] [00:04:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.57, 9.73, 9.69 [00:05:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.75, 9.07, 9.25 [00:06:52] miraheze/MirahezeMagic - Universal-Omega the build has errored. [00:09:57] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.40, 4.00, 3.77 [00:11:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.11, 8.86, 9.01 [00:11:55] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.96, 4.34, 3.91 [00:12:00] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [00:13:57] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 3.629 second response time [00:14:14] miraheze/CreateWiki - Universal-Omega the build passed. [00:14:27] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03revert-319-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/b217aca3f861...df4e90ef4722 [00:14:29] [02miraheze/MirahezeMagic] 07Universal-Omega 03df4e90e - Update MirahezeMagicLogEmailManager.php [00:14:30] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#323: Revert "Fix ci" - 13https://github.com/miraheze/MirahezeMagic/pull/323 [00:14:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.25, 8.53, 9.86 [00:15:51] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.59, 3.70, 3.77 [00:16:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.74, 9.31, 9.33 [00:17:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.61, 9.46, 9.28 [00:17:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.12, 9.21, 9.19 [00:18:10] miraheze/MirahezeMagic - Universal-Omega the build has errored. [00:18:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.92, 9.55, 9.42 [00:20:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.60, 7.42, 8.47 [00:21:50] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03revert-319-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/df4e90ef4722...bca419cd22ac [00:21:51] [02miraheze/MirahezeMagic] 07Universal-Omega 03bca419c - Update MirahezeMagicLogEmailManager.php [00:21:53] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#323: Revert "Fix ci" - 13https://github.com/miraheze/MirahezeMagic/pull/323 [00:22:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.39, 9.12, 9.20 [00:22:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.25, 8.78, 9.33 [00:23:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.69, 9.77, 9.60 [00:23:43] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.09, 3.62, 3.66 [00:24:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.91, 9.42, 9.30 [00:24:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.14, 8.52, 9.19 [00:25:42] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.08, 3.47, 3.61 [00:27:40] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.12, 3.67, 3.66 [00:28:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.52, 8.58, 8.47 [00:28:48] miraheze/MirahezeMagic - Universal-Omega the build passed. [00:29:00] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03revert-319-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/bca419cd22ac...f34ed36a7066 [00:29:01] [02miraheze/MirahezeMagic] 07Universal-Omega 03f34ed36 - Update globals.php [00:29:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.30, 7.48, 8.39 [00:29:03] [02MirahezeMagic] 07Universal-Omega synchronize pull request 03#323: Revert "Fix ci" - 13https://github.com/miraheze/MirahezeMagic/pull/323 [00:29:38] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.03, 3.46, 3.58 [00:30:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.39, 8.93, 9.02 [00:32:32] RECOVERY - mw101 Puppet on mw101 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [00:32:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.00, 8.77, 8.94 [00:32:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.69, 9.24, 9.14 [00:33:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.25, 9.25, 8.87 [00:33:34] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.20, 2.97, 3.37 [00:34:26] [02MirahezeMagic] 07Universal-Omega edited pull request 03#323: Fix CI for MediaWiki 1.38.0+ - 13https://github.com/miraheze/MirahezeMagic/pull/323 [00:34:33] [02MirahezeMagic] 07Universal-Omega edited pull request 03#323: Fix CI for MediaWiki 1.38.0+ - 13https://github.com/miraheze/MirahezeMagic/pull/323 [00:34:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.93, 9.77, 9.37 [00:34:58] miraheze/MirahezeMagic - Universal-Omega the build passed. [00:35:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.20, 8.93, 8.81 [00:35:10] [02MirahezeMagic] 07Universal-Omega closed pull request 03#323: Fix CI for MediaWiki 1.38.0+ - 13https://github.com/miraheze/MirahezeMagic/pull/323 [00:35:11] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/MirahezeMagic/compare/58bf06426c5a...743af4499f8a [00:35:13] [02miraheze/MirahezeMagic] 07Universal-Omega 03743af44 - Fix CI for MediaWiki 1.38.0+ (#323) [00:35:14] [02miraheze/MirahezeMagic] 07Universal-Omega deleted branch 03revert-319-patch-2 [00:35:16] [02MirahezeMagic] 07Universal-Omega deleted branch 03revert-319-patch-2 - 13https://github.com/miraheze/MirahezeMagic [00:36:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.90, 9.75, 9.23 [00:37:33] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.28, 8.68, 8.22 [00:39:32] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.80, 7.87, 7.97 [00:40:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.21, 8.81, 8.79 [00:41:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.10, 9.52, 9.04 [00:41:06] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03revert-5385-dependabot/submodules/REL1_37/skins/chameleon-862623f [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/bf60646674fc [00:41:08] [02miraheze/mediawiki] 07Universal-Omega 03bf60646 - Revert "Bump skins/chameleon from `a923c46` to `862623f` (#5385)" [00:41:09] [02mediawiki] 07Universal-Omega created branch 03revert-5385-dependabot/submodules/REL1_37/skins/chameleon-862623f - 13https://github.com/miraheze/mediawiki [00:41:11] [02mediawiki] 07Universal-Omega opened pull request 03#5502: Revert "Bump skins/chameleon from `a923c46` to `862623f`" - 13https://github.com/miraheze/mediawiki/pull/5502 [00:41:15] miraheze/MirahezeMagic - Universal-Omega the build passed. [00:42:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.53, 9.74, 9.35 [00:42:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.72, 8.95, 8.86 [00:43:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.62, 9.45, 9.08 [00:44:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.73, 9.56, 9.35 [00:44:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.40, 3.42, 3.99 [00:46:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.24, 9.84, 9.48 [00:46:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.60, 9.20, 9.01 [00:46:49] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [00:47:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.30, 9.33, 9.06 [00:47:51] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.31, 1.71, 1.30 [00:48:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 6.91, 8.95, 9.21 [00:48:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.27, 9.93, 9.25 [00:48:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.40, 8.51, 8.78 [00:49:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.21, 8.88, 8.92 [00:49:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.31, 9.21, 8.88 [00:49:50] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.64, 1.67, 1.33 [00:51:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.12, 8.77, 8.76 [00:53:14] [02mediawiki] 07MacFan4000 closed pull request 03#5502: Revert "Bump skins/chameleon from `a923c46` to `862623f`" - 13https://github.com/miraheze/mediawiki/pull/5502 [00:53:15] [02mediawiki] 07MacFan4000 deleted branch 03revert-5385-dependabot/submodules/REL1_37/skins/chameleon-862623f - 13https://github.com/miraheze/mediawiki [00:53:17] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03revert-5385-dependabot/submodules/REL1_37/skins/chameleon-862623f [00:53:18] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/49bf434a4630...2035d98f38d5 [00:53:20] [02miraheze/mediawiki] 07Universal-Omega 032035d98 - Revert "Bump skins/chameleon from `a923c46` to `862623f` (#5385)" (#5502) [00:53:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.91, 8.49, 8.17 [00:54:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.57, 9.22, 9.21 [00:55:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.67, 10.08, 9.42 [00:55:19] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.89, 8.31, 8.14 [00:55:53] !log [macfan@mwtask111] starting deploy of {'world': True} to skip [00:56:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [00:57:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.11, 9.15, 8.92 [00:58:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.26, 9.02, 8.98 [00:59:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.59, 9.88, 9.54 [00:59:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.66, 8.18, 8.60 [01:01:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.27, 7.44, 8.27 [01:02:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.81, 8.97, 9.00 [01:02:21] !log [macfan@mwtask111] finished deploy of {'world': True} to skip - SUCCESS in 388s [01:02:31] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:04:39] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.93, 2.97, 3.34 [01:04:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.80, 10.78, 9.76 [01:05:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.77, 8.52, 8.55 [01:06:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.23, 7.79, 8.45 [01:08:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.17, 7.92, 8.50 [01:09:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.19, 9.50, 9.19 [01:10:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.50, 9.71, 9.65 [01:11:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.62, 7.94, 8.33 [01:13:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.65, 9.77, 9.43 [01:15:30] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.52, 8.48, 8.51 [01:16:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.17, 9.13, 8.67 [01:16:07] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.05, 8.60, 8.22 [01:16:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.33, 9.88, 9.64 [01:17:08] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.23, 8.68, 8.49 [01:17:27] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.76, 9.14, 8.74 [01:18:06] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.24, 9.33, 8.52 [01:19:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 13.08, 10.13, 9.03 [01:20:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.49, 8.75, 8.68 [01:20:04] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.75, 8.80, 8.43 [01:23:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.55, 9.51, 9.06 [01:24:02] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.66, 8.30, 8.34 [01:25:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.68, 9.71, 9.55 [01:25:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.72, 8.75, 8.91 [01:25:15] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.38, 9.95, 9.28 [01:26:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.68, 9.57, 9.81 [01:27:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.08, 9.22, 9.41 [01:28:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.65, 8.11, 8.40 [01:28:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.26, 10.27, 10.04 [01:29:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.03, 9.92, 9.34 [01:29:09] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.29, 9.22, 9.15 [01:31:06] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.78, 9.79, 9.37 [01:32:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.67, 8.59, 8.55 [01:32:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.95, 3.52 [01:32:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.84, 9.39, 9.73 [01:33:03] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.58, 9.75, 9.41 [01:33:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.73, 8.85, 9.07 [01:34:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.75, 8.21, 8.41 [01:34:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.03, 10.32, 10.05 [01:36:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.45, 9.72, 9.87 [01:38:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.13, 9.12, 8.72 [01:38:54] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.29, 9.78, 9.50 [01:39:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.00, 9.07, 8.97 [01:39:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.08, 3.31, 3.38 [01:40:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.88, 8.94, 8.70 [01:42:48] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.65, 9.65, 9.53 [01:43:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.47, 7.89, 8.49 [01:44:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.80, 8.10, 8.40 [01:45:12] !log [macfan@mwtask111] starting deploy of {'world': True} to all [01:45:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:46:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.62, 9.77, 9.61 [01:47:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.03, 8.17, 8.53 [01:47:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.13, 3.22, 3.83 [01:49:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.33, 8.20, 8.49 [01:50:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.92, 10.38, 9.91 [01:50:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.49, 9.09, 9.40 [01:51:15] !log [macfan@mwtask111] finished deploy of {'world': True} to all - SUCCESS in 362s [01:51:22] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [01:52:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.14, 9.73, 9.58 [01:53:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.73, 8.88, 8.74 [01:53:31] [02mediawiki] 07dependabot[bot] opened pull request 03#5503: Bump extensions/ApprovedRevs from `8d1fe26` to `a7fb6ac` - 13https://github.com/miraheze/mediawiki/pull/5503 [01:53:32] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/ApprovedRevs-a7fb6ac [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/57c429ee88cf [01:53:34] [02miraheze/mediawiki] 07dependabot[bot] 0357c429e - Bump extensions/ApprovedRevs from `8d1fe26` to `a7fb6ac` [01:53:35] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/ApprovedRevs-a7fb6ac - 13https://github.com/miraheze/mediawiki [01:53:37] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Maps-9eae313 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/2e36742db8d6 [01:53:38] [02miraheze/mediawiki] 07dependabot[bot] 032e36742 - Bump extensions/Maps from `9e5c3ab` to `9eae313` [01:53:40] [02mediawiki] 07dependabot[bot] opened pull request 03#5504: Bump extensions/Maps from `9e5c3ab` to `9eae313` - 13https://github.com/miraheze/mediawiki/pull/5504 [01:53:41] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Maps-9eae313 - 13https://github.com/miraheze/mediawiki [01:53:43] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/PollNY-3df00e9 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/02a2a4898ed4 [01:53:44] [02miraheze/mediawiki] 07dependabot[bot] 0302a2a48 - Bump extensions/PollNY from `15e563e` to `3df00e9` [01:53:46] [02mediawiki] 07dependabot[bot] opened pull request 03#5505: Bump extensions/PollNY from `15e563e` to `3df00e9` - 13https://github.com/miraheze/mediawiki/pull/5505 [01:53:47] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/PollNY-3df00e9 - 13https://github.com/miraheze/mediawiki [01:53:49] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/MatomoAnalytics-f2a07d0 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/184fc2c3b63c [01:53:50] [02miraheze/mediawiki] 07dependabot[bot] 03184fc2c - Bump extensions/MatomoAnalytics from `6f44fd3` to `f2a07d0` [01:53:52] [02mediawiki] 07dependabot[bot] opened pull request 03#5506: Bump extensions/MatomoAnalytics from `6f44fd3` to `f2a07d0` - 13https://github.com/miraheze/mediawiki/pull/5506 [01:53:53] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/MatomoAnalytics-f2a07d0 - 13https://github.com/miraheze/mediawiki [01:53:55] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/WikiForum-2a42c61 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/c5bd3e74b022 [01:53:56] [02miraheze/mediawiki] 07dependabot[bot] 03c5bd3e7 - Bump extensions/WikiForum from `3b6d887` to `2a42c61` [01:53:58] [02mediawiki] 07dependabot[bot] opened pull request 03#5507: Bump extensions/WikiForum from `3b6d887` to `2a42c61` - 13https://github.com/miraheze/mediawiki/pull/5507 [01:53:59] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/WikiForum-2a42c61 - 13https://github.com/miraheze/mediawiki [01:54:01] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/WikiDiscover-086af25 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/1ed104cccb4a [01:54:02] [02miraheze/mediawiki] 07dependabot[bot] 031ed104c - Bump extensions/WikiDiscover from `49295c1` to `086af25` [01:54:04] [02mediawiki] 07dependabot[bot] opened pull request 03#5508: Bump extensions/WikiDiscover from `49295c1` to `086af25` - 13https://github.com/miraheze/mediawiki/pull/5508 [01:54:05] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/WikiDiscover-086af25 - 13https://github.com/miraheze/mediawiki [01:54:07] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/QuizGame-9b43e02 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/aabf784f9e53 [01:54:08] [02miraheze/mediawiki] 07dependabot[bot] 03aabf784 - Bump extensions/QuizGame from `1f52534` to `9b43e02` [01:54:10] [02mediawiki] 07dependabot[bot] opened pull request 03#5509: Bump extensions/QuizGame from `1f52534` to `9b43e02` - 13https://github.com/miraheze/mediawiki/pull/5509 [01:54:11] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/QuizGame-9b43e02 - 13https://github.com/miraheze/mediawiki [01:54:13] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/snapwikiskin-ffc4aa1 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/1a18f4c5b2e3 [01:54:14] [02miraheze/mediawiki] 07dependabot[bot] 031a18f4c - Bump skins/snapwikiskin from `3689482` to `ffc4aa1` [01:54:16] [02mediawiki] 07dependabot[bot] opened pull request 03#5510: Bump skins/snapwikiskin from `3689482` to `ffc4aa1` - 13https://github.com/miraheze/mediawiki/pull/5510 [01:54:17] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/snapwikiskin-ffc4aa1 - 13https://github.com/miraheze/mediawiki [01:54:19] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/GlobalNewFiles-68aca4a [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/3f624a4f5bc5 [01:54:20] [02miraheze/mediawiki] 07dependabot[bot] 033f624a4 - Bump extensions/GlobalNewFiles from `f3f3179` to `68aca4a` [01:54:22] [02mediawiki] 07dependabot[bot] opened pull request 03#5511: Bump extensions/GlobalNewFiles from `f3f3179` to `68aca4a` - 13https://github.com/miraheze/mediawiki/pull/5511 [01:54:23] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/GlobalNewFiles-68aca4a - 13https://github.com/miraheze/mediawiki [01:54:25] [02mediawiki] 07github-actions[bot] labeled pull request 03#5503: Bump extensions/ApprovedRevs from `8d1fe26` to `a7fb6ac` - 13https://github.com/miraheze/mediawiki/pull/5503 [01:54:26] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/ProtectSite-8eca4df [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/5917e2fc6959 [01:54:28] [02miraheze/mediawiki] 07dependabot[bot] 035917e2f - Bump extensions/ProtectSite from `afa02d0` to `8eca4df` [01:54:29] [02mediawiki] 07dependabot[bot] opened pull request 03#5512: Bump extensions/ProtectSite from `afa02d0` to `8eca4df` - 13https://github.com/miraheze/mediawiki/pull/5512 [01:54:31] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/ProtectSite-8eca4df - 13https://github.com/miraheze/mediawiki [01:54:32] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/CreateWiki-07f0416 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/7eba3b3cbfa7 [01:54:34] [02miraheze/mediawiki] 07dependabot[bot] 037eba3b3 - Bump extensions/CreateWiki from `8fa2186` to `07f0416` [01:54:35] [02mediawiki] 07dependabot[bot] opened pull request 03#5513: Bump extensions/CreateWiki from `8fa2186` to `07f0416` - 13https://github.com/miraheze/mediawiki/pull/5513 [01:54:37] [02mediawiki] 07github-actions[bot] labeled pull request 03#5507: Bump extensions/WikiForum from `3b6d887` to `2a42c61` - 13https://github.com/miraheze/mediawiki/pull/5507 [01:54:38] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/CreateWiki-07f0416 - 13https://github.com/miraheze/mediawiki [01:54:40] [02mediawiki] 07github-actions[bot] labeled pull request 03#5507: Bump extensions/WikiForum from `3b6d887` to `2a42c61` - 13https://github.com/miraheze/mediawiki/pull/5507 [01:54:41] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Cargo-dc101b6 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/bd3c9c53feee [01:54:43] [02miraheze/mediawiki] 07dependabot[bot] 03bd3c9c5 - Bump extensions/Cargo from `c9cc7f6` to `dc101b6` [01:54:44] [02mediawiki] 07github-actions[bot] labeled pull request 03#5504: Bump extensions/Maps from `9e5c3ab` to `9eae313` - 13https://github.com/miraheze/mediawiki/pull/5504 [01:54:46] [02mediawiki] 07dependabot[bot] opened pull request 03#5514: Bump extensions/Cargo from `c9cc7f6` to `dc101b6` - 13https://github.com/miraheze/mediawiki/pull/5514 [01:54:47] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Cargo-dc101b6 - 13https://github.com/miraheze/mediawiki [01:54:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.95, 9.53, 9.51 [01:54:49] [02mediawiki] 07github-actions[bot] labeled pull request 03#5505: Bump extensions/PollNY from `15e563e` to `3df00e9` - 13https://github.com/miraheze/mediawiki/pull/5505 [01:54:50] [02mediawiki] 07github-actions[bot] labeled pull request 03#5506: Bump extensions/MatomoAnalytics from `6f44fd3` to `f2a07d0` - 13https://github.com/miraheze/mediawiki/pull/5506 [01:54:52] [02mediawiki] 07github-actions[bot] labeled pull request 03#5508: Bump extensions/WikiDiscover from `49295c1` to `086af25` - 13https://github.com/miraheze/mediawiki/pull/5508 [01:54:53] [02mediawiki] 07github-actions[bot] labeled pull request 03#5506: Bump extensions/MatomoAnalytics from `6f44fd3` to `f2a07d0` - 13https://github.com/miraheze/mediawiki/pull/5506 [01:54:55] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Comments-72ce95c [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/ee0cda62c881 [01:54:56] [02miraheze/mediawiki] 07dependabot[bot] 03ee0cda6 - Bump extensions/Comments from `c830f5e` to `72ce95c` [01:54:58] [02mediawiki] 07dependabot[bot] opened pull request 03#5515: Bump extensions/Comments from `c830f5e` to `72ce95c` - 13https://github.com/miraheze/mediawiki/pull/5515 [01:54:59] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Comments-72ce95c - 13https://github.com/miraheze/mediawiki [01:55:01] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/ManageWiki-35b5466 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/40fffbf26f89 [01:55:02] [02miraheze/mediawiki] 07dependabot[bot] 0340fffbf - Bump extensions/ManageWiki from `772b596` to `35b5466` [01:55:04] [02mediawiki] 07dependabot[bot] opened pull request 03#5516: Bump extensions/ManageWiki from `772b596` to `35b5466` - 13https://github.com/miraheze/mediawiki/pull/5516 [01:55:05] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/ManageWiki-35b5466 - 13https://github.com/miraheze/mediawiki [01:55:07] [02mediawiki] 07github-actions[bot] labeled pull request 03#5509: Bump extensions/QuizGame from `1f52534` to `9b43e02` - 13https://github.com/miraheze/mediawiki/pull/5509 [01:55:08] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/BlogPage-05a8163 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/afe10d503d7b [01:55:10] [02miraheze/mediawiki] 07dependabot[bot] 03afe10d5 - Bump extensions/BlogPage from `d7e241f` to `05a8163` [01:55:11] [02mediawiki] 07dependabot[bot] opened pull request 03#5517: Bump extensions/BlogPage from `d7e241f` to `05a8163` - 13https://github.com/miraheze/mediawiki/pull/5517 [01:55:13] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/BlogPage-05a8163 - 13https://github.com/miraheze/mediawiki [01:55:14] [02mediawiki] 07github-actions[bot] labeled pull request 03#5511: Bump extensions/GlobalNewFiles from `f3f3179` to `68aca4a` - 13https://github.com/miraheze/mediawiki/pull/5511 [01:55:16] [02mediawiki] 07github-actions[bot] labeled pull request 03#5510: Bump skins/snapwikiskin from `3689482` to `ffc4aa1` - 13https://github.com/miraheze/mediawiki/pull/5510 [01:55:17] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/YouTube-a007b6c [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/ad1867ce3a37 [01:55:19] [02miraheze/mediawiki] 07dependabot[bot] 03ad1867c - Bump extensions/YouTube from `f2c0e32` to `a007b6c` [01:55:20] [02mediawiki] 07dependabot[bot] opened pull request 03#5518: Bump extensions/YouTube from `f2c0e32` to `a007b6c` - 13https://github.com/miraheze/mediawiki/pull/5518 [01:55:22] [02mediawiki] 07github-actions[bot] labeled pull request 03#5513: Bump extensions/CreateWiki from `8fa2186` to `07f0416` - 13https://github.com/miraheze/mediawiki/pull/5513 [01:55:23] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/YouTube-a007b6c - 13https://github.com/miraheze/mediawiki [01:55:25] [02mediawiki] 07github-actions[bot] labeled pull request 03#5513: Bump extensions/CreateWiki from `8fa2186` to `07f0416` - 13https://github.com/miraheze/mediawiki/pull/5513 [01:55:26] [02mediawiki] 07github-actions[bot] labeled pull request 03#5514: Bump extensions/Cargo from `c9cc7f6` to `dc101b6` - 13https://github.com/miraheze/mediawiki/pull/5514 [01:55:28] [02mediawiki] 07github-actions[bot] labeled pull request 03#5513: Bump extensions/CreateWiki from `8fa2186` to `07f0416` - 13https://github.com/miraheze/mediawiki/pull/5513 [01:55:29] [02mediawiki] 07github-actions[bot] labeled pull request 03#5514: Bump extensions/Cargo from `c9cc7f6` to `dc101b6` - 13https://github.com/miraheze/mediawiki/pull/5514 [01:55:31] [02mediawiki] 07github-actions[bot] labeled pull request 03#5513: Bump extensions/CreateWiki from `8fa2186` to `07f0416` - 13https://github.com/miraheze/mediawiki/pull/5513 [01:55:32] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/ShortDescription-26b10a9 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/1509c7c6f6d8 [01:55:34] [02miraheze/mediawiki] 07dependabot[bot] 031509c7c - Bump extensions/ShortDescription from `bf568ed` to `26b10a9` [01:55:35] [02mediawiki] 07dependabot[bot] opened pull request 03#5519: Bump extensions/ShortDescription from `bf568ed` to `26b10a9` - 13https://github.com/miraheze/mediawiki/pull/5519 [01:55:37] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/ShortDescription-26b10a9 - 13https://github.com/miraheze/mediawiki [01:55:38] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/DataDump-3d78106 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/59eb5ee0e038 [01:55:40] [02miraheze/mediawiki] 07dependabot[bot] 0359eb5ee - Bump extensions/DataDump from `ed3de61` to `3d78106` [01:55:41] [02mediawiki] 07dependabot[bot] opened pull request 03#5520: Bump extensions/DataDump from `ed3de61` to `3d78106` - 13https://github.com/miraheze/mediawiki/pull/5520 [01:55:43] [02mediawiki] 07github-actions[bot] labeled pull request 03#5512: Bump extensions/ProtectSite from `afa02d0` to `8eca4df` - 13https://github.com/miraheze/mediawiki/pull/5512 [01:55:43] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.62, 8.31, 8.34 [01:55:44] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/DataDump-3d78106 - 13https://github.com/miraheze/mediawiki [01:55:46] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/HAWelcome-67c1410 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/6894978c8f4a [01:55:47] [02miraheze/mediawiki] 07dependabot[bot] 036894978 - Bump extensions/HAWelcome from `a3a87a1` to `67c1410` [01:55:49] [02mediawiki] 07dependabot[bot] opened pull request 03#5521: Bump extensions/HAWelcome from `a3a87a1` to `67c1410` - 13https://github.com/miraheze/mediawiki/pull/5521 [01:55:50] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/HAWelcome-67c1410 - 13https://github.com/miraheze/mediawiki [01:55:52] [02mediawiki] 07github-actions[bot] labeled pull request 03#5515: Bump extensions/Comments from `c830f5e` to `72ce95c` - 13https://github.com/miraheze/mediawiki/pull/5515 [01:55:53] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/7ed52f7fdf2b [01:55:55] [02miraheze/mediawiki] 07dependabot[bot] 037ed52f7 - Bump skins/chameleon from `a923c46` to `e08fffc` [01:55:56] [02mediawiki] 07dependabot[bot] opened pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522 [01:55:58] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [01:55:59] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/Evelution-73acf5f [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/5a5a1e4260ca [01:56:01] [02miraheze/mediawiki] 07dependabot[bot] 035a5a1e4 - Bump skins/Evelution from `d492062` to `73acf5f` [01:56:02] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/Evelution-73acf5f - 13https://github.com/miraheze/mediawiki [01:56:04] [02mediawiki] 07dependabot[bot] opened pull request 03#5523: Bump skins/Evelution from `d492062` to `73acf5f` - 13https://github.com/miraheze/mediawiki/pull/5523 [01:56:05] [02mediawiki] 07github-actions[bot] labeled pull request 03#5517: Bump extensions/BlogPage from `d7e241f` to `05a8163` - 13https://github.com/miraheze/mediawiki/pull/5517 [01:56:07] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/SocialProfile-37838f0 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/15cbd5842557 [01:56:08] [02miraheze/mediawiki] 07dependabot[bot] 0315cbd58 - Bump extensions/SocialProfile from `a6d42ce` to `37838f0` [01:56:10] [02mediawiki] 07dependabot[bot] opened pull request 03#5524: Bump extensions/SocialProfile from `a6d42ce` to `37838f0` - 13https://github.com/miraheze/mediawiki/pull/5524 [01:56:11] [02mediawiki] 07github-actions[bot] labeled pull request 03#5516: Bump extensions/ManageWiki from `772b596` to `35b5466` - 13https://github.com/miraheze/mediawiki/pull/5516 [01:56:13] [02mediawiki] 07github-actions[bot] labeled pull request 03#5517: Bump extensions/BlogPage from `d7e241f` to `05a8163` - 13https://github.com/miraheze/mediawiki/pull/5517 [01:56:14] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/SocialProfile-37838f0 - 13https://github.com/miraheze/mediawiki [01:56:16] [02mediawiki] 07dependabot[bot] commented on pull request 03#5479: Bump skins/Evelution from `d492062` to `44ef2a8` - 13https://github.com/miraheze/mediawiki/pull/5479#issuecomment-1048382579 [01:56:17] [02mediawiki] 07dependabot[bot] closed pull request 03#5479: Bump skins/Evelution from `d492062` to `44ef2a8` - 13https://github.com/miraheze/mediawiki/pull/5479 [01:56:19] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/RemovePII-7491aba [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/4835e5f8e20a [01:56:20] [02miraheze/mediawiki] 07dependabot[bot] 034835e5f - Bump extensions/RemovePII from `0371de5` to `7491aba` [01:56:22] [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/Evelution-44ef2a8 - 13https://github.com/miraheze/mediawiki [01:56:23] [02mediawiki] 07dependabot[bot] opened pull request 03#5525: Bump extensions/RemovePII from `0371de5` to `7491aba` - 13https://github.com/miraheze/mediawiki/pull/5525 [01:56:25] [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/Evelution-44ef2a8 [01:56:26] [02mediawiki] 07github-actions[bot] labeled pull request 03#5519: Bump extensions/ShortDescription from `bf568ed` to `26b10a9` - 13https://github.com/miraheze/mediawiki/pull/5519 [01:56:28] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/RemovePII-7491aba - 13https://github.com/miraheze/mediawiki [01:56:29] [02mediawiki] 07github-actions[bot] labeled pull request 03#5518: Bump extensions/YouTube from `f2c0e32` to `a007b6c` - 13https://github.com/miraheze/mediawiki/pull/5518 [01:56:31] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/RottenLinks-445d803 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/6ade6a631544 [01:56:32] [02miraheze/mediawiki] 07dependabot[bot] 036ade6a6 - Bump extensions/RottenLinks from `e52a662` to `445d803` [01:56:34] [02mediawiki] 07dependabot[bot] opened pull request 03#5526: Bump extensions/RottenLinks from `e52a662` to `445d803` - 13https://github.com/miraheze/mediawiki/pull/5526 [01:56:35] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/RottenLinks-445d803 - 13https://github.com/miraheze/mediawiki [01:56:37] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/PortableInfobox-4df958b [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/8324a9829d7e [01:56:38] [02miraheze/mediawiki] 07dependabot[bot] 038324a98 - Bump extensions/PortableInfobox from `d82a4df` to `4df958b` [01:56:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.24, 9.90, 9.97 [01:56:40] [02mediawiki] 07dependabot[bot] opened pull request 03#5527: Bump extensions/PortableInfobox from `d82a4df` to `4df958b` - 13https://github.com/miraheze/mediawiki/pull/5527 [01:56:41] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/PortableInfobox-4df958b - 13https://github.com/miraheze/mediawiki [01:56:43] [02mediawiki] 07github-actions[bot] labeled pull request 03#5520: Bump extensions/DataDump from `ed3de61` to `3d78106` - 13https://github.com/miraheze/mediawiki/pull/5520 [01:56:44] [02mediawiki] 07github-actions[bot] labeled pull request 03#5520: Bump extensions/DataDump from `ed3de61` to `3d78106` - 13https://github.com/miraheze/mediawiki/pull/5520 [01:56:46] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/StandardDialogs-89795dc [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/36de0ae49189 [01:56:47] [02miraheze/mediawiki] 07dependabot[bot] 0336de0ae - Bump extensions/StandardDialogs from `cc76e3a` to `89795dc` [01:56:49] [02mediawiki] 07dependabot[bot] opened pull request 03#5528: Bump extensions/StandardDialogs from `cc76e3a` to `89795dc` - 13https://github.com/miraheze/mediawiki/pull/5528 [01:56:50] [02mediawiki] 07github-actions[bot] labeled pull request 03#5521: Bump extensions/HAWelcome from `a3a87a1` to `67c1410` - 13https://github.com/miraheze/mediawiki/pull/5521 [01:56:52] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/StandardDialogs-89795dc - 13https://github.com/miraheze/mediawiki [01:56:53] [02mediawiki] 07github-actions[bot] labeled pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522 [01:56:55] [02mediawiki] 07github-actions[bot] labeled pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522 [01:56:56] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/MirahezeMagic-743af44 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/32f12ae1d1ad [01:56:58] [02miraheze/mediawiki] 07dependabot[bot] 0332f12ae - Bump extensions/MirahezeMagic from `615f48d` to `743af44` [01:56:59] [02mediawiki] 07github-actions[bot] labeled pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522 [01:57:01] [02mediawiki] 07dependabot[bot] opened pull request 03#5529: Bump extensions/MirahezeMagic from `615f48d` to `743af44` - 13https://github.com/miraheze/mediawiki/pull/5529 [01:57:02] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/MirahezeMagic-743af44 - 13https://github.com/miraheze/mediawiki [01:57:04] [02mediawiki] 07github-actions[bot] labeled pull request 03#5524: Bump extensions/SocialProfile from `a6d42ce` to `37838f0` - 13https://github.com/miraheze/mediawiki/pull/5524 [01:57:05] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Mermaid-0862ad5 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/7b10c1dcb9ad [01:57:07] [02miraheze/mediawiki] 07dependabot[bot] 037b10c1d - Bump extensions/Mermaid from `077ca5e` to `0862ad5` [01:57:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.69, 9.51, 9.96 [01:57:08] [02mediawiki] 07dependabot[bot] opened pull request 03#5530: Bump extensions/Mermaid from `077ca5e` to `0862ad5` - 13https://github.com/miraheze/mediawiki/pull/5530 [01:57:10] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Mermaid-0862ad5 - 13https://github.com/miraheze/mediawiki [01:57:11] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/PageForms-6bd0703 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/a62966b1320b [01:57:13] [02miraheze/mediawiki] 07dependabot[bot] 03a62966b - Bump extensions/PageForms from `a390343` to `6bd0703` [01:57:14] [02mediawiki] 07github-actions[bot] labeled pull request 03#5525: Bump extensions/RemovePII from `0371de5` to `7491aba` - 13https://github.com/miraheze/mediawiki/pull/5525 [01:57:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.72, 3.75, 3.69 [01:57:16] [02mediawiki] 07github-actions[bot] labeled pull request 03#5526: Bump extensions/RottenLinks from `e52a662` to `445d803` - 13https://github.com/miraheze/mediawiki/pull/5526 [01:57:17] [02mediawiki] 07dependabot[bot] opened pull request 03#5531: Bump extensions/PageForms from `a390343` to `6bd0703` - 13https://github.com/miraheze/mediawiki/pull/5531 [01:57:19] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/PageForms-6bd0703 - 13https://github.com/miraheze/mediawiki [01:57:20] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-0bd9a68 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/f525340029f3 [01:57:22] [02miraheze/mediawiki] 07dependabot[bot] 03f525340 - Bump extensions/UniversalLanguageSelector from `7cbd413` to `0bd9a68` [01:57:23] [02mediawiki] 07dependabot[bot] opened pull request 03#5532: Bump extensions/UniversalLanguageSelector from `7cbd413` to `0bd9a68` - 13https://github.com/miraheze/mediawiki/pull/5532 [01:57:25] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-0bd9a68 - 13https://github.com/miraheze/mediawiki [01:57:26] [02mediawiki] 07dependabot[bot] opened pull request 03#5533: Bump skins/Cosmos from `3f70c00` to `34f65a4` - 13https://github.com/miraheze/mediawiki/pull/5533 [01:57:28] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/Cosmos-34f65a4 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/1b140d62ecf8 [01:57:29] [02miraheze/mediawiki] 07dependabot[bot] 031b140d6 - Bump skins/Cosmos from `3f70c00` to `34f65a4` [01:57:31] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/Cosmos-34f65a4 - 13https://github.com/miraheze/mediawiki [01:57:32] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/IncidentReporting-54dfbd5 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/f0a730d70efe [01:57:34] [02miraheze/mediawiki] 07dependabot[bot] 03f0a730d - Bump extensions/IncidentReporting from `cad9014` to `54dfbd5` [01:57:35] [02mediawiki] 07dependabot[bot] opened pull request 03#5534: Bump extensions/IncidentReporting from `cad9014` to `54dfbd5` - 13https://github.com/miraheze/mediawiki/pull/5534 [01:57:37] [02mediawiki] 07github-actions[bot] labeled pull request 03#5523: Bump skins/Evelution from `d492062` to `73acf5f` - 13https://github.com/miraheze/mediawiki/pull/5523 [01:57:38] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.83, 7.87, 8.18 [01:57:38] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/IncidentReporting-54dfbd5 - 13https://github.com/miraheze/mediawiki [01:57:40] [02mediawiki] 07github-actions[bot] labeled pull request 03#5523: Bump skins/Evelution from `d492062` to `73acf5f` - 13https://github.com/miraheze/mediawiki/pull/5523 [01:57:41] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Translate-414f3cb [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/8d3806fd80d0 [01:57:43] [02miraheze/mediawiki] 07dependabot[bot] 038d3806f - Bump extensions/Translate from `fed015c` to `414f3cb` [01:57:45] [02mediawiki] 07dependabot[bot] opened pull request 03#5535: Bump extensions/Translate from `fed015c` to `414f3cb` - 13https://github.com/miraheze/mediawiki/pull/5535 [01:57:46] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Translate-414f3cb - 13https://github.com/miraheze/mediawiki [01:57:47] [02mediawiki] 07dependabot[bot] opened pull request 03#5536: Bump extensions/SemanticMediaWiki from `a46476c` to `77164bc` - 13https://github.com/miraheze/mediawiki/pull/5536 [01:57:49] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/SemanticMediaWiki-77164bc [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/38b7ca3aead9 [01:57:50] [02miraheze/mediawiki] 07dependabot[bot] 0338b7ca3 - Bump extensions/SemanticMediaWiki from `a46476c` to `77164bc` [01:57:52] [02mediawiki] 07github-actions[bot] labeled pull request 03#5527: Bump extensions/PortableInfobox from `d82a4df` to `4df958b` - 13https://github.com/miraheze/mediawiki/pull/5527 [01:57:53] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/SemanticMediaWiki-77164bc - 13https://github.com/miraheze/mediawiki [01:57:55] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/AJAXPoll-5f740ab [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/2db83cf7a589 [01:57:56] [02miraheze/mediawiki] 07dependabot[bot] 032db83cf - Bump extensions/AJAXPoll from `2ea5085` to `5f740ab` [01:57:58] [02mediawiki] 07dependabot[bot] opened pull request 03#5537: Bump extensions/AJAXPoll from `2ea5085` to `5f740ab` - 13https://github.com/miraheze/mediawiki/pull/5537 [01:58:00] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/AJAXPoll-5f740ab - 13https://github.com/miraheze/mediawiki [01:58:01] [02mediawiki] 07github-actions[bot] labeled pull request 03#5528: Bump extensions/StandardDialogs from `cc76e3a` to `89795dc` - 13https://github.com/miraheze/mediawiki/pull/5528 [01:58:02] [02mediawiki] 07github-actions[bot] labeled pull request 03#5529: Bump extensions/MirahezeMagic from `615f48d` to `743af44` - 13https://github.com/miraheze/mediawiki/pull/5529 [01:58:04] [02mediawiki] 07github-actions[bot] labeled pull request 03#5529: Bump extensions/MirahezeMagic from `615f48d` to `743af44` - 13https://github.com/miraheze/mediawiki/pull/5529 [01:58:05] [02mediawiki] 07github-actions[bot] labeled pull request 03#5529: Bump extensions/MirahezeMagic from `615f48d` to `743af44` - 13https://github.com/miraheze/mediawiki/pull/5529 [01:58:07] [02mediawiki] 07github-actions[bot] labeled pull request 03#5530: Bump extensions/Mermaid from `077ca5e` to `0862ad5` - 13https://github.com/miraheze/mediawiki/pull/5530 [01:58:09] [02mediawiki] 07github-actions[bot] labeled pull request 03#5533: Bump skins/Cosmos from `3f70c00` to `34f65a4` - 13https://github.com/miraheze/mediawiki/pull/5533 [01:58:10] [02mediawiki] 07github-actions[bot] labeled pull request 03#5532: Bump extensions/UniversalLanguageSelector from `7cbd413` to `0bd9a68` - 13https://github.com/miraheze/mediawiki/pull/5532 [01:58:12] [02mediawiki] 07github-actions[bot] labeled pull request 03#5531: Bump extensions/PageForms from `a390343` to `6bd0703` - 13https://github.com/miraheze/mediawiki/pull/5531 [01:58:13] [02mediawiki] 07github-actions[bot] labeled pull request 03#5531: Bump extensions/PageForms from `a390343` to `6bd0703` - 13https://github.com/miraheze/mediawiki/pull/5531 [01:58:15] [02mediawiki] 07github-actions[bot] labeled pull request 03#5537: Bump extensions/AJAXPoll from `2ea5085` to `5f740ab` - 13https://github.com/miraheze/mediawiki/pull/5537 [01:58:16] [02mediawiki] 07github-actions[bot] labeled pull request 03#5534: Bump extensions/IncidentReporting from `cad9014` to `54dfbd5` - 13https://github.com/miraheze/mediawiki/pull/5534 [01:58:18] [02mediawiki] 07github-actions[bot] labeled pull request 03#5537: Bump extensions/AJAXPoll from `2ea5085` to `5f740ab` - 13https://github.com/miraheze/mediawiki/pull/5537 [01:58:19] [02mediawiki] 07github-actions[bot] labeled pull request 03#5536: Bump extensions/SemanticMediaWiki from `a46476c` to `77164bc` - 13https://github.com/miraheze/mediawiki/pull/5536 [01:58:21] [02mediawiki] 07github-actions[bot] labeled pull request 03#5535: Bump extensions/Translate from `fed015c` to `414f3cb` - 13https://github.com/miraheze/mediawiki/pull/5535 [01:58:22] [02mediawiki] 07github-actions[bot] labeled pull request 03#5535: Bump extensions/Translate from `fed015c` to `414f3cb` - 13https://github.com/miraheze/mediawiki/pull/5535 [01:58:24] [02mediawiki] 07MacFan4000 commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1048383792 [01:58:25] [02mediawiki] 07dependabot[bot] commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1048383802 [01:58:27] [02mediawiki] 07MacFan4000 commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1048383929 [01:58:28] [02mediawiki] 07dependabot[bot] closed pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522 [01:58:30] [02mediawiki] 07dependabot[bot] commented on pull request 03#5522: Bump skins/chameleon from `a923c46` to `e08fffc` - 13https://github.com/miraheze/mediawiki/pull/5522#issuecomment-1048383939 [01:58:31] [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc - 13https://github.com/miraheze/mediawiki [01:58:33] [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-e08fffc [01:58:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.45, 9.76, 9.54 [01:59:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 4.64, 7.65, 8.41 [01:59:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.91, 3.65, 3.65 [02:00:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.35, 9.72, 9.57 [02:02:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.23, 9.61, 9.53 [02:05:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.94, 3.05, 3.37 [02:06:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.02, 9.08, 9.37 [02:09:05] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.52, 8.84, 8.57 [02:10:05] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.20, 8.54, 8.31 [02:10:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.52, 9.78, 9.50 [02:11:07] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.75, 3.78, 3.39 [02:11:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.28, 3.99, 3.62 [02:12:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.77, 9.29, 9.32 [02:13:03] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.80, 3.74, 3.43 [02:13:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.98, 3.67 [02:14:12] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.06, 2.05, 1.57 [02:14:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:14:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.41, 9.76, 9.59 [02:14:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.89, 9.47, 9.39 [02:15:00] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.71, 3.34, 3.31 [02:16:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.61, 9.22, 8.64 [02:16:12] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.87, 1.58, 1.45 [02:16:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.52, 9.96, 9.58 [02:17:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.01, 9.18, 8.78 [02:18:36] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:18:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.45, 9.85, 9.63 [02:18:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.25, 9.36, 9.42 [02:19:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.16, 9.10, 8.80 [02:19:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.13, 9.17, 9.03 [02:20:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.00, 9.75, 9.06 [02:20:11] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [02:20:11] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.407080888748169 seconds [02:21:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.17, 4.08, 3.81 [02:22:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.69, 9.80, 9.69 [02:23:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.01, 9.05, 8.77 [02:23:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.41, 8.77, 8.94 [02:23:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.62, 3.64, 3.69 [02:25:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.60, 9.21, 8.90 [02:26:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.86, 9.91, 9.28 [02:27:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.75, 10.12, 9.26 [02:27:44] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 4.00, 3.66, 3.42 [02:28:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.75, 9.40, 9.17 [02:28:48] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.42, 7.64, 8.41 [02:29:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.20, 9.17, 9.01 [02:29:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.98, 4.43, 4.00 [02:29:41] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.66, 3.39, 3.36 [02:33:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.14, 7.90, 8.50 [02:34:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.69, 9.35, 8.27 [02:35:46] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.76, 9.25, 8.81 [02:36:09] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.20, 9.08, 8.31 [02:37:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.86, 3.85, 3.93 [02:37:46] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.83, 8.86, 8.70 [02:40:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.10, 7.78, 8.44 [02:40:07] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.43, 9.12, 8.45 [02:40:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.06, 9.59, 9.18 [02:42:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.59, 9.88, 9.36 [02:43:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.51, 3.68 [02:43:44] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.08, 9.85, 9.11 [02:44:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.70, 9.41, 8.95 [02:44:04] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.11, 8.80, 8.54 [02:46:23] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 3.49, 4.02, 3.62 [02:47:43] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.20, 9.90, 9.33 [02:48:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.67, 3.52, 3.48 [02:49:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.72, 9.59, 9.15 [02:49:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.29, 3.59, 3.69 [02:49:35] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 12.55, 10.04, 8.98 [02:49:42] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.73, 10.11, 9.46 [02:51:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.60, 8.36, 8.75 [02:51:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.99, 4.10, 3.89 [02:51:59] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.82, 8.25, 8.42 [02:52:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.58, 9.48, 9.30 [02:52:13] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.79, 3.19, 3.35 [02:52:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.13, 10.09, 9.57 [02:53:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.89, 3.35, 3.65 [02:53:25] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.90, 9.73, 9.12 [02:53:41] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.00, 9.34, 9.33 [02:54:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.65, 9.14, 9.29 [02:58:05] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.06, 3.76, 3.45 [02:58:36] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:59:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.05, 8.05, 8.49 [02:59:10] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.21, 7.96, 8.48 [03:00:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 5.39, 7.25, 8.48 [03:01:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.97, 3.90, 3.76 [03:01:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:01:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.81, 3.53, 3.44 [03:02:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.03, 7.35, 8.36 [03:05:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.91, 3.52, 3.68 [03:05:48] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.60, 9.33, 8.55 [03:07:46] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.85, 9.32, 8.63 [03:07:54] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.58, 8.94, 8.60 [03:08:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.70, 8.63, 8.56 [03:09:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.44, 3.14, 3.33 [03:11:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.34, 9.10, 8.48 [03:11:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:11:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.43, 9.47, 8.88 [03:13:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.75, 3.66 [03:13:42] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.85, 8.29, 8.38 [03:14:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:14:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.99, 9.10, 8.97 [03:15:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.62, 8.38, 8.38 [03:15:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.73, 3.39, 3.54 [03:16:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.42, 9.82, 9.24 [03:18:49] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [03:18:49] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [03:19:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.68, 9.88, 8.96 [03:19:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.96, 4.22, 3.79 [03:20:07] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [03:23:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.79, 9.91, 9.22 [03:23:26] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.51, 8.02, 8.48 [03:23:34] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.22, 7.91, 8.44 [03:24:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.76, 9.47, 9.48 [03:25:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.94, 3.45, 3.69 [03:27:20] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.70, 4.18, 3.50 [03:29:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:30:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.21, 7.53, 8.49 [03:31:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.84, 3.66, 3.47 [03:31:14] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.22, 8.62, 8.56 [03:32:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:33:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.40, 3.34, 3.38 [03:33:11] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.88, 7.77, 8.25 [03:35:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.28, 7.57, 8.38 [03:35:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.91, 3.97, 3.78 [03:35:30] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.15, 9.26, 8.58 [03:37:06] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.85, 3.47, 3.45 [03:37:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.26, 3.58, 3.66 [03:37:23] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.00, 8.74, 8.41 [03:37:30] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.27, 8.68, 8.44 [03:37:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:38:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.58, 9.68, 8.85 [03:39:03] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.92, 3.23, 3.39 [03:39:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.00, 3.98, 3.79 [03:39:22] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.08, 8.13, 8.22 [03:40:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.88, 9.55, 8.90 [03:43:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.54, 8.84, 8.56 [03:45:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.82, 7.88, 8.23 [03:50:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:51:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.53, 10.24, 9.16 [03:51:26] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.07, 9.44, 8.92 [03:52:19] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.25, 9.12, 8.23 [03:53:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.74, 8.69, 8.33 [03:53:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.50, 9.52, 9.02 [03:53:25] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.80, 8.69, 8.71 [03:54:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.19, 9.09, 8.33 [03:55:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.41, 7.77, 8.03 [03:55:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 9.81, 10.03, 9.29 [03:55:24] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.22, 2.32, 1.70 [03:56:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.66, 9.23, 8.99 [03:57:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 6.27, 8.69, 8.89 [03:57:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.82, 3.32, 3.97 [03:57:23] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.51, 1.99, 1.65 [03:57:24] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.71, 7.55, 8.24 [03:58:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.27, 9.28, 9.04 [03:59:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.08, 8.72, 8.39 [04:00:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.91, 10.21, 9.02 [04:01:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.20, 8.35, 8.31 [04:01:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.30, 9.04, 8.96 [04:01:22] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.21, 1.91, 1.67 [04:03:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.24, 9.14, 9.01 [04:03:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.26, 8.14, 7.87 [04:03:21] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.89, 1.51, 1.55 [04:04:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.82, 9.20, 8.97 [04:05:11] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 11.16, 8.81, 8.12 [04:05:15] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.93, 5.09, 4.27 [04:06:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.67, 8.73, 8.42 [04:06:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.14, 2.95 [04:06:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.52, 8.85, 8.87 [04:07:11] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.21, 8.78, 8.22 [04:10:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.21, 9.45, 9.46 [04:10:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.38, 8.12, 8.27 [04:10:39] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.38, 3.17, 3.01 [04:10:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.87, 9.83, 9.26 [04:11:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.12, 7.86, 8.48 [04:12:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.29, 8.83, 8.96 [04:12:51] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.37, 1.91, 1.55 [04:13:11] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.36, 8.30, 8.23 [04:13:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.97, 9.42, 8.72 [04:14:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.51, 9.57, 9.20 [04:14:49] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.86, 1.56, 1.46 [04:15:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.89, 8.63, 8.67 [04:16:18] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.71, 8.90, 8.54 [04:16:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.66, 9.43, 9.18 [04:16:49] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [04:18:18] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.04, 8.01, 8.25 [04:20:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.63, 7.48, 8.41 [04:20:11] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [04:20:11] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.407654762268066 seconds [04:21:07] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.97, 10.37, 9.37 [04:27:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 7.35, 9.63, 9.51 [04:27:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.51, 3.55, 3.95 [04:27:26] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.06, 9.19, 8.84 [04:29:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.11, 9.21, 8.90 [04:30:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:34:40] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.57, 9.01, 8.74 [04:36:12] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.61, 10.08, 8.89 [04:36:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.39, 7.68, 8.40 [04:37:08] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.65, 7.51, 8.28 [04:37:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.10, 2.74, 3.30 [04:38:11] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.59, 9.44, 8.78 [04:39:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.54, 7.30, 8.32 [04:41:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 13.25, 9.34, 8.74 [04:42:10] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.60, 9.49, 8.90 [04:42:19] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.09, 7.49, 8.19 [04:42:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:45:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.14, 9.59, 9.04 [04:46:09] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.46, 9.29, 9.00 [04:46:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.19, 9.63, 9.00 [04:47:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.89, 3.62 [04:47:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:48:39] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.33, 9.54, 9.05 [04:50:07] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [04:51:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.76, 7.70, 8.35 [04:51:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.30, 3.06, 3.35 [04:53:22] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.93, 1.68, 1.32 [04:55:21] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.94, 1.36, 1.24 [04:56:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.50, 7.82, 8.46 [05:00:06] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.01, 8.18, 8.50 [05:09:15] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.97, 3.60, 3.45 [05:11:15] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.98, 3.27, 3.34 [05:15:14] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.39, 4.06, 3.61 [05:15:28] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.27, 8.61, 8.08 [05:16:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:17:25] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.70, 7.98, 7.92 [05:21:14] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.99, 3.68, 3.61 [05:22:03] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.81, 8.23, 8.01 [05:22:33] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.75, 8.28, 7.68 [05:24:03] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.66, 8.12, 8.00 [05:24:28] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.12, 7.83, 7.58 [05:25:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.43, 2.82, 3.27 [05:26:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:32:07] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.56, 8.26, 7.80 [05:32:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:34:02] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.00, 8.26, 7.86 [05:37:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:41:03] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.06, 8.50, 7.84 [05:43:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.50, 8.25, 7.85 [05:43:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:45:39] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 7.01, 4.26, 3.15 [05:47:33] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.76, 9.01, 8.34 [05:48:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:50:40] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.69, 8.17, 7.85 [05:51:27] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 5.58, 7.65, 7.99 [05:51:29] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.22, 3.64, 3.27 [05:52:35] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.01, 7.87, 7.79 [05:53:25] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.32, 3.73, 3.33 [05:55:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.93, 3.41, 3.26 [05:57:18] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.67, 3.03, 3.13 [06:01:54] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.29, 8.35, 7.76 [06:03:51] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.05, 7.54, 7.54 [06:16:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.06, 8.33, 7.83 [06:18:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.11, 8.66, 8.02 [06:20:48] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.74, 7.96, 7.84 [06:30:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:35:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:44:10] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.58, 3.35, 2.66 [06:44:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [06:46:06] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.86, 2.98, 2.63 [06:49:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:19:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:20:11] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [07:20:11] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.405223846435547 seconds [07:24:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:32:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.61, 8.21, 7.31 [07:36:01] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.26, 7.92, 7.40 [07:36:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:41:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:41:51] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.33, 8.67, 7.65 [07:43:08] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.84, 8.05, 6.86 [07:45:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.21, 7.74, 6.89 [07:46:19] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.45, 3.25, 2.61 [07:46:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:47:40] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.21, 8.04, 7.71 [07:48:16] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.39, 2.96, 2.58 [07:48:39] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.21, 8.20, 7.29 [07:50:39] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 8.26, 8.17, 7.40 [07:55:06] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.06, 3.50, 2.95 [07:56:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [07:58:59] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.81, 3.46, 3.06 [08:00:56] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.17, 3.68, 3.18 [08:02:52] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.21, 3.19, 3.07 [08:03:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:05:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.14, 8.90, 8.16 [08:07:19] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.65, 8.21, 7.98 [08:08:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:13:36] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.64, 3.27 [08:13:49] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.63, 3.84, 3.11 [08:15:32] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 3.81, 3.37 [08:15:46] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.74, 3.44, 3.05 [08:17:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.94, 3.69, 3.37 [08:18:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:19:39] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.75, 3.32, 3.11 [08:20:03] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.26, 1.48, 1.14 [08:21:22] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.85, 3.40, 3.33 [08:22:03] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.73, 1.21, 1.08 [08:23:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:25:17] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.27, 3.48, 3.39 [08:26:03] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.83, 1.64, 1.28 [08:27:14] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.33, 3.12, 3.27 [08:28:03] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.00, 1.36, 1.22 [08:29:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.22, 3.52, 3.26 [08:31:21] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.86, 2.91, 3.07 [08:35:17] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.71, 4.30, 3.57 [08:37:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.40, 3.93, 3.52 [08:39:10] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.68, 4.22, 3.67 [08:40:09] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.56, 8.06, 7.78 [08:40:42] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.44, 3.09, 2.74 [08:42:08] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.92, 7.93, 7.79 [08:42:40] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.90, 2.98, 2.74 [08:43:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.07, 8.25, 7.51 [08:43:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:45:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.84, 8.22, 7.60 [08:46:06] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.84, 3.82, 3.43 [08:48:03] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.55, 4.16, 3.60 [08:48:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.73, 3.41, 3.05 [08:48:33] [02miraheze/mediawiki] 07RhinosF1 pushed 0375 commits to 03master [+33/-6/±521] 13https://github.com/miraheze/mediawiki/compare/8ff99314ef89...6b872fdb3403 [08:48:35] [02miraheze/mediawiki] 07hashar 03b94cc17 - Revert "api-testing: Skip flaky bot edit revert test" [08:48:36] [02miraheze/mediawiki] 07Dylsss 036939b7f - SpecialUndelete: Do not show empty comments as deleted [08:48:38] [02miraheze/mediawiki] 07thiemowmde 03b2ded2c - Linker: Compact rollback edit count related code [08:48:39] [02miraheze/mediawiki] ... and 72 more commits. [08:49:59] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.08, 3.36, 3.37 [08:50:09] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [08:52:28] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.92, 2.86, 2.94 [08:55:51] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.37, 3.73, 3.52 [08:56:52] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.09, 1.62, 1.24 [08:58:49] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.55, 1.24, 1.15 [08:59:45] PROBLEM - pokemonwiki.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pokemonwiki.info' expires in 15 day(s) (Fri 11 Mar 2022 08:50:58 GMT +0000). [09:00:39] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.34, 3.49, 3.93 [09:03:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:03:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.08, 2.86, 3.25 [09:05:06] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/14d643dc999b...7424b2ab2c7f [09:05:07] [02miraheze/ssl] 07MirahezeSSLBot 037424b2a - Bot: Update SSL cert for pokemonwiki.info [09:06:39] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.70, 2.38, 3.29 [09:17:52] PROBLEM - hoodwiki.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'hoodwiki.xyz' expires in 15 day(s) (Fri 11 Mar 2022 08:45:52 GMT +0000). [09:18:49] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [09:18:49] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:23:03] PROBLEM - www.project-patterns.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'project-patterns.com' expires in 15 day(s) (Fri 11 Mar 2022 08:52:46 GMT +0000). [09:24:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/7424b2ab2c7f...3f537de7978d [09:24:45] [02miraheze/ssl] 07MirahezeSSLBot 033f537de - Bot: Update SSL cert for hoodwiki.xyz [09:29:00] RECOVERY - pokemonwiki.info - LetsEncrypt on sslhost is OK: OK - Certificate 'pokemonwiki.info' will expire on Tue 24 May 2022 08:04:59 GMT +0000. [09:47:37] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [09:55:17] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.92, 1.72, 1.30 [09:57:14] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.32, 1.59, 1.30 [10:03:03] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.02, 1.86, 1.50 [10:05:00] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.16, 1.62, 1.45 [10:16:34] RECOVERY - hoodwiki.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'hoodwiki.xyz' will expire on Tue 24 May 2022 08:24:38 GMT +0000. [10:20:11] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [10:20:11] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406018495559692 seconds [10:34:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:39:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:50:09] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [10:53:29] [02miraheze/ManageWiki] 07RhinosF1 pushed 031 commit to 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 [+0/-0/±2] 13https://github.com/miraheze/ManageWiki/compare/374f1f90560e...1930f7d4ee30 [10:53:30] [02miraheze/ManageWiki] 07RhinosF1 031930f7d - update browsers & postcss-less [10:53:32] [02ManageWiki] 07RhinosF1 synchronize pull request 03#344: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/ManageWiki/pull/344 [10:55:48] [02MatomoAnalytics] 07RhinosF1 closed pull request 03#75: Bump stylelint-config-wikimedia from 0.12.1 to 0.12.2 - 13https://github.com/miraheze/MatomoAnalytics/pull/75 [10:55:50] [02miraheze/MatomoAnalytics] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/MatomoAnalytics/compare/f2a07d03bbc0...ef54929b243b [10:55:51] [02miraheze/MatomoAnalytics] 07dependabot[bot] 03ef54929 - Bump stylelint-config-wikimedia from 0.12.1 to 0.12.2 (#75) [10:55:53] [02miraheze/MatomoAnalytics] 07RhinosF1 deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 [10:55:54] [02MatomoAnalytics] 07RhinosF1 deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 - 13https://github.com/miraheze/MatomoAnalytics [10:56:26] PROBLEM - puppet111 Puppet on puppet111 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Package[postgresql-contrib-13] [10:57:50] miraheze/ManageWiki - RhinosF1 the build passed. [10:57:59] [02miraheze/MatomoAnalytics] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/MatomoAnalytics/compare/ef54929b243b...803459b8b7ca [10:58:00] [02miraheze/MatomoAnalytics] 07RhinosF1 03803459b - Update package-lock.json [10:58:20] [02ManageWiki] 07RhinosF1 closed pull request 03#344: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/ManageWiki/pull/344 [10:58:21] [02miraheze/ManageWiki] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/ManageWiki/compare/35b5466e18bc...84b9c8aecf88 [10:58:23] [02miraheze/ManageWiki] 07dependabot[bot] 0384b9c8a - Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 (#344) [10:58:24] [02miraheze/ManageWiki] 07RhinosF1 deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 [10:58:26] [02ManageWiki] 07RhinosF1 deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 - 13https://github.com/miraheze/ManageWiki [11:01:15] [02miraheze/IncidentReporting] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/IncidentReporting/compare/54dfbd5cab71...9b52b80605dd [11:01:17] [02miraheze/IncidentReporting] 07RhinosF1 039b52b80 - update npm stuff [11:01:36] [02IncidentReporting] 07dependabot[bot] edited pull request 03#38: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/IncidentReporting/pull/38 [11:02:06] [02IncidentReporting] 07dependabot[bot] edited pull request 03#38: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/IncidentReporting/pull/38 [11:02:09] [02miraheze/IncidentReporting] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 [+0/-0/±2] 13https://github.com/miraheze/IncidentReporting/compare/73785cd0fb47...2f55148c4693 [11:02:10] [02miraheze/IncidentReporting] 07dependabot[bot] 032f55148 - Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 [11:02:12] [02IncidentReporting] 07dependabot[bot] edited pull request 03#38: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/IncidentReporting/pull/38 [11:02:13] [02IncidentReporting] 07dependabot[bot] synchronize pull request 03#38: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/IncidentReporting/pull/38 [11:02:44] [02IncidentReporting] 07dependabot[bot] edited pull request 03#38: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/IncidentReporting/pull/38 [11:03:00] miraheze/MatomoAnalytics - RhinosF1 the build passed. [11:04:35] miraheze/ManageWiki - RhinosF1 the build passed. [11:05:00] [02miraheze/CreateWiki] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/07f0416b8528...6ac9ac622ea3 [11:05:02] [02miraheze/CreateWiki] 07RhinosF1 036ac9ac6 - update packages [11:05:29] [02CreateWiki] 07dependabot[bot] edited pull request 03#302: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/CreateWiki/pull/302 [11:05:49] [02CreateWiki] 07dependabot[bot] edited pull request 03#302: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/CreateWiki/pull/302 [11:05:50] [02miraheze/CreateWiki] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/ef43f27856ec...af8f40575154 [11:05:52] [02miraheze/CreateWiki] 07dependabot[bot] 03af8f405 - Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 [11:05:53] [02CreateWiki] 07dependabot[bot] synchronize pull request 03#302: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/CreateWiki/pull/302 [11:05:55] [02CreateWiki] 07dependabot[bot] edited pull request 03#302: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/CreateWiki/pull/302 [11:06:05] miraheze/IncidentReporting - RhinosF1 the build passed. [11:06:14] [02CreateWiki] 07dependabot[bot] edited pull request 03#302: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/CreateWiki/pull/302 [11:07:28] [02miraheze/IncidentReporting] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/IncidentReporting/compare/9b52b80605dd...1f63e526f6a3 [11:07:30] [02miraheze/IncidentReporting] 07dependabot[bot] 031f63e52 - Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 (#38) [11:07:31] [02IncidentReporting] 07RhinosF1 closed pull request 03#38: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/IncidentReporting/pull/38 [11:07:33] [02miraheze/IncidentReporting] 07RhinosF1 deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 [11:07:34] [02IncidentReporting] 07RhinosF1 deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 - 13https://github.com/miraheze/IncidentReporting [11:07:49] miraheze/IncidentReporting - dependabot[bot] the build passed. [11:10:04] [02CreateWiki] 07RhinosF1 closed pull request 03#302: Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 - 13https://github.com/miraheze/CreateWiki/pull/302 [11:10:05] [02miraheze/CreateWiki] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/compare/6ac9ac622ea3...632c49cdf83c [11:10:07] [02miraheze/CreateWiki] 07dependabot[bot] 03632c49c - Bump stylelint-config-wikimedia from 0.11.1 to 0.12.2 (#302) [11:10:08] [02CreateWiki] 07RhinosF1 deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 - 13https://github.com/miraheze/CreateWiki [11:10:10] [02miraheze/CreateWiki] 07RhinosF1 deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.12.2 [11:10:58] miraheze/CreateWiki - RhinosF1 the build passed. [11:12:00] miraheze/CreateWiki - dependabot[bot] the build passed. [11:13:16] miraheze/IncidentReporting - RhinosF1 the build passed. [11:15:52] miraheze/CreateWiki - RhinosF1 the build passed. [11:24:25] RECOVERY - puppet111 Puppet on puppet111 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [11:27:26] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.08, 1.66, 1.32 [11:29:23] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.12, 1.42, 1.27 [11:33:29] RECOVERY - wiki.landev.vn - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.landev.vn' will expire on Sat 02 Apr 2022 03:10:10 GMT +0000. [11:33:38] [02mediawiki] 07RhinosF1 commented on pull request 03#5385: Bump skins/chameleon from `a923c46` to `862623f` - 13https://github.com/miraheze/mediawiki/pull/5385#issuecomment-1048690455 [11:33:40] [02mediawiki] 07dependabot[bot] commented on pull request 03#5385: Bump skins/chameleon from `a923c46` to `862623f` - 13https://github.com/miraheze/mediawiki/pull/5385#issuecomment-1048690474 [11:37:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.84, 3.41, 2.54 [11:39:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.21, 2.86, 2.44 [11:46:58] !log https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CentralAuth/+/743661/5/db_patches/patch-gu_hidden_normalize.sql in beta [11:47:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:48:49] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - dnd.bellinrattin.it All nameservers failed to answer the query. [11:50:00] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/94c256a09bb6 [11:50:02] [02miraheze/mw-config] 07RhinosF1 0394c256a - CA: set wgCentralAuthHiddenLevelMigrationStage to OLD [11:50:03] [02mw-config] 07RhinosF1 created branch 03RhinosF1-patch-2 - 13https://github.com/miraheze/mw-config [11:50:11] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [11:50:11] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406090021133423 seconds [11:50:23] [02mw-config] 07RhinosF1 opened pull request 03#4480: CA: set wgCentralAuthHiddenLevelMigrationStage to OLD - 13https://github.com/miraheze/mw-config/pull/4480 [11:50:27] Reception123: ^ [11:50:34] !log same in production [11:50:38] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [11:51:30] miraheze/mw-config - RhinosF1 the build passed. [11:53:18] taavi: does that PR look ok? [11:59:00] looks correct [11:59:17] [02mw-config] 07RhinosF1 closed pull request 03#4480: CA: set wgCentralAuthHiddenLevelMigrationStage to OLD - 13https://github.com/miraheze/mw-config/pull/4480 [11:59:18] [02miraheze/mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-2 [11:59:20] [02mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-2 - 13https://github.com/miraheze/mw-config [11:59:21] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/7d925644dba1...2476fa5165e7 [11:59:23] [02miraheze/mw-config] 07RhinosF1 032476fa5 - CA: set wgCentralAuthHiddenLevelMigrationStage to OLD (#4480) [12:00:22] miraheze/mw-config - RhinosF1 the build passed. [12:01:03] ack [12:01:33] Reception123: we have 0 schema changes to run during read only [12:01:46] https://phabricator.miraheze.org/P454 [12:01:46] [url] ✎ P454 Schema Changes 1.38 | phabricator.miraheze.org [12:02:08] Reception123: i can run the 'safe' ones in beta now if you want to prove they are safe [12:03:31] RhinosF1: how do you know without checking all extensions? [12:04:48] Reception123: we don't have extensions yet [12:05:01] s/only/only except extensions [12:05:02] RhinosF1 meant to say: Reception123: we have 0 schema changes to run during read only except extensions [12:05:28] PROBLEM - wiki.landev.vn - LetsEncrypt on sslhost is CRITICAL: connect to address wiki.landev.vn and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [12:08:40] ah [12:08:48] that's what I imagined, but I saw CA so I was a bit confused there [12:09:34] Reception123: CA is because I have seen that ticket [12:09:44] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/mw-config/compare/2476fa5165e7...6962605dbd07 [12:09:45] [02miraheze/mw-config] 07RhinosF1 036962605 - Create 138pre-patch.sql [12:10:29] Reception123: i will run them now in beta [12:12:07] !log [@test101] starting deploy of {'config': True} to skip [12:12:08] !log [@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s [12:12:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:12:18] miraheze/mw-config - RhinosF1 the build passed. [12:12:20] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:12:58] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (START) [12:13:04] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (END - exit=0) [12:13:17] !log [@mwtask111] starting deploy of {'config': True} to all [12:13:18] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:13:20] Reception123: beta is running with all core sql changes as of today [12:13:29] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:13:30] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 13s [12:13:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:13:33] and it's not crashed [12:13:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:15:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:17:06] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/3d68d99fc414 [12:17:08] [02miraheze/mw-config] 07RhinosF1 033d68d99 - cw: run 1.38 backwards compatible SQLs on creation [12:17:09] [02mw-config] 07RhinosF1 created branch 03RhinosF1-patch-2 - 13https://github.com/miraheze/mw-config [12:17:37] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [12:17:37] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [12:18:10] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/6962605dbd07...d9755f803639 [12:18:12] [02miraheze/mw-config] 07RhinosF1 03d9755f8 - Update 138pre-patch.sql [12:19:20] miraheze/mw-config - RhinosF1 the build passed. [12:19:44] !log [@test101] starting deploy of {'config': True} to skip [12:19:45] !log [@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s [12:19:50] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:19:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:20:10] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [12:20:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:22:51] !log [@mwtask111] starting deploy of {'config': True} to all [12:22:56] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:00] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 8s [12:23:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:23:52] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (START) [12:23:55] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (END - exit=256) [12:23:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:24:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:24:59] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/d9755f803639...934e44229702 [12:25:01] [02miraheze/mw-config] 07RhinosF1 03934e442 - Update 138pre-patch.sql [12:26:10] miraheze/mw-config - RhinosF1 the build passed. [12:26:34] !log [@test101] starting deploy of {'config': True} to skip [12:26:35] !log [@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s [12:26:39] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:26:44] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:27:06] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (START) [12:27:13] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:27:19] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (END - exit=256) [12:27:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:29:31] [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/mw-config/compare/934e44229702...73ba40b4ae0b [12:29:32] [02miraheze/mw-config] 07RhinosF1 0373ba40b - Update 138pre-patch.sql [12:29:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:30:33] miraheze/mw-config - RhinosF1 the build passed. [12:31:03] !log [@test101] starting deploy of {'config': True} to skip [12:31:04] !log [@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s [12:31:09] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:31:14] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:31:53] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (START) [12:31:56] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (END - exit=0) [12:32:01] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:33] [02mw-config] 07RhinosF1 opened pull request 03#4481: cw: run 1.38 backwards compatible SQLs on creation - 13https://github.com/miraheze/mw-config/pull/4481 [12:32:40] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (START) [12:32:43] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (END - exit=0) [12:32:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:51] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:32:55] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (START) [12:33:02] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:33:21] !log [rhinos@test101] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/sql.php /srv/mediawiki/config/138pre-patch.sql (END - exit=0) [12:33:27] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:33:42] miraheze/mw-config - RhinosF1 the build passed. [12:37:05] [02puppet] 07RhinosF1 opened pull request 03#2427: test: setup redis for beta - 13https://github.com/miraheze/puppet/pull/2427 [12:37:54] Reception123: we can do that and if it sets up fine then use jobrunner [12:38:14] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.61, 8.97, 7.88 [12:39:22] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.56, 8.15, 7.31 [12:39:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 8.80, 5.83, 3.84 [12:40:13] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.73, 8.96, 8.01 [12:41:19] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.97, 9.43, 7.88 [12:42:13] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.43, 9.20, 8.20 [12:42:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:43:15] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.68, 8.60, 7.75 [12:44:12] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.55, 8.98, 8.22 [12:45:12] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.17, 8.01, 7.63 [12:45:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.96, 3.67, 3.49 [12:46:49] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [12:47:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.32, 3.64, 3.48 [12:49:11] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.77, 3.63, 3.49 [12:50:11] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [12:50:11] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.40679931640625 seconds [12:51:07] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 4.45, 3.85 [12:52:10] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.63, 8.13, 8.20 [12:52:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:52:39] !log [@mwtask111] starting deploy of {'config': True} to all [12:52:46] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:52:55] !log [@mwtask111] finished deploy of {'config': True} to all - SUCCESS in 16s [12:53:04] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.37, 3.72, 3.66 [12:53:05] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [12:55:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.38, 4.07, 3.79 [12:55:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [12:56:57] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.05, 3.70, 3.69 [12:59:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.72, 8.55, 8.02 [13:03:03] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.32, 8.09, 7.96 [13:04:43] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.22, 2.82, 3.30 [13:05:06] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.38, 10.02, 8.91 [13:05:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:07:06] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.96, 9.28, 8.78 [13:12:09] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.90, 8.96, 8.19 [13:13:04] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.10, 9.72, 9.06 [13:14:06] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.95, 8.38, 8.06 [13:15:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:17:03] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.98, 9.70, 9.22 [13:17:53] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.61, 3.24, 2.79 [13:19:28] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.70, 4.95, 3.96 [13:19:49] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.91, 4.03, 3.15 [13:23:42] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.68, 3.81, 3.29 [13:25:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.76, 3.94, 3.83 [13:25:38] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.15, 3.27, 3.16 [13:29:00] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.35, 7.72, 8.43 [13:30:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:33:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:34:58] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.46, 9.80, 9.06 [13:35:01] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.84, 2.78, 3.33 [13:36:57] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.66, 9.70, 9.12 [13:38:18] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.44, 8.94, 8.47 [13:38:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:40:15] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.30, 9.93, 8.89 [13:42:04] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.32, 9.72, 8.50 [13:44:00] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.91, 9.19, 8.46 [13:44:09] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.34, 9.42, 8.97 [13:44:10] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.79, 8.35, 7.58 [13:44:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:46:04] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.90, 8.24, 7.63 [13:47:53] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.10, 8.23, 8.25 [13:48:49] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [13:48:49] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [13:50:07] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [13:50:15] [02ssl] 07MacFan4000 closed pull request 03#481: add hi.famepedia.org cert - 13https://github.com/miraheze/ssl/pull/481 [13:50:16] [02miraheze/ssl] 07MacFan4000 pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/3f537de7978d...f9e1e213f519 [13:50:18] [02miraheze/ssl] 07MacFan4000 03f9e1e21 - add hi.famepedia.org cert (#481) [13:50:20] [02ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 - 13https://github.com/miraheze/ssl [13:50:21] [02miraheze/ssl] 07MacFan4000 deleted branch 03MacFan4000-patch-1 [13:51:49] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.04, 9.34, 8.67 [13:53:54] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.26, 9.66, 9.10 [13:54:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:54:53] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.01, 9.03, 8.93 [13:55:41] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.48, 9.73, 9.03 [13:55:51] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.71, 9.27, 9.03 [13:58:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [13:58:52] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.61, 9.22, 9.06 [14:05:36] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.47, 8.06, 8.48 [14:05:36] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.04, 3.30, 2.93 [14:06:25] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.28, 9.62, 8.57 [14:06:50] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 12.55, 9.92, 9.29 [14:08:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:09:29] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.79, 3.66, 3.22 [14:10:15] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.87, 9.97, 8.95 [14:10:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.75, 9.75, 9.38 [14:11:26] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.57, 3.33, 3.16 [14:11:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [14:15:06] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.81, 9.96, 9.35 [14:16:01] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.03, 9.30, 8.89 [14:16:48] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.01, 9.50, 9.35 [14:17:03] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.96, 9.63, 9.29 [14:18:48] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.85, 9.40, 9.34 [14:19:07] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.56, 8.43, 7.61 [14:19:09] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.26, 9.07, 8.55 [14:21:08] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.05, 8.04, 7.57 [14:24:01] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.91, 9.22, 9.14 [14:26:59] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.77, 8.10, 8.33 [14:30:22] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.05, 10.28, 9.71 [14:30:48] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.01, 9.11, 9.03 [14:32:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.96, 9.14, 9.35 [14:32:48] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.54, 8.77, 8.91 [14:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.27, 9.53, 9.46 [14:34:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.91, 9.27, 9.06 [14:36:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.91, 8.98, 9.27 [14:36:45] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.05, 8.78, 8.50 [14:36:46] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.89, 9.11, 9.03 [14:37:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.09, 9.36, 9.07 [14:38:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.69, 9.49, 9.41 [14:39:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.31, 9.04, 9.00 [14:40:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 6.91, 8.32, 8.98 [14:41:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.13, 9.76, 9.23 [14:42:31] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.22, 8.31, 8.42 [14:43:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.92, 9.47, 9.23 [14:44:44] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.91, 7.50, 8.28 [14:45:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.40, 3.50, 3.30 [14:46:49] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [14:47:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.68, 9.88, 9.42 [14:47:04] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.04, 2.96, 3.13 [14:47:14] !log [rhinos@test101] sudo -u www-data php /srv/mediawiki/w/extensions/CentralAuth/maintenance/migrateStewards.php --wiki=betawiki (END - exit=0) [14:47:25] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:47:32] !log [rhinos@test101] starting deploy of {'config': True} to skip [14:47:33] !log [rhinos@test101] finished deploy of {'config': True} to skip - SUCCESS in 0s [14:47:37] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:47:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:51:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.74, 9.88, 9.51 [14:51:41] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.53, 9.07, 8.73 [14:54:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 7.56, 7.81, 8.41 [14:55:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.39, 3.82, 3.48 [14:55:39] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.85, 7.91, 8.33 [14:56:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.77, 8.70, 8.47 [14:57:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.08, 4.26, 3.65 [14:58:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.54, 9.10, 8.82 [14:59:24] !log be hacky and make myself a sysadmin on beta [14:59:33] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [14:59:38] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.86, 8.77, 8.57 [15:03:36] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.75, 8.23, 8.45 [15:04:31] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 6.53, 7.87, 8.24 [15:06:20] RECOVERY - mw122 Current Load on mw122 is OK: OK - load average: 6.93, 7.74, 8.31 [15:06:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:09:47] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.94, 8.63, 8.14 [15:10:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.62, 9.26, 8.80 [15:10:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [15:11:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.81, 9.63, 9.25 [15:11:45] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.90, 8.10, 8.00 [15:12:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.50, 8.70, 8.66 [15:12:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.23, 8.64, 8.43 [15:12:39] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.15, 3.26, 2.79 [15:13:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.85, 8.90, 9.04 [15:14:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.32, 8.88, 8.70 [15:14:37] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.17, 3.13, 2.80 [15:16:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.71, 8.84, 8.72 [15:16:30] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.78, 1.58, 1.27 [15:17:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.77, 3.99 [15:18:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.32, 1.48, 1.27 [15:21:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.61, 4.16, 4.05 [15:22:30] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.52, 2.09, 1.57 [15:22:31] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.22, 8.13, 8.43 [15:23:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.87, 3.96 [15:23:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.68, 7.44, 8.26 [15:24:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.52, 1.95, 1.58 [15:26:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.62, 9.54, 8.95 [15:27:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.86, 8.52, 8.52 [15:28:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.66, 9.23, 8.91 [15:29:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.16, 8.91, 8.65 [15:30:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.77, 9.37, 8.99 [15:30:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.46, 1.65, 1.58 [15:33:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.47, 9.22, 8.82 [15:38:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.79, 1.89, 1.66 [15:40:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.45, 1.79, 1.66 [15:41:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.68, 4.21, 3.82 [15:41:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.63, 9.45, 8.95 [15:42:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.18, 9.81, 9.80 [15:42:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.01, 1.54, 1.59 [15:42:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.63, 9.85, 9.16 [15:42:53] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.50, 3.49, 3.07 [15:43:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.96, 3.76, 3.70 [15:43:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.86, 9.45, 9.02 [15:44:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.32, 10.35, 10.02 [15:44:51] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.32, 3.00, 2.94 [15:45:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.07, 3.86, 3.73 [15:46:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.50, 9.86, 9.88 [15:46:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.67, 9.92, 9.36 [15:47:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.83, 3.63, 3.65 [15:48:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.16, 10.38, 9.59 [15:50:21] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.44, 8.90, 8.34 [15:52:20] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.74, 8.33, 8.19 [15:52:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.14, 9.78, 9.57 [15:52:35] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.47, 3.17, 2.99 [15:54:33] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.42, 2.97, 2.95 [15:55:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.87, 2.69, 3.20 [15:55:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.11, 8.07, 8.50 [15:59:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.03, 8.53, 8.64 [16:00:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.15, 8.79, 9.10 [16:02:16] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.74, 9.52, 8.67 [16:03:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.93, 4.17, 3.69 [16:04:16] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.40, 9.26, 8.67 [16:04:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.43, 9.56, 9.37 [16:05:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.46, 3.53, 3.51 [16:05:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 8.12, 8.17, 8.49 [16:08:14] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.64, 10.38, 9.20 [16:09:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.24, 3.02, 3.32 [16:09:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.52, 8.51, 8.56 [16:10:14] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.62, 9.88, 9.15 [16:10:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.37, 9.42, 9.08 [16:11:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.21, 8.86, 8.66 [16:13:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.91, 9.60, 8.98 [16:15:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.97, 9.76, 9.09 [16:17:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.83, 3.69, 3.53 [16:17:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.83, 9.55, 9.11 [16:18:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.40, 9.22, 9.14 [16:18:29] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [16:18:29] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.407735824584961 seconds [16:18:56] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.73, 2.15, 1.63 [16:19:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 4.03, 3.69 [16:20:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.25, 9.17, 9.13 [16:20:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:20:51] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 0.91, 1.71, 1.53 [16:21:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.60, 3.67, 3.60 [16:22:06] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.89, 8.85, 8.17 [16:22:10] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.14, 9.44, 9.12 [16:22:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.01, 9.85, 9.38 [16:22:45] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.33, 1.58, 1.50 [16:23:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.21, 4.03, 3.75 [16:23:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.61, 9.62, 9.19 [16:24:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.70, 8.65, 8.19 [16:24:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [16:25:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.45, 3.79, 3.69 [16:25:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.53, 9.61, 9.25 [16:26:00] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.41, 8.43, 8.18 [16:26:19] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.51, 8.35, 8.14 [16:26:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.52, 9.52, 9.40 [16:26:34] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 1.86, 2.14, 1.77 [16:27:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.10, 4.17, 3.83 [16:28:08] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.05, 9.50, 9.30 [16:28:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.39, 1.79, 1.68 [16:28:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.43, 9.88, 9.90 [16:30:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.32, 9.70, 9.46 [16:30:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.60, 1.69, 1.65 [16:31:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.07, 9.76, 9.40 [16:32:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.78, 9.41, 9.36 [16:33:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.36, 3.92, 3.86 [16:33:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.83, 9.51, 9.33 [16:35:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.36, 4.29, 3.99 [16:36:05] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.58, 9.00, 8.49 [16:36:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.05, 9.52, 9.41 [16:38:03] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.44, 8.47, 8.34 [16:38:05] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.11, 9.35, 9.36 [16:38:17] !log created my own betawiki account [16:38:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.52, 9.14, 9.28 [16:38:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.67, 9.44, 9.58 [16:38:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [16:40:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.89, 9.85, 9.53 [16:40:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.05, 9.12, 9.44 [16:41:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 14.19, 10.84, 9.88 [16:42:04] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 6.52, 8.77, 9.20 [16:42:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.23, 9.72, 9.64 [16:46:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.78, 9.58, 9.62 [16:47:32] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [16:47:32] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:49:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.21, 9.68, 9.74 [16:50:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.01, 1.54, 1.44 [16:50:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.54, 9.41, 9.50 [16:51:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.47, 9.79, 9.76 [16:51:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.13, 8.49, 7.97 [16:52:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.64, 1.58, 1.47 [16:52:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.41, 9.34, 9.46 [16:53:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.92, 9.76, 9.74 [16:53:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.26, 4.15, 3.47 [16:53:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.61, 7.84, 7.80 [16:56:30] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.78, 1.84, 1.61 [16:57:59] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 8.18, 8.04, 8.46 [17:00:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.38, 1.57, 1.54 [17:03:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 1.73, 3.25, 3.48 [17:05:10] [02miraheze/MirahezeMagic] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/commit/2abb8b389f88 [17:05:12] [02miraheze/MirahezeMagic] 07Universal-Omega 032abb8b3 - Fix usage of CentralAuthUser for MediaWiki 1.38.0+ [17:05:13] [02MirahezeMagic] 07Universal-Omega created branch 03Universal-Omega-patch-1 - 13https://github.com/miraheze/MirahezeMagic [17:05:15] [02MirahezeMagic] 07Universal-Omega opened pull request 03#324: Fix usage of CentralAuthUser for MediaWiki 1.38.0+ - 13https://github.com/miraheze/MirahezeMagic/pull/324 [17:07:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.99, 3.01, 3.38 [17:08:55] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.17, 8.51, 8.47 [17:09:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.00, 3.60, 3.97 [17:09:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 6.55, 7.44, 8.32 [17:10:10] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+1/-0/±0] 13https://github.com/miraheze/MirahezeMagic/commit/38e3359c2b08 [17:10:12] [02miraheze/MirahezeMagic] 07RhinosF1 0338e3359 - [py]: add CI [17:10:13] [02MirahezeMagic] 07RhinosF1 created branch 03RhinosF1-patch-2 - 13https://github.com/miraheze/MirahezeMagic [17:10:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.25, 9.08, 8.87 [17:10:32] [02MirahezeMagic] 07RhinosF1 opened pull request 03#325: [py]: add CI - 13https://github.com/miraheze/MirahezeMagic/pull/325 [17:10:54] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.02, 8.27, 8.40 [17:11:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.24, 3.75, 3.97 [17:11:12] miraheze/MirahezeMagic - Universal-Omega the build passed. [17:11:19] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+1/-0/±0] 13https://github.com/miraheze/MirahezeMagic/compare/38e3359c2b08...c977eaa534f6 [17:11:20] [02miraheze/MirahezeMagic] 07RhinosF1 03c977eaa - Create python.yml [17:11:22] [02MirahezeMagic] 07RhinosF1 synchronize pull request 03#325: [py]: add CI - 13https://github.com/miraheze/MirahezeMagic/pull/325 [17:13:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.86, 3.62, 3.89 [17:13:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.59, 8.64, 8.60 [17:13:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.91, 3.55, 3.47 [17:14:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.33, 9.34, 9.07 [17:14:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:15:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.23, 3.97, 3.99 [17:15:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.94, 4.23, 3.74 [17:16:02] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [17:16:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.43, 10.19, 9.41 [17:17:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.32, 9.78, 9.05 [17:17:51] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.96, 8.85, 8.58 [17:18:20] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/c977eaa534f6...ebffd41c59da [17:18:22] [02miraheze/MirahezeMagic] 07RhinosF1 03ebffd41 - Update generateSitemapIndex.py [17:18:23] [02MirahezeMagic] 07RhinosF1 synchronize pull request 03#325: [py]: add CI - 13https://github.com/miraheze/MirahezeMagic/pull/325 [17:19:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.41, 9.10, 8.89 [17:19:15] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.07, 3.42, 3.04 [17:19:16] miraheze/MirahezeMagic - RhinosF1 the build passed. [17:19:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:19:50] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.72, 8.17, 8.37 [17:21:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.08, 3.80, 3.97 [17:21:13] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.63, 3.22, 3.01 [17:22:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.83, 9.64, 9.51 [17:23:47] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.83, 1.79, 1.44 [17:23:48] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.93, 9.14, 8.68 [17:23:54] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ebffd41c59da...95f0c6f0d67a [17:23:56] [02miraheze/MirahezeMagic] 07RhinosF1 0395f0c6f - Update generateSitemapIndex.py [17:23:57] [02MirahezeMagic] 07RhinosF1 synchronize pull request 03#325: [py]: add CI - 13https://github.com/miraheze/MirahezeMagic/pull/325 [17:24:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.29, 9.16, 9.96 [17:24:57] miraheze/MirahezeMagic - RhinosF1 the build passed. [17:25:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.07, 7.99, 8.47 [17:25:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.14, 1.57, 1.41 [17:25:48] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.58, 9.18, 8.75 [17:26:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.32, 9.47, 9.97 [17:26:45] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/95f0c6f0d67a...8fbea860ffe0 [17:26:47] [02miraheze/MirahezeMagic] 07RhinosF1 038fbea86 - Update generateSitemapIndex.py [17:26:48] [02MirahezeMagic] 07RhinosF1 synchronize pull request 03#325: [py]: add CI - 13https://github.com/miraheze/MirahezeMagic/pull/325 [17:27:58] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/8fbea860ffe0...d361b1d7d6fe [17:28:00] [02miraheze/MirahezeMagic] 07RhinosF1 03d361b1d - Update generateSitemapIndex.py [17:28:01] [02MirahezeMagic] 07RhinosF1 synchronize pull request 03#325: [py]: add CI - 13https://github.com/miraheze/MirahezeMagic/pull/325 [17:28:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.46, 9.21, 9.80 [17:31:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.02, 8.92, 8.69 [17:31:10] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/d361b1d7d6fe...ea3ecebd809d [17:31:12] [02miraheze/MirahezeMagic] 07RhinosF1 03ea3eceb - Update mediawiki-tests.yml [17:31:13] [02MirahezeMagic] 07RhinosF1 synchronize pull request 03#325: [py]: add CI - 13https://github.com/miraheze/MirahezeMagic/pull/325 [17:31:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.59, 9.65, 9.04 [17:33:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.14, 2.84, 3.35 [17:33:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.65, 8.63, 8.62 [17:33:32] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/ea3ecebd809d...b9b09d3e6d55 [17:33:33] [02miraheze/MirahezeMagic] 07RhinosF1 03b9b09d3 - Update python.yml [17:33:35] [02MirahezeMagic] 07RhinosF1 synchronize pull request 03#325: [py]: add CI - 13https://github.com/miraheze/MirahezeMagic/pull/325 [17:33:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.61, 9.24, 8.97 [17:33:58] [02miraheze/MirahezeMagic] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-2 [+0/-0/±1] 13https://github.com/miraheze/MirahezeMagic/compare/b9b09d3e6d55...6d3c0963487c [17:33:59] [02miraheze/MirahezeMagic] 07RhinosF1 036d3c096 - Update mediawiki-tests.yml [17:34:01] [02MirahezeMagic] 07RhinosF1 synchronize pull request 03#325: [py]: add CI - 13https://github.com/miraheze/MirahezeMagic/pull/325 [17:34:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.45, 9.35, 9.55 [17:36:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.68, 8.98, 9.38 [17:37:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.86, 8.17, 8.44 [17:37:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.04, 3.55, 3.98 [17:39:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.42, 8.99, 8.84 [17:41:00] miraheze/MirahezeMagic - RhinosF1 the build passed. [17:41:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.34, 9.71, 8.95 [17:41:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.05, 8.47, 8.68 [17:43:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.96, 9.47, 8.97 [17:45:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.16, 3.93, 3.88 [17:46:49] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [17:47:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 4.07, 3.51 [17:47:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.33, 3.87, 3.87 [17:49:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.22, 9.41, 8.91 [17:50:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.74, 9.78, 9.16 [17:50:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.65, 8.12, 7.69 [17:52:31] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.82, 7.66, 7.58 [17:52:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.84, 9.49, 9.14 [17:53:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.04, 3.35, 3.45 [17:53:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.17, 8.11, 8.50 [17:53:48] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.92, 9.40, 9.06 [17:54:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.42, 8.99, 9.01 [17:54:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:55:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.78, 3.20, 3.37 [17:55:15] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.05, 3.36, 3.58 [17:55:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.47, 1.90, 1.42 [17:55:56] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.09, 8.31, 7.90 [17:56:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.21, 9.15, 9.08 [17:57:13] [02puppet] 07RhinosF1 opened pull request 03#2428: Use default_sync = all everywhere - 13https://github.com/miraheze/puppet/pull/2428 [17:57:25] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.18, 1.62, 1.38 [17:57:41] [02puppet] 07RhinosF1 synchronize pull request 03#2428: Use default_sync = all everywhere - 13https://github.com/miraheze/puppet/pull/2428 [17:57:54] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.57, 7.72, 7.74 [17:58:03] Reception123: ^ [17:58:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.13, 9.35, 9.15 [17:58:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.02, 9.09, 8.98 [17:59:17] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.81, 3.13, 3.44 [17:59:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [17:59:48] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.56, 10.71, 9.68 [17:59:52] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.78, 9.41, 8.90 [18:01:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.38, 3.01, 3.37 [18:01:47] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.24, 9.36, 8.95 [18:02:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.50, 8.99, 9.03 [18:05:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.98, 9.81, 9.62 [18:06:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.91, 9.58, 9.42 [18:08:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.50, 10.22, 9.66 [18:09:26] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.81, 8.90, 8.81 [18:10:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.32, 10.26, 9.63 [18:11:37] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.83, 8.73, 8.23 [18:11:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.24, 9.56, 9.46 [18:11:55] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.78, 9.19, 8.47 [18:13:16] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 5.96, 9.02, 9.02 [18:13:35] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.42, 7.95, 8.04 [18:13:50] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 5.07, 8.25, 9.03 [18:13:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 3.90, 7.51, 7.96 [18:14:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 3.85, 7.82, 8.97 [18:14:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 4.87, 8.18, 9.03 [18:14:51] [02puppet] 07JohnFLewis commented on pull request 03#2423: Allow static access from same domain - 13https://github.com/miraheze/puppet/pull/2423#issuecomment-1049071088 [18:15:03] PROBLEM - cp31 Stunnel HTTP for mw112 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:11] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 5.16, 7.49, 8.44 [18:15:14] PROBLEM - cp21 Stunnel HTTP for mw112 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:19] PROBLEM - cp21 Stunnel HTTP for mw111 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:27] PROBLEM - cp31 Stunnel HTTP for mw122 on cp31 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 0.239 second response time [18:15:40] PROBLEM - cp20 Stunnel HTTP for mw112 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:42] PROBLEM - cp30 Stunnel HTTP for mw121 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:46] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:48] PROBLEM - cp21 Stunnel HTTP for mw122 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:15:50] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 4.70, 6.94, 8.44 [18:15:56] PROBLEM - mw112 MediaWiki Rendering on mw112 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:16] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [18:16:17] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.407034158706665 seconds [18:16:23] PROBLEM - cp21 Stunnel HTTP for mw121 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:35] PROBLEM - cp31 Stunnel HTTP for mw121 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:35] PROBLEM - mw122 MediaWiki Rendering on mw122 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:16:56] PROBLEM - cp30 Stunnel HTTP for mw122 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [18:17:00] RECOVERY - cp31 Stunnel HTTP for mw112 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 3.228 second response time [18:17:10] RECOVERY - cp21 Stunnel HTTP for mw112 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 1.129 second response time [18:17:13] RECOVERY - cp21 Stunnel HTTP for mw111 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.020 second response time [18:17:27] RECOVERY - cp31 Stunnel HTTP for mw122 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 2.397 second response time [18:17:38] RECOVERY - cp20 Stunnel HTTP for mw112 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.019 second response time [18:17:43] RECOVERY - cp30 Stunnel HTTP for mw121 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 1.949 second response time [18:17:45] RECOVERY - cp21 Stunnel HTTP for mw122 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.017 second response time [18:17:45] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 22228 bytes in 0.609 second response time [18:17:51] RECOVERY - mw112 MediaWiki Rendering on mw112 is OK: HTTP OK: HTTP/1.1 200 OK - 22228 bytes in 0.380 second response time [18:18:21] RECOVERY - cp21 Stunnel HTTP for mw121 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.018 second response time [18:18:31] RECOVERY - cp31 Stunnel HTTP for mw121 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.657 second response time [18:18:35] RECOVERY - mw122 MediaWiki Rendering on mw122 is OK: HTTP OK: HTTP/1.1 200 OK - 22228 bytes in 0.826 second response time [18:18:54] RECOVERY - cp30 Stunnel HTTP for mw122 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 0.314 second response time [18:19:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.36, 8.57, 8.66 [18:21:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.72, 9.15, 8.84 [18:21:25] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.61, 8.81, 8.05 [18:21:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.15, 9.57, 9.12 [18:23:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.92, 9.16, 8.89 [18:23:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.92, 9.49, 9.14 [18:24:31] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.09, 1.61, 1.29 [18:25:21] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.39, 9.05, 8.35 [18:25:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.83, 8.81, 8.21 [18:26:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.30, 8.92, 8.82 [18:26:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.37, 1.64, 1.35 [18:27:19] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.09, 9.62, 8.63 [18:29:17] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.93, 9.90, 8.87 [18:32:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.36, 9.30, 9.11 [18:35:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.20, 9.05, 8.96 [18:35:23] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.77, 3.87, 3.37 [18:36:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 13.19, 10.79, 9.70 [18:37:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.94, 9.37, 9.09 [18:37:17] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.27, 4.27, 3.56 [18:37:32] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.64, 3.33, 2.96 [18:37:51] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.52, 9.57, 8.85 [18:39:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.24, 10.09, 9.39 [18:39:10] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.91, 3.77, 3.46 [18:39:29] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.04, 3.38, 3.01 [18:39:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 7.18, 8.84, 8.68 [18:40:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.86, 9.97, 9.27 [18:41:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.70, 3.19 [18:42:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.36, 9.99, 9.39 [18:43:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.66, 3.19, 3.30 [18:43:24] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.19, 4.21, 3.43 [18:43:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.10, 9.24, 8.87 [18:45:04] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.32, 9.14, 8.89 [18:45:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.67, 3.50, 3.26 [18:46:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.32, 9.90, 9.45 [18:47:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.34, 8.80, 8.80 [18:47:09] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.71, 1.49, 1.25 [18:47:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.09, 9.54, 9.15 [18:49:04] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.61, 9.29, 8.97 [18:49:08] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.69, 1.56, 1.31 [18:49:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.35, 3.17, 3.20 [18:52:49] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [18:53:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.49, 9.39, 9.63 [18:53:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.81, 9.31, 9.09 [18:55:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.64, 9.59, 9.21 [18:56:30] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 6.32, 3.25, 1.97 [18:57:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.25, 10.18, 9.86 [18:57:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.51, 9.46, 9.20 [18:59:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 6.92, 9.16, 9.55 [19:01:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.61, 9.69, 9.26 [19:01:55] PROBLEM - cp21 Stunnel HTTP for mw101 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:02:05] PROBLEM - cp20 Stunnel HTTP for mw101 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:02:21] PROBLEM - mw101 MediaWiki Rendering on mw101 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [19:03:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.87, 7.86, 8.38 [19:03:54] RECOVERY - cp21 Stunnel HTTP for mw101 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14562 bytes in 0.313 second response time [19:04:00] RECOVERY - cp20 Stunnel HTTP for mw101 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.021 second response time [19:04:23] RECOVERY - mw101 MediaWiki Rendering on mw101 is OK: HTTP OK: HTTP/1.1 200 OK - 22228 bytes in 2.557 second response time [19:04:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.60, 9.30, 9.89 [19:05:04] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.05, 8.00, 8.42 [19:06:30] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.11, 1.74, 1.74 [19:06:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.37, 10.38, 10.20 [19:07:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.84, 9.29, 9.33 [19:07:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.83, 9.92, 9.58 [19:08:30] PROBLEM - cp20 Current Load on cp20 is CRITICAL: CRITICAL - load average: 2.19, 1.85, 1.77 [19:09:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.51, 8.91, 8.72 [19:09:15] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.80, 3.81, 3.37 [19:09:46] [02mediawiki] 07MacFan4000 closed pull request 03#5537: Bump extensions/AJAXPoll from `2ea5085` to `5f740ab` - 13https://github.com/miraheze/mediawiki/pull/5537 [19:09:48] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/AJAXPoll-5f740ab [19:09:49] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/AJAXPoll-5f740ab - 13https://github.com/miraheze/mediawiki [19:09:51] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/2035d98f38d5...968b66df618b [19:09:52] [02miraheze/mediawiki] 07dependabot[bot] 03968b66d - Bump extensions/AJAXPoll from `2ea5085` to `5f740ab` (#5537) [19:10:11] [02mediawiki] 07MacFan4000 closed pull request 03#5536: Bump extensions/SemanticMediaWiki from `a46476c` to `77164bc` - 13https://github.com/miraheze/mediawiki/pull/5536 [19:10:13] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/968b66df618b...5ad1f6acaece [19:10:14] [02miraheze/mediawiki] 07dependabot[bot] 035ad1f6a - Bump extensions/SemanticMediaWiki from `a46476c` to `77164bc` (#5536) [19:10:16] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/SemanticMediaWiki-77164bc - 13https://github.com/miraheze/mediawiki [19:10:17] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/SemanticMediaWiki-77164bc [19:10:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.00, 1.54, 1.67 [19:10:31] [02mediawiki] 07MacFan4000 closed pull request 03#5535: Bump extensions/Translate from `fed015c` to `414f3cb` - 13https://github.com/miraheze/mediawiki/pull/5535 [19:10:32] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Translate-414f3cb - 13https://github.com/miraheze/mediawiki [19:10:34] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/5ad1f6acaece...e02265622636 [19:10:35] [02miraheze/mediawiki] 07dependabot[bot] 03e022656 - Bump extensions/Translate from `fed015c` to `414f3cb` (#5535) [19:10:37] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Translate-414f3cb [19:10:47] [02mediawiki] 07MacFan4000 closed pull request 03#5534: Bump extensions/IncidentReporting from `cad9014` to `54dfbd5` - 13https://github.com/miraheze/mediawiki/pull/5534 [19:10:49] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/e02265622636...c9800ca8cbc9 [19:10:50] [02miraheze/mediawiki] 07dependabot[bot] 03c9800ca - Bump extensions/IncidentReporting from `cad9014` to `54dfbd5` (#5534) [19:10:52] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/IncidentReporting-54dfbd5 [19:10:53] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/IncidentReporting-54dfbd5 - 13https://github.com/miraheze/mediawiki [19:11:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.17, 3.25, 3.22 [19:11:28] [02mediawiki] 07MacFan4000 closed pull request 03#5533: Bump skins/Cosmos from `3f70c00` to `34f65a4` - 13https://github.com/miraheze/mediawiki/pull/5533 [19:11:29] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/Cosmos-34f65a4 [19:11:31] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/c9800ca8cbc9...9b5cfbea518d [19:11:32] [02miraheze/mediawiki] 07dependabot[bot] 039b5cfbe - Bump skins/Cosmos from `3f70c00` to `34f65a4` (#5533) [19:11:34] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/Cosmos-34f65a4 - 13https://github.com/miraheze/mediawiki [19:12:11] [02mediawiki] 07MacFan4000 closed pull request 03#5532: Bump extensions/UniversalLanguageSelector from `7cbd413` to `0bd9a68` - 13https://github.com/miraheze/mediawiki/pull/5532 [19:12:13] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-0bd9a68 [19:12:14] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-0bd9a68 - 13https://github.com/miraheze/mediawiki [19:12:16] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/9b5cfbea518d...66b34f2f3681 [19:12:17] [02miraheze/mediawiki] 07dependabot[bot] 0366b34f2 - Bump extensions/UniversalLanguageSelector from `7cbd413` to `0bd9a68` (#5532) [19:12:24] [02mediawiki] 07MacFan4000 closed pull request 03#5531: Bump extensions/PageForms from `a390343` to `6bd0703` - 13https://github.com/miraheze/mediawiki/pull/5531 [19:12:25] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/PageForms-6bd0703 - 13https://github.com/miraheze/mediawiki [19:12:26] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/PageForms-6bd0703 [19:12:28] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/66b34f2f3681...7d619a252c64 [19:12:29] [02miraheze/mediawiki] 07dependabot[bot] 037d619a2 - Bump extensions/PageForms from `a390343` to `6bd0703` (#5531) [19:12:36] [02mediawiki] 07MacFan4000 closed pull request 03#5530: Bump extensions/Mermaid from `077ca5e` to `0862ad5` - 13https://github.com/miraheze/mediawiki/pull/5530 [19:12:38] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/7d619a252c64...1dda6dbe90c2 [19:12:39] [02miraheze/mediawiki] 07dependabot[bot] 031dda6db - Bump extensions/Mermaid from `077ca5e` to `0862ad5` (#5530) [19:12:41] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Mermaid-0862ad5 [19:12:42] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Mermaid-0862ad5 - 13https://github.com/miraheze/mediawiki [19:12:56] [02mediawiki] 07MacFan4000 closed pull request 03#5529: Bump extensions/MirahezeMagic from `615f48d` to `743af44` - 13https://github.com/miraheze/mediawiki/pull/5529 [19:12:57] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/MirahezeMagic-743af44 - 13https://github.com/miraheze/mediawiki [19:12:59] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/MirahezeMagic-743af44 [19:13:00] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/1dda6dbe90c2...c638170a6111 [19:13:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.04, 8.65, 9.12 [19:13:02] [02miraheze/mediawiki] 07dependabot[bot] 03c638170 - Bump extensions/MirahezeMagic from `615f48d` to `743af44` (#5529) [19:13:06] [02mediawiki] 07MacFan4000 closed pull request 03#5528: Bump extensions/StandardDialogs from `cc76e3a` to `89795dc` - 13https://github.com/miraheze/mediawiki/pull/5528 [19:13:07] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/c638170a6111...3dff3b632b7e [19:13:09] [02miraheze/mediawiki] 07dependabot[bot] 033dff3b6 - Bump extensions/StandardDialogs from `cc76e3a` to `89795dc` (#5528) [19:13:10] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/StandardDialogs-89795dc [19:13:12] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/StandardDialogs-89795dc - 13https://github.com/miraheze/mediawiki [19:13:25] [02mediawiki] 07MacFan4000 closed pull request 03#5527: Bump extensions/PortableInfobox from `d82a4df` to `4df958b` - 13https://github.com/miraheze/mediawiki/pull/5527 [19:13:27] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/3dff3b632b7e...0721eaef5c97 [19:13:28] [02miraheze/mediawiki] 07dependabot[bot] 030721eae - Bump extensions/PortableInfobox from `d82a4df` to `4df958b` (#5527) [19:13:30] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/PortableInfobox-4df958b - 13https://github.com/miraheze/mediawiki [19:13:31] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/PortableInfobox-4df958b [19:13:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.10, 9.67, 9.48 [19:13:53] [02mediawiki] 07MacFan4000 closed pull request 03#5526: Bump extensions/RottenLinks from `e52a662` to `445d803` - 13https://github.com/miraheze/mediawiki/pull/5526 [19:13:55] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/0721eaef5c97...bb6dfa67f184 [19:13:56] [02miraheze/mediawiki] 07dependabot[bot] 03bb6dfa6 - Bump extensions/RottenLinks from `e52a662` to `445d803` (#5526) [19:13:58] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/RottenLinks-445d803 - 13https://github.com/miraheze/mediawiki [19:13:59] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/RottenLinks-445d803 [19:14:05] [02mediawiki] 07MacFan4000 closed pull request 03#5525: Bump extensions/RemovePII from `0371de5` to `7491aba` - 13https://github.com/miraheze/mediawiki/pull/5525 [19:14:06] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/bb6dfa67f184...2aa6d2ab6e4c [19:14:08] [02miraheze/mediawiki] 07dependabot[bot] 032aa6d2a - Bump extensions/RemovePII from `0371de5` to `7491aba` (#5525) [19:14:09] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/RemovePII-7491aba - 13https://github.com/miraheze/mediawiki [19:14:11] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/RemovePII-7491aba [19:14:19] [02mediawiki] 07MacFan4000 closed pull request 03#5524: Bump extensions/SocialProfile from `a6d42ce` to `37838f0` - 13https://github.com/miraheze/mediawiki/pull/5524 [19:14:20] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/2aa6d2ab6e4c...737e763c5874 [19:14:22] [02miraheze/mediawiki] 07dependabot[bot] 03737e763 - Bump extensions/SocialProfile from `a6d42ce` to `37838f0` (#5524) [19:14:23] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/SocialProfile-37838f0 - 13https://github.com/miraheze/mediawiki [19:14:25] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/SocialProfile-37838f0 [19:14:28] [02mediawiki] 07MacFan4000 closed pull request 03#5523: Bump skins/Evelution from `d492062` to `73acf5f` - 13https://github.com/miraheze/mediawiki/pull/5523 [19:14:29] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/737e763c5874...144ca6668013 [19:14:31] [02miraheze/mediawiki] 07dependabot[bot] 03144ca66 - Bump skins/Evelution from `d492062` to `73acf5f` (#5523) [19:14:32] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/Evelution-73acf5f - 13https://github.com/miraheze/mediawiki [19:14:34] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/Evelution-73acf5f [19:14:54] [02mediawiki] 07MacFan4000 closed pull request 03#5521: Bump extensions/HAWelcome from `a3a87a1` to `67c1410` - 13https://github.com/miraheze/mediawiki/pull/5521 [19:14:56] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/HAWelcome-67c1410 [19:14:57] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/144ca6668013...ce274c148ddc [19:14:59] [02miraheze/mediawiki] 07dependabot[bot] 03ce274c1 - Bump extensions/HAWelcome from `a3a87a1` to `67c1410` (#5521) [19:15:00] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/HAWelcome-67c1410 - 13https://github.com/miraheze/mediawiki [19:15:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.38, 9.88, 9.50 [19:15:04] [02mediawiki] 07MacFan4000 closed pull request 03#5520: Bump extensions/DataDump from `ed3de61` to `3d78106` - 13https://github.com/miraheze/mediawiki/pull/5520 [19:15:06] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/ce274c148ddc...6cbf5447d7b6 [19:15:07] [02miraheze/mediawiki] 07dependabot[bot] 036cbf544 - Bump extensions/DataDump from `ed3de61` to `3d78106` (#5520) [19:15:09] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/DataDump-3d78106 [19:15:10] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/DataDump-3d78106 - 13https://github.com/miraheze/mediawiki [19:15:22] [02mediawiki] 07MacFan4000 closed pull request 03#5519: Bump extensions/ShortDescription from `bf568ed` to `26b10a9` - 13https://github.com/miraheze/mediawiki/pull/5519 [19:15:23] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/ShortDescription-26b10a9 - 13https://github.com/miraheze/mediawiki [19:15:25] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/ShortDescription-26b10a9 [19:15:26] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/6cbf5447d7b6...6f6363d76270 [19:15:28] [02miraheze/mediawiki] 07dependabot[bot] 036f6363d - Bump extensions/ShortDescription from `bf568ed` to `26b10a9` (#5519) [19:15:36] [02mediawiki] 07MacFan4000 closed pull request 03#5518: Bump extensions/YouTube from `f2c0e32` to `a007b6c` - 13https://github.com/miraheze/mediawiki/pull/5518 [19:15:37] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/YouTube-a007b6c - 13https://github.com/miraheze/mediawiki [19:15:39] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/YouTube-a007b6c [19:15:40] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/6f6363d76270...f57ef1fb8690 [19:15:42] [02miraheze/mediawiki] 07dependabot[bot] 03f57ef1f - Bump extensions/YouTube from `f2c0e32` to `a007b6c` (#5518) [19:15:45] [02mediawiki] 07MacFan4000 closed pull request 03#5517: Bump extensions/BlogPage from `d7e241f` to `05a8163` - 13https://github.com/miraheze/mediawiki/pull/5517 [19:15:47] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/BlogPage-05a8163 - 13https://github.com/miraheze/mediawiki [19:15:48] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/BlogPage-05a8163 [19:15:50] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/f57ef1fb8690...cbd549647119 [19:15:51] [02miraheze/mediawiki] 07dependabot[bot] 03cbd5496 - Bump extensions/BlogPage from `d7e241f` to `05a8163` (#5517) [19:16:00] [02mediawiki] 07MacFan4000 closed pull request 03#5516: Bump extensions/ManageWiki from `772b596` to `35b5466` - 13https://github.com/miraheze/mediawiki/pull/5516 [19:16:02] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/cbd549647119...de3444cf91dd [19:16:03] [02miraheze/mediawiki] 07dependabot[bot] 03de3444c - Bump extensions/ManageWiki from `772b596` to `35b5466` (#5516) [19:16:05] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/ManageWiki-35b5466 [19:16:06] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/ManageWiki-35b5466 - 13https://github.com/miraheze/mediawiki [19:16:10] [02mediawiki] 07MacFan4000 closed pull request 03#5515: Bump extensions/Comments from `c830f5e` to `72ce95c` - 13https://github.com/miraheze/mediawiki/pull/5515 [19:16:12] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/de3444cf91dd...cfd49a25e3a8 [19:16:14] [02miraheze/mediawiki] 07dependabot[bot] 03cfd49a2 - Bump extensions/Comments from `c830f5e` to `72ce95c` (#5515) [19:16:15] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Comments-72ce95c - 13https://github.com/miraheze/mediawiki [19:16:16] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Comments-72ce95c [19:16:31] [02mediawiki] 07MacFan4000 closed pull request 03#5514: Bump extensions/Cargo from `c9cc7f6` to `dc101b6` - 13https://github.com/miraheze/mediawiki/pull/5514 [19:16:32] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Cargo-dc101b6 - 13https://github.com/miraheze/mediawiki [19:16:34] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/cfd49a25e3a8...da97e705a74f [19:16:35] [02miraheze/mediawiki] 07dependabot[bot] 03da97e70 - Bump extensions/Cargo from `c9cc7f6` to `dc101b6` (#5514) [19:16:37] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Cargo-dc101b6 [19:17:02] [02mediawiki] 07MacFan4000 closed pull request 03#5512: Bump extensions/ProtectSite from `afa02d0` to `8eca4df` - 13https://github.com/miraheze/mediawiki/pull/5512 [19:17:03] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/ProtectSite-8eca4df - 13https://github.com/miraheze/mediawiki [19:17:05] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/ProtectSite-8eca4df [19:17:06] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/da97e705a74f...cb6c33fce0d6 [19:17:08] [02miraheze/mediawiki] 07dependabot[bot] 03cb6c33f - Bump extensions/ProtectSite from `afa02d0` to `8eca4df` (#5512) [19:17:12] [02mediawiki] 07MacFan4000 closed pull request 03#5511: Bump extensions/GlobalNewFiles from `f3f3179` to `68aca4a` - 13https://github.com/miraheze/mediawiki/pull/5511 [19:17:14] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/cb6c33fce0d6...be372de14522 [19:17:15] [02miraheze/mediawiki] 07dependabot[bot] 03be372de - Bump extensions/GlobalNewFiles from `f3f3179` to `68aca4a` (#5511) [19:17:17] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/GlobalNewFiles-68aca4a - 13https://github.com/miraheze/mediawiki [19:17:18] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/GlobalNewFiles-68aca4a [19:17:35] [02mediawiki] 07MacFan4000 closed pull request 03#5510: Bump skins/snapwikiskin from `3689482` to `ffc4aa1` - 13https://github.com/miraheze/mediawiki/pull/5510 [19:17:36] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/be372de14522...1e90ec96266f [19:17:38] [02miraheze/mediawiki] 07dependabot[bot] 031e90ec9 - Bump skins/snapwikiskin from `3689482` to `ffc4aa1` (#5510) [19:17:39] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/snapwikiskin-ffc4aa1 [19:17:41] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/skins/snapwikiskin-ffc4aa1 - 13https://github.com/miraheze/mediawiki [19:17:52] [02mediawiki] 07MacFan4000 closed pull request 03#5509: Bump extensions/QuizGame from `1f52534` to `9b43e02` - 13https://github.com/miraheze/mediawiki/pull/5509 [19:17:53] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/1e90ec96266f...4e611ff099e8 [19:17:55] [02miraheze/mediawiki] 07dependabot[bot] 034e611ff - Bump extensions/QuizGame from `1f52534` to `9b43e02` (#5509) [19:17:56] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/QuizGame-9b43e02 - 13https://github.com/miraheze/mediawiki [19:17:58] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/QuizGame-9b43e02 [19:18:33] [02mediawiki] 07MacFan4000 closed pull request 03#5508: Bump extensions/WikiDiscover from `49295c1` to `086af25` - 13https://github.com/miraheze/mediawiki/pull/5508 [19:18:34] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/4e611ff099e8...3b9aa7dce310 [19:18:36] [02miraheze/mediawiki] 07dependabot[bot] 033b9aa7d - Bump extensions/WikiDiscover from `49295c1` to `086af25` (#5508) [19:18:37] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/WikiDiscover-086af25 - 13https://github.com/miraheze/mediawiki [19:18:39] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/WikiDiscover-086af25 [19:18:54] [02mediawiki] 07MacFan4000 closed pull request 03#5507: Bump extensions/WikiForum from `3b6d887` to `2a42c61` - 13https://github.com/miraheze/mediawiki/pull/5507 [19:18:55] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/3b9aa7dce310...a142237a04fc [19:18:57] [02miraheze/mediawiki] 07dependabot[bot] 03a142237 - Bump extensions/WikiForum from `3b6d887` to `2a42c61` (#5507) [19:18:58] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/WikiForum-2a42c61 [19:19:00] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/WikiForum-2a42c61 - 13https://github.com/miraheze/mediawiki [19:19:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.93, 9.90, 9.63 [19:19:04] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.40, 9.27, 8.81 [19:19:09] [02mediawiki] 07MacFan4000 closed pull request 03#5506: Bump extensions/MatomoAnalytics from `6f44fd3` to `f2a07d0` - 13https://github.com/miraheze/mediawiki/pull/5506 [19:19:10] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/a142237a04fc...9a6b8049107d [19:19:12] [02miraheze/mediawiki] 07dependabot[bot] 039a6b804 - Bump extensions/MatomoAnalytics from `6f44fd3` to `f2a07d0` (#5506) [19:19:13] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/MatomoAnalytics-f2a07d0 [19:19:15] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/MatomoAnalytics-f2a07d0 - 13https://github.com/miraheze/mediawiki [19:19:19] [02mediawiki] 07MacFan4000 closed pull request 03#5505: Bump extensions/PollNY from `15e563e` to `3df00e9` - 13https://github.com/miraheze/mediawiki/pull/5505 [19:19:21] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/PollNY-3df00e9 [19:19:22] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/PollNY-3df00e9 - 13https://github.com/miraheze/mediawiki [19:19:24] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/9a6b8049107d...2e1ab9048a8f [19:19:25] [02miraheze/mediawiki] 07dependabot[bot] 032e1ab90 - Bump extensions/PollNY from `15e563e` to `3df00e9` (#5505) [19:19:33] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Maps-9eae313 [19:19:35] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/Maps-9eae313 - 13https://github.com/miraheze/mediawiki [19:19:36] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/2e1ab9048a8f...5818df23136a [19:19:38] [02miraheze/mediawiki] 07dependabot[bot] 035818df2 - Bump extensions/Maps from `9e5c3ab` to `9eae313` (#5504) [19:19:39] [02mediawiki] 07MacFan4000 closed pull request 03#5504: Bump extensions/Maps from `9e5c3ab` to `9eae313` - 13https://github.com/miraheze/mediawiki/pull/5504 [19:19:42] [02mediawiki] 07MacFan4000 closed pull request 03#5503: Bump extensions/ApprovedRevs from `8d1fe26` to `a7fb6ac` - 13https://github.com/miraheze/mediawiki/pull/5503 [19:19:43] [02miraheze/mediawiki] 07MacFan4000 pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/compare/5818df23136a...85092c957378 [19:19:45] [02miraheze/mediawiki] 07dependabot[bot] 0385092c9 - Bump extensions/ApprovedRevs from `8d1fe26` to `a7fb6ac` (#5503) [19:19:46] [02mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/ApprovedRevs-a7fb6ac - 13https://github.com/miraheze/mediawiki [19:19:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.73, 9.58, 9.55 [19:19:48] [02miraheze/mediawiki] 07MacFan4000 deleted branch 03dependabot/submodules/REL1_37/extensions/ApprovedRevs-a7fb6ac [19:20:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.75, 9.00, 9.82 [19:20:49] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [19:20:55] !log sudo chmod -R 775 /home/puppet-users/ssl-keys on puppet111 [19:20:57] ^ MacFan4000 [19:21:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.43, 10.49, 9.85 [19:21:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:21:48] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.85, 10.36, 9.86 [19:22:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.07, 9.97, 10.09 [19:23:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.16, 9.36, 9.01 [19:23:21] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.20, 8.34, 8.26 [19:23:29] [02puppet] 07Universal-Omega commented on pull request 03#2423: Allow static access from same domain - 13https://github.com/miraheze/puppet/pull/2423#issuecomment-1049131628 [19:24:21] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.82, 9.56, 9.93 [19:24:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.04, 9.52, 9.97 [19:24:55] !log [macfan@mwtask111] starting deploy of {'world': True, 'l10n': True} to all [19:25:06] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:25:18] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.71, 8.32, 8.27 [19:26:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.03, 9.72, 9.94 [19:28:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.01, 9.25, 9.75 [19:31:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.75, 9.44, 9.85 [19:32:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.83, 9.68, 9.80 [19:32:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.80, 9.59, 9.65 [19:34:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.38, 9.21, 9.51 [19:36:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.89, 9.45, 9.72 [19:37:04] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.36, 7.94, 8.47 [19:37:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.73, 4.19, 3.26 [19:37:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.29, 9.41, 9.85 [19:38:39] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.91, 1.55, 1.41 [19:40:34] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.30, 1.41, 1.37 [19:41:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.47, 3.71, 3.27 [19:42:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.36, 9.17, 9.24 [19:43:16] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.40, 4.17, 3.48 [19:44:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.49, 8.64, 9.04 [19:45:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.71, 4.19, 3.15 [19:45:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.61, 3.77, 3.41 [19:47:16] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.82, 3.36, 3.30 [19:47:48] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.01, 9.98, 9.86 [19:48:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.71, 9.87, 9.37 [19:49:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.24, 9.82, 9.83 [19:51:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.95, 3.70, 3.30 [19:51:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.05, 10.02, 9.91 [19:51:51] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.31, 9.20, 8.43 [19:52:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.13, 8.46, 8.81 [19:53:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.27, 3.37, 3.24 [19:53:36] !log [macfan@mwtask111] finished deploy of {'world': True, 'l10n': True} to all - SUCCESS in 1720s [19:53:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [19:53:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.90, 9.41, 9.68 [19:53:49] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.61, 9.06, 8.46 [19:55:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.38, 9.66, 9.13 [19:55:47] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.52, 8.29, 8.26 [19:56:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.56, 9.38, 9.46 [19:58:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.54, 9.83, 9.62 [19:59:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.54, 4.02, 3.60 [19:59:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.93, 10.01, 9.77 [20:00:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.05, 9.42, 9.49 [20:01:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.31, 3.41, 3.43 [20:01:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.17, 9.92, 9.49 [20:03:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.63, 3.22, 3.36 [20:06:33] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.64, 8.70, 8.47 [20:07:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.14, 9.65, 9.84 [20:09:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.53, 4.08, 3.58 [20:09:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.27, 8.83, 9.04 [20:10:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.88, 9.01, 9.10 [20:11:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.64, 3.48, 3.42 [20:13:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.05, 8.92, 9.06 [20:13:30] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.53, 8.61, 8.39 [20:13:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.32, 8.98, 9.36 [20:15:27] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.12, 8.37, 8.32 [20:17:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.14, 3.84, 3.62 [20:17:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.12, 9.83, 9.33 [20:19:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.03, 9.04, 9.11 [20:19:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.04, 8.76, 8.48 [20:20:19] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 11.28, 9.87, 9.20 [20:20:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.43, 9.23, 9.48 [20:22:17] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.69, 9.71, 9.22 [20:23:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.93, 3.76, 3.68 [20:24:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 13.21, 10.44, 9.82 [20:25:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.42, 4.15, 3.81 [20:25:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.45, 9.53, 9.31 [20:28:23] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.12, 1.76, 1.29 [20:29:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 1.86, 3.39, 3.61 [20:29:03] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.75, 8.26, 8.37 [20:30:22] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.05, 1.50, 1.25 [20:31:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.57, 9.84, 9.58 [20:32:07] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.65, 7.89, 8.46 [20:33:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.71, 10.51, 9.85 [20:35:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.72, 4.07, 3.80 [20:36:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.77, 9.60, 9.85 [20:37:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.44, 3.89, 3.77 [20:39:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 7.24, 5.27, 4.29 [20:39:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.73, 9.90, 9.80 [20:40:16] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.19, 3.18, 2.67 [20:40:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.14, 10.65, 10.20 [20:40:32] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.85, 3.57, 2.99 [20:41:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.43, 10.62, 10.09 [20:41:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.83, 9.60, 9.96 [20:42:14] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.71, 3.48, 2.85 [20:43:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 9.50, 9.81, 10.01 [20:44:27] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.89, 3.65, 3.18 [20:46:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.46, 3.31, 3.11 [20:47:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.97, 9.70, 9.90 [20:47:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.78, 8.15, 8.05 [20:48:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.10, 3.27, 2.97 [20:49:46] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.39, 9.59, 8.83 [20:49:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.64, 7.88, 7.97 [20:51:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 9.33, 10.07, 10.03 [20:52:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.87, 9.35, 9.91 [20:53:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.70, 3.26, 3.99 [20:53:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.13, 9.60, 9.85 [20:53:51] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 10.57, 9.49, 8.62 [20:54:31] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.97, 1.53, 1.22 [20:55:40] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.70, 9.86, 9.23 [20:55:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.78, 9.02, 8.54 [20:56:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 0.78, 1.23, 1.15 [20:56:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.71, 9.79, 9.93 [20:57:38] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.87, 10.27, 9.46 [20:59:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.77, 3.53, 3.84 [20:59:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.38, 9.91, 9.87 [20:59:36] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.53, 9.89, 9.43 [20:59:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 6.99, 8.36, 8.43 [21:01:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.00, 3.31, 3.72 [21:01:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.54, 9.68, 9.81 [21:02:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.64, 9.48, 9.81 [21:03:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 3.80, 3.85 [21:03:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.62, 9.65, 9.76 [21:03:16] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.43, 3.20, 3.03 [21:03:52] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.43, 3.17 [21:04:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.02, 10.08, 10.01 [21:05:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.88, 9.73, 9.78 [21:05:15] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.07, 3.07, 3.00 [21:05:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.45, 8.90, 9.73 [21:05:50] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.11, 3.34, 3.16 [21:06:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.15, 9.17, 9.67 [21:07:28] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.65, 7.27, 8.37 [21:07:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.04, 9.16, 9.71 [21:09:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.73, 3.74, 3.81 [21:10:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.33, 9.65, 9.66 [21:11:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.63, 3.75 [21:11:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.58, 9.06, 9.61 [21:12:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.32, 8.80, 9.83 [21:13:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.69, 3.19, 3.57 [21:13:30] PROBLEM - cp31 Stunnel HTTP for mw102 on cp31 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:13:57] PROBLEM - cp20 Stunnel HTTP for mw102 on cp20 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:14:01] PROBLEM - cp30 Stunnel HTTP for mw102 on cp30 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:14:10] PROBLEM - cp21 Stunnel HTTP for mw102 on cp21 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [21:15:25] RECOVERY - cp31 Stunnel HTTP for mw102 on cp31 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 0.312 second response time [21:15:56] RECOVERY - cp20 Stunnel HTTP for mw102 on cp20 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 1.746 second response time [21:16:00] RECOVERY - cp30 Stunnel HTTP for mw102 on cp30 is OK: HTTP OK: HTTP/1.1 200 OK - 14548 bytes in 2.324 second response time [21:16:08] RECOVERY - cp21 Stunnel HTTP for mw102 on cp21 is OK: HTTP OK: HTTP/1.1 200 OK - 14556 bytes in 1.357 second response time [21:17:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.27, 3.51, 3.58 [21:17:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.22, 8.71, 9.02 [21:17:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.53, 9.10, 9.32 [21:19:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.50, 3.11, 3.43 [21:19:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.68, 9.12, 9.14 [21:19:15] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.61, 8.34, 8.16 [21:21:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.60, 9.98, 9.47 [21:21:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.37, 9.49, 9.45 [21:23:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.16, 3.38, 3.45 [21:23:11] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.81, 8.25, 8.18 [21:25:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.96, 2.90, 3.27 [21:26:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.03, 9.83, 9.53 [21:27:05] PROBLEM - mw112 Current Load on mw112 is CRITICAL: CRITICAL - load average: 10.77, 8.82, 8.35 [21:27:48] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 12.08, 10.29, 9.70 [21:29:04] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.44, 8.40, 8.24 [21:29:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.38, 9.32, 9.41 [21:30:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.55, 9.12, 9.35 [21:30:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.87, 9.21, 9.93 [21:31:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.06, 9.63, 9.51 [21:32:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.38, 9.43, 9.42 [21:32:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.26, 9.67, 9.99 [21:33:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.20, 9.65, 9.69 [21:34:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.05, 9.50, 9.90 [21:35:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.56, 8.86, 9.24 [21:36:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.46, 9.65, 9.58 [21:36:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.17, 9.61, 9.88 [21:41:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.10, 9.29, 9.48 [21:41:38] PROBLEM - cloud12 Puppet on cloud12 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [21:44:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.46, 8.95, 9.16 [21:44:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.64, 9.49, 9.86 [21:45:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.85, 9.79, 9.65 [21:45:11] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 8.85, 5.23, 3.87 [21:52:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.57, 9.01, 9.20 [21:52:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.72, 9.70, 9.64 [21:53:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 11.75, 9.56, 8.99 [21:54:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.69, 9.63, 9.39 [21:55:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.14, 3.98, 3.95 [21:55:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.87, 8.50, 8.01 [21:55:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.59, 9.27, 8.96 [21:56:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.78, 9.69, 9.68 [21:57:04] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.70, 8.04, 7.89 [21:59:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [21:59:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.78, 9.65, 9.15 [22:01:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.57, 9.31, 9.10 [22:03:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.52, 3.71, 3.72 [22:04:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:05:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.04, 3.49, 3.65 [22:05:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.72, 8.84, 8.92 [22:07:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.27, 4.29, 3.92 [22:07:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.48, 9.22, 9.07 [22:08:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.08, 9.04, 8.95 [22:08:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:09:38] RECOVERY - cloud12 Puppet on cloud12 is OK: OK: Puppet is currently enabled, last run 44 seconds ago with 0 failures [22:10:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.10, 9.05, 8.97 [22:11:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.90, 3.93, 3.90 [22:12:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.15, 9.56, 9.18 [22:13:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.23, 9.30, 9.13 [22:13:47] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.12, 7.75, 8.38 [22:14:33] PROBLEM - cp20 Current Load on cp20 is WARNING: WARNING - load average: 1.96, 1.53, 1.13 [22:15:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.33, 4.30, 4.04 [22:15:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.22, 8.68, 8.92 [22:16:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.51, 9.76, 9.93 [22:16:30] RECOVERY - cp20 Current Load on cp20 is OK: OK - load average: 1.63, 1.52, 1.17 [22:16:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.36, 9.86, 9.45 [22:17:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.24, 3.88, 3.92 [22:17:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.97, 9.18, 8.83 [22:19:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.70, 4.07, 4.00 [22:19:04] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.98, 8.74, 8.09 [22:19:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 6.90, 8.51, 8.65 [22:23:04] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 5.11, 7.44, 7.77 [22:23:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:24:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.48, 9.16, 9.04 [22:26:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.46, 8.36, 8.78 [22:27:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:28:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.13, 8.98, 8.95 [22:29:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.26, 9.10, 8.82 [22:30:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.88, 9.20, 9.26 [22:30:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.49, 8.36, 8.72 [22:31:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.53, 3.35, 3.82 [22:31:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.87, 9.50, 9.01 [22:32:35] ok : [RESOLVED] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:33:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.17, 9.43, 9.03 [22:33:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.08, 9.59, 9.05 [22:34:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.52, 9.75, 9.20 [22:35:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.43, 2.48, 3.37 [22:35:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.15, 9.32, 9.04 [22:35:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.17, 9.11, 8.93 [22:36:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.57, 8.81, 8.92 [22:36:35] alerting : [FIRING:1] (PHP-FPM Worker Usage High yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [22:38:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.22, 9.60, 9.21 [22:39:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.43, 9.50, 9.17 [22:40:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 8.67, 9.85, 9.84 [22:43:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 9.11, 9.65, 9.33 [22:43:48] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 9.97, 9.00, 8.38 [22:44:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 6.96, 9.16, 9.23 [22:45:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.95, 3.67, 3.44 [22:45:47] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 8.18, 8.49, 8.26 [22:48:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.98, 9.69, 9.73 [22:50:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.14, 9.08, 9.13 [22:51:39] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.98, 8.82, 8.47 [22:52:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.41, 9.70, 9.75 [22:53:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.27, 9.47, 9.16 [22:53:37] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.56, 8.02, 8.22 [22:54:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 8.62, 9.47, 9.34 [22:55:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.91, 4.51, 3.94 [22:55:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.88, 9.32, 9.15 [22:56:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.68, 9.98, 9.55 [22:57:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.53, 3.86, 3.78 [22:57:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.60, 9.44, 9.06 [22:58:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.46, 9.84, 9.56 [23:00:02] !log [@test101] starting deploy of {'l10nupdate': True} to skip [23:00:06] !log [@mwtask111] starting deploy of {'l10nupdate': True} to all [23:00:35] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:00:52] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:01:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.59, 4.05, 3.86 [23:02:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 11.63, 9.94, 9.67 [23:03:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.55, 9.25, 9.23 [23:05:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.38, 3.69, 3.75 [23:06:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.47, 9.63, 9.48 [23:07:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.08, 8.73, 8.97 [23:08:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.67, 8.72, 9.16 [23:09:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.31, 8.88, 9.00 [23:10:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.66, 9.42, 9.82 [23:10:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 11.68, 10.15, 9.65 [23:10:49] PROBLEM - diamowiki.ga - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - diamowiki.ga All nameservers failed to answer the query. [23:11:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 12.28, 9.98, 9.40 [23:11:47] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.72, 3.02, 2.68 [23:12:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.35, 9.70, 9.54 [23:13:00] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.27, 3.46, 3.57 [23:13:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 7.92, 9.03, 9.12 [23:13:45] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.35, 3.35, 2.84 [23:14:49] !log [@mwtask111] finished deploy of {'l10nupdate': True} to all - SUCCESS in 884s [23:15:15] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:17:42] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.76, 1.72, 1.29 [23:18:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 12.70, 10.08, 9.55 [23:19:37] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.63, 3.75, 3.24 [23:19:42] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.04, 1.68, 1.32 [23:19:47] PROBLEM - mw101 Current Load on mw101 is CRITICAL: CRITICAL - load average: 10.57, 8.66, 8.71 [23:21:35] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.23, 3.78, 3.30 [23:21:42] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.90, 1.39, 1.26 [23:21:47] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 8.02, 8.62, 8.71 [23:21:56] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.67, 8.10, 7.57 [23:22:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 7.34, 8.96, 9.22 [23:23:47] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.18, 7.89, 8.42 [23:23:53] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.36, 7.73, 7.49 [23:24:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.16, 8.96, 9.28 [23:25:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 11.07, 9.36, 9.05 [23:25:30] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.54, 3.10, 3.13 [23:26:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.01, 8.29, 9.00 [23:27:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.87, 8.90, 8.90 [23:29:01] PROBLEM - mw121 Current Load on mw121 is CRITICAL: CRITICAL - load average: 10.51, 9.38, 9.07 [23:29:54] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.67, 8.20, 7.88 [23:31:01] PROBLEM - mw121 Current Load on mw121 is WARNING: WARNING - load average: 8.55, 9.11, 9.01 [23:31:51] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 8.75, 8.50, 7.92 [23:31:52] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.93, 7.72, 7.75 [23:32:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.21, 8.58, 8.84 [23:32:52] !log [@test101] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 1969s [23:32:59] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [23:33:51] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.03, 8.11, 7.86 [23:34:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 9.91, 8.83, 8.89 [23:34:46] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 9.80, 9.24, 8.76 [23:36:31] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.45, 7.74, 8.41 [23:36:45] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 5.32, 8.07, 8.42 [23:38:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.48, 9.33, 9.07 [23:40:19] PROBLEM - diamowiki.ga - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 123, in main rdns_hostname = get_reverse_dnshostname(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 108, in get_reverse_dnshostname resolved_ip_addr = str(dns_resolver.resolve(hostn [23:40:19] AA')[0]) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 1043, in resolve timeout = self._compute_timeout(start, lifetime) File "/usr/lib/python3/dist-packages/dns/resolver.py", line 950, in _compute_timeout raise Timeout(timeout=duration)dns.exception.Timeout: The DNS operation timed out after 5.406438589096069 seconds [23:42:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.40, 8.55, 8.83 [23:47:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.25, 3.54, 4.00 [23:47:01] RECOVERY - mw121 Current Load on mw121 is OK: OK - load average: 7.76, 8.09, 8.48 [23:48:32] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 8.58, 8.54, 8.12 [23:49:50] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 1.91, 2.08, 1.55 [23:50:31] PROBLEM - mw102 Current Load on mw102 is CRITICAL: CRITICAL - load average: 10.87, 9.85, 8.92 [23:51:49] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.16, 1.81, 1.51 [23:52:28] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 7.08, 8.10, 8.03 [23:52:38] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 7.48, 8.73, 8.55 [23:54:31] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 9.05, 9.86, 9.18 [23:54:39] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 6.47, 8.05, 8.33 [23:56:20] PROBLEM - mw122 Current Load on mw122 is CRITICAL: CRITICAL - load average: 10.14, 8.91, 8.77 [23:58:20] PROBLEM - mw122 Current Load on mw122 is WARNING: WARNING - load average: 7.79, 8.53, 8.66 [23:59:00] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.37, 2.68, 3.27 [23:59:46] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.88, 1.41, 1.50