[00:00:58] PROBLEM - wiki.jeremyboyd.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.jeremyboyd.org' expires in 8 day(s) (Tue 21 Dec 2021 05:07:51 GMT +0000). [00:02:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.07, 3.98, 3.75 [00:02:21] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 41.64, 26.92, 21.73 [00:03:48] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.78, 7.95, 7.98 [00:04:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.88, 3.56, 3.62 [00:05:58] PROBLEM - wikipedia.yogfront.ooo - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wikipedia.yogfront.ooo' expires in 13 day(s) (Sun 26 Dec 2021 12:33:58 GMT +0000). [00:06:01] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 9.33, 6.30, 4.34 [00:08:01] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.65, 5.09, 4.13 [00:08:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.79, 4.11, 3.80 [00:10:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.51, 3.64, 3.68 [00:10:16] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.72, 7.40, 7.93 [00:10:51] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 5.93, 7.37, 7.96 [00:12:01] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.82, 5.66, 4.59 [00:12:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.24, 3.98, 3.80 [00:12:18] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.04, 7.66, 7.95 [00:14:01] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 9.45, 6.70, 5.08 [00:14:17] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.65, 6.99, 7.65 [00:14:52] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.15, 7.24, 7.75 [00:16:52] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.36, 7.36, 7.73 [00:18:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.21, 3.70, 3.77 [00:18:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:18:52] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.36, 8.09, 7.95 [00:19:48] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.01, 7.26, 7.20 [00:20:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.15, 4.19, 3.94 [00:20:15] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 13.35, 8.67, 7.95 [00:21:48] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.05, 7.00, 7.11 [00:23:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:24:52] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.99, 7.94, 7.95 [00:25:48] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.04, 7.35, 7.18 [00:26:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.36, 3.67, 3.87 [00:28:19] CosmicAlpha, and SRE, getting ```Could not locally block 2a02:27ac::/32 [00:28:19] [f6f43f5f2710ff854913957e] Caught exception of type Error [00:28:19] Could not locally block 2a0a:8c40::/32 [00:28:19] [36ad233a21f2c8826e7a89c9] Caught exception of type Error``` [00:28:23] can you trace? [00:28:51] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.40, 7.62, 7.80 [00:30:03] might possibly be a JS error with MassGlobalBlock.js, so I'll ping Void here if that's the case [00:30:14] @Void ^ https://www.irccloud.com/pastebin/Yw9QsXoa/ [00:31:08] The user is still causing even more pain, even if some of their proxies are blocked. It still irritates even me. [00:32:08] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.82, 7.52, 7.91 [00:32:51] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.74, 7.71, 7.77 [00:33:48] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.32, 7.43, 7.43 [00:34:06] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.56, 8.88, 8.39 [00:38:04] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.88, 6.95, 7.70 [00:40:02] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.63, 7.48, 7.79 [00:40:52] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.57, 5.66, 6.68 [00:41:48] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.01, 7.27, 7.23 [00:42:01] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.20, 6.84, 7.51 [00:42:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.93, 3.75, 3.64 [00:44:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.92, 3.79, 3.67 [00:44:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:44:52] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.91, 7.21, 7.05 [00:46:52] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.25, 6.19, 6.69 [00:47:48] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.38, 7.87, 7.68 [00:49:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:49:48] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.76, 8.41, 7.90 [00:49:56] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.76, 7.54, 7.49 [00:50:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.26, 3.66, 3.62 [00:50:51] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 8.33, 7.26, 6.98 [00:52:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.74, 3.73, 3.66 [00:52:52] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.18, 6.83, 6.85 [00:53:48] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.43, 7.55, 7.78 [00:53:53] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 4.32, 6.52, 7.14 [00:54:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.92, 4.02, 3.76 [00:54:52] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.10, 5.70, 6.42 [00:56:11] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Cargo-d100b8c [+0/-0/±1] 13https://git.io/JDWFo [00:56:13] [02miraheze/mediawiki] 07dependabot[bot] 03d9dd2d8 - Bump extensions/Cargo from `5decb5b` to `d100b8c` [00:56:14] [02mediawiki] 07dependabot[bot] opened pull request 03#4559: Bump extensions/Cargo from `5decb5b` to `d100b8c` - 13https://git.io/JDWFK [00:56:16] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Cargo-d100b8c - 13https://git.io/vbL5b [00:56:20] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Translate-0babb26 [+0/-0/±1] 13https://git.io/JDWFX [00:56:22] [02miraheze/mediawiki] 07dependabot[bot] 03bc790a1 - Bump extensions/Translate from `d275ed1` to `0babb26` [00:56:23] [02mediawiki] 07dependabot[bot] opened pull request 03#4560: Bump extensions/Translate from `d275ed1` to `0babb26` - 13https://git.io/JDWF1 [00:56:25] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Translate-0babb26 - 13https://git.io/vbL5b [00:56:26] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-357e68b [+0/-0/±1] 13https://git.io/JDWFS [00:56:28] [02miraheze/mediawiki] 07dependabot[bot] 03c723080 - Bump extensions/UniversalLanguageSelector from `0cf64b5` to `357e68b` [00:56:29] [02mediawiki] 07dependabot[bot] opened pull request 03#4561: Bump extensions/UniversalLanguageSelector from `0cf64b5` to `357e68b` - 13https://git.io/JDWF9 [00:56:31] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-357e68b - 13https://git.io/vbL5b [00:56:32] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/ProtectSite-6e5558f [+0/-0/±1] 13https://git.io/JDWF5 [00:56:34] [02miraheze/mediawiki] 07dependabot[bot] 038161960 - Bump extensions/ProtectSite from `80119f0` to `6e5558f` [00:56:35] [02mediawiki] 07dependabot[bot] opened pull request 03#4562: Bump extensions/ProtectSite from `80119f0` to `6e5558f` - 13https://git.io/JDWFd [00:56:37] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/ProtectSite-6e5558f - 13https://git.io/vbL5b [00:56:38] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/Cosmos-1ad1915 [+0/-0/±1] 13https://git.io/JDWFb [00:56:40] [02miraheze/mediawiki] 07dependabot[bot] 03bf19dfa - Bump skins/Cosmos from `244d95a` to `1ad1915` [00:56:41] [02mediawiki] 07github-actions[bot] labeled pull request 03#4559: Bump extensions/Cargo from `5decb5b` to `d100b8c` - 13https://git.io/JDWFK [00:56:43] [02mediawiki] 07dependabot[bot] opened pull request 03#4563: Bump skins/Cosmos from `244d95a` to `1ad1915` - 13https://git.io/JDWFN [00:56:44] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/Cosmos-1ad1915 - 13https://git.io/vbL5b [00:56:46] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/Evelution-2cc6564 [+0/-0/±1] 13https://git.io/JDWFA [00:56:47] [02miraheze/mediawiki] 07dependabot[bot] 03f9e2ffa - Bump skins/Evelution from `435441d` to `2cc6564` [00:56:49] [02mediawiki] 07dependabot[bot] opened pull request 03#4564: Bump skins/Evelution from `435441d` to `2cc6564` - 13https://git.io/JDWFp [00:56:50] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/Evelution-2cc6564 - 13https://git.io/vbL5b [00:56:52] [02mediawiki] 07github-actions[bot] labeled pull request 03#4561: Bump extensions/UniversalLanguageSelector from `0cf64b5` to `357e68b` - 13https://git.io/JDWF9 [00:56:53] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/Femiwiki-be075c6 [+0/-0/±1] 13https://git.io/JDWbf [00:56:55] [02miraheze/mediawiki] 07dependabot[bot] 03d9379eb - Bump skins/Femiwiki from `d7b9cfd` to `be075c6` [00:56:56] [02mediawiki] 07dependabot[bot] opened pull request 03#4565: Bump skins/Femiwiki from `d7b9cfd` to `be075c6` - 13https://git.io/JDWbJ [00:56:58] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/Femiwiki-be075c6 - 13https://git.io/vbL5b [00:56:59] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/RatePage-a9d6b32 [+0/-0/±1] 13https://git.io/JDWbU [00:57:01] [02miraheze/mediawiki] 07dependabot[bot] 03a2eb861 - Bump extensions/RatePage from `1182c92` to `a9d6b32` [00:57:02] [02mediawiki] 07dependabot[bot] opened pull request 03#4566: Bump extensions/RatePage from `1182c92` to `a9d6b32` - 13https://git.io/JDWbT [00:57:04] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/RatePage-a9d6b32 - 13https://git.io/vbL5b [00:57:05] [02mediawiki] 07github-actions[bot] labeled pull request 03#4562: Bump extensions/ProtectSite from `80119f0` to `6e5558f` - 13https://git.io/JDWFd [00:57:07] [02mediawiki] 07github-actions[bot] labeled pull request 03#4560: Bump extensions/Translate from `d275ed1` to `0babb26` - 13https://git.io/JDWF1 [00:57:08] [02mediawiki] 07github-actions[bot] labeled pull request 03#4563: Bump skins/Cosmos from `244d95a` to `1ad1915` - 13https://git.io/JDWFN [00:57:10] [02mediawiki] 07github-actions[bot] labeled pull request 03#4564: Bump skins/Evelution from `435441d` to `2cc6564` - 13https://git.io/JDWFp [00:57:11] [02mediawiki] 07github-actions[bot] labeled pull request 03#4565: Bump skins/Femiwiki from `d7b9cfd` to `be075c6` - 13https://git.io/JDWbJ [00:57:13] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/PageSchemas-af3aa88 [+0/-0/±1] 13https://git.io/JDWbI [00:57:14] [02miraheze/mediawiki] 07dependabot[bot] 0377841a2 - Bump extensions/PageSchemas from `8cf8155` to `af3aa88` [00:57:16] [02mediawiki] 07dependabot[bot] opened pull request 03#4567: Bump extensions/PageSchemas from `8cf8155` to `af3aa88` - 13https://git.io/JDWbL [00:57:17] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/PageSchemas-af3aa88 - 13https://git.io/vbL5b [00:57:19] [02mediawiki] 07github-actions[bot] labeled pull request 03#4566: Bump extensions/RatePage from `1182c92` to `a9d6b32` - 13https://git.io/JDWbT [00:57:20] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/PageForms-5a376c5 [+0/-0/±1] 13https://git.io/JDWbm [00:57:22] [02miraheze/mediawiki] 07dependabot[bot] 038d4327c - Bump extensions/PageForms from `cc9850d` to `5a376c5` [00:57:23] [02mediawiki] 07dependabot[bot] opened pull request 03#4568: Bump extensions/PageForms from `cc9850d` to `5a376c5` - 13https://git.io/JDWbO [00:57:25] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/PageForms-5a376c5 - 13https://git.io/vbL5b [00:57:35] [02mediawiki] 07github-actions[bot] labeled pull request 03#4567: Bump extensions/PageSchemas from `8cf8155` to `af3aa88` - 13https://git.io/JDWbL [00:57:42] [02mediawiki] 07github-actions[bot] labeled pull request 03#4568: Bump extensions/PageForms from `cc9850d` to `5a376c5` - 13https://git.io/JDWbO [00:57:44] [02mediawiki] 07github-actions[bot] labeled pull request 03#4568: Bump extensions/PageForms from `cc9850d` to `5a376c5` - 13https://git.io/JDWbO [00:57:45] [02mediawiki] 07github-actions[bot] labeled pull request 03#4568: Bump extensions/PageForms from `cc9850d` to `5a376c5` - 13https://git.io/JDWbO [00:57:50] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.29, 7.17, 7.21 [00:59:49] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.30, 6.36, 6.91 [01:00:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.77, 3.85, 3.76 [01:01:47] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.24, 5.62, 6.57 [01:03:48] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.99, 5.23, 6.53 [01:06:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.93, 2.84, 3.36 [01:12:01] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 2.63, 3.79, 5.68 [01:13:22] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.01, 18.51, 23.78 [01:19:22] PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.39, 20.22, 22.54 [01:20:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.23, 3.60, 3.42 [01:21:22] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 15.70, 18.56, 21.67 [01:22:01] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.07, 3.40, 4.72 [01:23:22] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 10.92, 15.89, 20.32 [01:26:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.50, 3.51, 3.49 [01:26:49] [02mediawiki] 07Universal-Omega closed pull request 03#4557: Labeler: add more file types to existing + add `schema-change` - 13https://git.io/JDnJn [01:26:50] [02mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 - 13https://git.io/vbL5b [01:26:52] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03Universal-Omega-patch-1 [01:26:53] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDleq [01:26:55] [02miraheze/mediawiki] 07Universal-Omega 03f864e13 - Labeler: add more file types to existing + add `schema-change` (#4557) [01:27:15] [02mediawiki] 07Universal-Omega closed pull request 03#4559: Bump extensions/Cargo from `5decb5b` to `d100b8c` - 13https://git.io/JDWFK [01:27:17] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDles [01:27:18] [02miraheze/mediawiki] 07dependabot[bot] 03f128fef - Bump extensions/Cargo from `5decb5b` to `d100b8c` (#4559) [01:27:20] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/Cargo-d100b8c - 13https://git.io/vbL5b [01:27:21] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/Cargo-d100b8c [01:27:25] [02mediawiki] 07Universal-Omega closed pull request 03#4560: Bump extensions/Translate from `d275ed1` to `0babb26` - 13https://git.io/JDWF1 [01:27:27] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/Translate-0babb26 - 13https://git.io/vbL5b [01:27:28] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDleW [01:27:30] [02miraheze/mediawiki] 07dependabot[bot] 0386aaacf - Bump extensions/Translate from `d275ed1` to `0babb26` (#4560) [01:27:31] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/Translate-0babb26 [01:27:59] [02mediawiki] 07Universal-Omega closed pull request 03#4561: Bump extensions/UniversalLanguageSelector from `0cf64b5` to `357e68b` - 13https://git.io/JDWF9 [01:28:01] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-357e68b - 13https://git.io/vbL5b [01:28:02] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-357e68b [01:28:04] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDleE [01:28:05] [02miraheze/mediawiki] 07dependabot[bot] 03db5cad9 - Bump extensions/UniversalLanguageSelector from `0cf64b5` to `357e68b` (#4561) [01:28:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.21, 3.15, 3.37 [01:28:16] [02mediawiki] 07Universal-Omega closed pull request 03#4567: Bump extensions/PageSchemas from `8cf8155` to `af3aa88` - 13https://git.io/JDWbL [01:28:18] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/PageSchemas-af3aa88 - 13https://git.io/vbL5b [01:28:19] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/PageSchemas-af3aa88 [01:28:21] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDleK [01:28:22] [02miraheze/mediawiki] 07dependabot[bot] 03467144d - Bump extensions/PageSchemas from `8cf8155` to `af3aa88` (#4567) [01:29:16] [02mediawiki] 07Universal-Omega closed pull request 03#4568: Bump extensions/PageForms from `cc9850d` to `5a376c5` - 13https://git.io/JDWbO [01:29:17] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDle9 [01:29:19] [02miraheze/mediawiki] 07dependabot[bot] 03ffba099 - Bump extensions/PageForms from `cc9850d` to `5a376c5` (#4568) [01:29:20] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/PageForms-5a376c5 - 13https://git.io/vbL5b [01:29:22] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/PageForms-5a376c5 [01:30:36] [02mediawiki] 07Universal-Omega closed pull request 03#4566: Bump extensions/RatePage from `1182c92` to `a9d6b32` - 13https://git.io/JDWbT [01:30:37] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/RatePage-a9d6b32 - 13https://git.io/vbL5b [01:30:39] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDlvL [01:30:40] [02miraheze/mediawiki] 07dependabot[bot] 03fe1c974 - Bump extensions/RatePage from `1182c92` to `a9d6b32` (#4566) [01:30:42] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/RatePage-a9d6b32 [01:30:59] [02mediawiki] 07Universal-Omega closed pull request 03#4562: Bump extensions/ProtectSite from `80119f0` to `6e5558f` - 13https://git.io/JDWFd [01:31:01] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDlv3 [01:31:02] [02miraheze/mediawiki] 07dependabot[bot] 0321d3c63 - Bump extensions/ProtectSite from `80119f0` to `6e5558f` (#4562) [01:31:04] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/ProtectSite-6e5558f - 13https://git.io/vbL5b [01:31:05] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/extensions/ProtectSite-6e5558f [01:31:34] [02mediawiki] 07Universal-Omega closed pull request 03#4565: Bump skins/Femiwiki from `d7b9cfd` to `be075c6` - 13https://git.io/JDWbJ [01:31:36] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDlvR [01:31:37] [02miraheze/mediawiki] 07dependabot[bot] 0366f4ba8 - Bump skins/Femiwiki from `d7b9cfd` to `be075c6` (#4565) [01:31:39] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/Femiwiki-be075c6 [01:31:40] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/Femiwiki-be075c6 - 13https://git.io/vbL5b [01:32:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.72, 4.08, 3.72 [01:32:11] [02mediawiki] 07Universal-Omega closed pull request 03#4564: Bump skins/Evelution from `435441d` to `2cc6564` - 13https://git.io/JDWFp [01:32:13] [02mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/Evelution-2cc6564 - 13https://git.io/vbL5b [01:32:14] [02miraheze/mediawiki] 07Universal-Omega deleted branch 03dependabot/submodules/REL1_37/skins/Evelution-2cc6564 [01:32:16] [02miraheze/mediawiki] 07Universal-Omega pushed 031 commit to 03REL1_37 [+0/-0/±1] 13https://git.io/JDlvi [01:32:17] [02miraheze/mediawiki] 07dependabot[bot] 0310acb90 - Bump skins/Evelution from `435441d` to `2cc6564` (#4564) [01:36:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.60, 3.90, 3.74 [01:40:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.19, 3.73, 3.69 [01:42:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.13, 3.64, 3.67 [01:52:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.45, 3.93, 3.78 [01:54:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.47, 3.80, 3.76 [02:00:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.88, 4.04, 3.82 [02:14:51] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.73, 6.44, 4.22 [02:15:22] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.61, 20.74, 17.82 [02:15:48] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.93, 6.85, 6.06 [02:16:00] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.33, 6.83, 5.76 [02:16:46] PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 4.41, 5.72, 4.22 [02:17:22] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.42, 18.35, 17.32 [02:17:48] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.55, 6.77, 6.16 [02:17:58] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.66, 5.87, 5.54 [02:18:41] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 3.15, 4.58, 3.96 [02:22:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.54, 3.63, 3.96 [02:24:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 3.64, 3.87, 4.02 [02:26:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.52, 3.68, 3.95 [02:40:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.34, 3.11, 3.40 [02:44:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.93, 3.29, 3.43 [02:45:40] CosmicAlpha: are you done with the `handle-pii` user right on the `sysadmin` global group? [02:45:53] i.e., have you finished fixing that extension? [02:48:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.85, 3.10, 3.33 [02:59:39] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.53, 3.49, 3.40 [03:01:33] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.08, 3.32, 3.34 [03:04:19] dmehus: removed [03:04:45] CosmicAlpha: seen and ty :) [03:05:21] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.66, 3.66, 3.50 [03:05:23] dmehus: no problem. Sorry for leaving those there. I forgot to remove when we were done with the 1.37 upgrade testing. [03:06:08] CosmicAlpha: yeah I figured it was forgotten about, then it came in useful for that Phabricator task I raised related to MW 1.37 testing / compatibility [03:07:35] dmehus: yep, I remembered I just left them there when the extension was initially done as I forgot, then with the 1.37 testing, I meant to remove after but forgot. So yeah we've always has the right since I released the extension, since I forgot about it till 1.37, then it was needed again. Next time if it's needed I'll be sure to remove it again. [03:09:09] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.19, 3.26, 3.36 [03:10:12] dmehus Could you check #cvt? [03:12:56] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.72, 3.74, 3.56 [03:16:44] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.26, 3.74, 3.59 [03:18:38] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.59, 3.64, 3.57 [03:20:32] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.27, 3.90, 3.67 [03:21:44] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 1.69, 2.72, 1.81 [03:24:20] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.80, 3.77, 3.72 [03:26:15] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.34, 3.98, 3.80 [03:27:44] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 0.89, 1.60, 1.61 [03:28:08] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.01, 3.63, 3.70 [03:30:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.41, 3.80, 3.74 [03:32:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.47, 3.73, 3.72 [03:42:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.37, 3.65, 3.58 [03:46:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.62, 3.88, 3.72 [03:48:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.60, 3.85, 3.71 [03:50:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.08, 3.47, 3.58 [03:52:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.96, 4.55, 3.97 [03:58:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.09, 3.70, 3.79 [04:02:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.22, 3.77, 3.79 [04:06:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.31, 3.34, 3.62 [04:10:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.87, 2.93, 3.38 [04:34:31] PROBLEM - mw11 APT on mw11 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [04:35:01] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 18.83, 12.56, 7.91 [04:35:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:36:33] RECOVERY - mw11 APT on mw11 is OK: APT OK: 0 packages available for upgrade (0 critical updates). [04:36:51] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.18, 5.93, 4.85 [04:40:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:40:51] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.58, 6.23, 5.26 [04:51:51] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.89, 7.08, 6.08 [04:52:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.91, 4.18, 3.54 [04:53:46] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.91, 6.67, 6.03 [04:54:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.56, 3.78, 3.46 [04:55:40] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.44, 5.89, 5.83 [04:56:51] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 4.96, 6.72, 7.86 [05:04:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.60, 3.21, 3.39 [05:04:48] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.54, 5.25, 6.67 [05:07:39] PROBLEM - lcn.zfc.id.lv - reverse DNS on sslhost is WARNING: rDNS WARNING - reverse DNS entry for lcn.zfc.id.lv could not be found [05:08:52] PROBLEM - wiki.jeremyboyd.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'wiki.jeremyboyd.org' expires in 7 day(s) (Tue 21 Dec 2021 05:07:51 GMT +0000). [05:10:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.61, 3.59, 3.43 [05:12:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.34, 3.19, 3.31 [05:12:10] PROBLEM - fanon.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'fanon.polandballwiki.com' expires in 7 day(s) (Tue 21 Dec 2021 05:09:59 GMT +0000). [05:15:44] PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 10.07, 6.93, 6.54 [05:16:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.64, 3.49 [05:17:43] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.72, 7.77, 6.94 [05:18:08] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 7.07, 5.47, 4.89 [05:19:42] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.36, 6.59, 6.62 [05:19:55] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.88, 6.91, 5.21 [05:20:08] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 4.60, 5.07, 4.81 [05:21:54] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.42, 6.43, 5.26 [05:23:45] dmehus: not around to run the script, but https://phabricator.miraheze.org/T8432#170409 might be the cause for that. [05:23:46] [url] ⚓ T8432 Run FixStuckGlobalRename.php for Galaxy Star / IronclawFan | phabricator.miraheze.org [05:24:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.26, 3.21, 3.36 [05:28:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.70, 3.92, 3.61 [05:30:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.51, 3.41, 3.46 [05:42:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.40, 2.98, 3.29 [05:49:35] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.14, 6.15, 5.20 [05:49:39] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.82, 6.60, 5.73 [05:50:02] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.92, 6.74, 5.52 [05:50:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.53, 3.67, 3.34 [05:51:31] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.93, 6.01, 5.08 [05:52:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.80, 3.86, 3.46 [05:52:08] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 6.82, 6.54, 5.34 [05:53:31] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.73, 5.36, 4.95 [05:53:32] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.33, 5.49, 5.15 [05:53:34] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 3.39, 5.42, 5.48 [05:53:50] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.15, 5.71, 5.39 [05:54:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.50, 3.38, 3.34 [05:54:08] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 4.16, 5.71, 5.18 [06:08:31] PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.59, 6.72, 4.49 [06:10:29] PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.80, 7.26, 4.97 [06:16:25] RECOVERY - db11 Current Load on db11 is OK: OK - load average: 6.65, 6.79, 5.48 [06:51:52] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.50, 8.67, 5.75 [06:53:51] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.12, 7.68, 5.73 [06:55:49] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.56, 6.31, 5.47 [07:09:29] PROBLEM - ref.undu.st - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:10:28] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JDlxD [07:10:30] [02miraheze/dns] 07Reception123 03df10401 - add thenintendowiki.org zone [07:11:33] [02miraheze/dns] 07Reception123 pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/JDlxA [07:11:35] [02miraheze/dns] 07Reception123 036a98222 - add smashbroswiki.com zone [07:15:12] PROBLEM - db12 APT on db12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds. [07:16:17] RECOVERY - ref.undu.st - LetsEncrypt on sslhost is OK: OK - Certificate 'ref.undu.st' will expire on Mon 14 Feb 2022 15:19:30 GMT +0000. [07:17:11] RECOVERY - db12 APT on db12 is OK: APT OK: 8 packages available for upgrade (0 critical updates). [07:25:28] PROBLEM - ref.undu.st - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [07:52:02] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.33, 3.26, 1.64 [07:58:02] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.59, 1.53, 1.37 [08:01:31] PROBLEM - ref.undu.st - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - ref.undu.st All nameservers failed to answer the query. [08:09:14] RECOVERY - ref.undu.st - reverse DNS on sslhost is OK: SSL OK - ref.undu.st reverse DNS resolves to cp21.miraheze.org - CNAME OK [08:09:43] !log sudo -u www-data php /srv/mediawiki/w/extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=pseudopediawiki --logwiki=metawiki Galaxy Star IronclawFan [08:09:45] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [08:13:49] RECOVERY - ref.undu.st - LetsEncrypt on sslhost is OK: OK - Certificate 'ref.undu.st' will expire on Mon 14 Feb 2022 15:19:30 GMT +0000. [08:37:39] morning, RhinosF1 [08:37:55] Reception123, ty for fixing that stuck global rename :) [08:38:21] Morning dmehus [08:38:24] dmehus: no problem, seems to be a weird side effect of the upgrade [08:38:33] Reception123, ah [08:38:41] Reception123: not Wierd [08:38:42] was it stuck before the upgrade I wonder? [08:38:44] RhinosF1: Paladox has just seen the OOM task so maybe we can figure something out today about that [08:38:52] We want read-only which made it happen. [08:38:57] yeah, just unusual timing [08:39:04] CosmicAlpha: s/Wierd/Weird [08:39:04] dmehus thinks CosmicAlpha meant to say: Reception123: not Weird [08:39:04] Yeah.... [08:39:12] Reception123: ok [08:39:23] I told you a potential solution [08:39:29] Which we can try later [08:39:31] dmehus: hey thanks, I was going to fix that and accidentally sent the message... [08:39:32] yeah [08:39:40] CosmicAlpha, np heh [08:40:10] .mhca Dmehus [08:40:10] https://meta.miraheze.org/wiki/Special:CentralAuth/Dmehus [08:46:35] dmehus: [08:46:38] See meta [08:52:47] RhinosF1, I don't think this warrants SRE action, but looking [08:58:22] dmehus: that's volunteer me [09:31:24] RhinosF1, ack, but see PM/e-mail [09:31:34] Yes [09:31:38] Lesson now [09:32:00] And based on the silence from my friend not a fun one [10:02:53] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JD80P [10:02:55] [02miraheze/ErrorPages] 07Universal-Omega 030dd79f4 - Update getTranslations.php [10:02:56] [02ErrorPages] 07Universal-Omega synchronize pull request 03#2: T8005: Add localisation to error pages - 13https://git.io/JuBC7 [10:04:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.09, 1.85, 1.02 [10:04:41] [02miraheze/ErrorPages] 07Universal-Omega pushed 031 commit to 03Universal-Omega-patch-1 [+0/-0/±1] 13https://git.io/JD80j [10:04:43] [02miraheze/ErrorPages] 07Universal-Omega 03f566843 - Update en.json [10:04:44] [02ErrorPages] 07Universal-Omega synchronize pull request 03#2: T8005: Add localisation to error pages - 13https://git.io/JuBC7 [10:06:28] PROBLEM - cp30 Current Load on cp30 is CRITICAL: CRITICAL - load average: 2.40, 2.74, 1.49 [10:08:28] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 0.59, 1.91, 1.33 [10:10:28] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.51, 1.39, 1.20 [10:52:08] PROBLEM - mw13 Current Load on mw13 is WARNING: WARNING - load average: 5.96, 7.04, 4.77 [10:54:01] PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 7.90, 4.71, 2.82 [10:54:08] RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 3.06, 5.52, 4.48 [10:56:01] RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 4.99, 4.45, 2.94 [12:08:55] [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/JD892 [12:08:56] [02miraheze/MirahezeMagic] 07translatewiki 03be3fe2d - Localisation updates from https://translatewiki.net. [12:08:57] [url] Main page - translatewiki.net | translatewiki.net [12:16:28] miraheze/MirahezeMagic - translatewiki the build passed. [12:18:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.82, 3.13, 2.54 [12:20:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.74, 3.01, 2.57 [13:36:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.42, 3.07, 2.68 [13:38:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.98, 2.76, 2.62 [13:50:42] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.74, 3.16, 2.88 [13:54:30] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.10, 3.69, 3.16 [13:58:18] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.26, 3.54, 3.21 [14:04:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.17, 2.99, 3.09 [15:16:02] Home [15:20:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 7.24, 4.35, 3.28 [15:28:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.75, 3.98, 3.56 [15:34:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.34, 3.10, 3.31 [15:46:42] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.28, 3.75, 3.37 [15:48:36] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.59, 3.40, 3.29 [15:51:31] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.76, 6.74, 5.01 [15:51:39] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 7.56, 8.05, 6.08 [15:51:48] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.51, 8.10, 5.93 [15:51:57] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.77, 7.72, 5.80 [15:52:14] PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.73, 20.42, 16.96 [15:52:24] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.57, 3.62, 3.40 [15:53:31] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 6.57, 6.17, 4.99 [15:53:36] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.88, 6.78, 5.85 [15:53:48] RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.07, 6.78, 5.70 [15:53:56] RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.13, 6.65, 5.63 [15:54:12] RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 16.36, 18.49, 16.64 [15:54:18] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.72, 4.07, 3.59 [15:56:12] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.98, 3.75, 3.54 [15:58:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.16, 4.14, 3.69 [16:04:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.43, 3.80, 3.72 [16:06:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.23, 3.78, 3.71 [16:08:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.95, 3.51, 3.63 [16:14:06] RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.16, 3.01, 3.40 [16:19:48] PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.70, 6.73, 5.68 [16:21:31] PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 10.52, 7.42, 5.76 [16:21:37] PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 11.31, 9.06, 6.54 [16:22:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.10, 4.36, 3.86 [16:23:30] PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.42, 7.04, 5.83 [16:23:52] PROBLEM - mw8 Current Load on mw8 is CRITICAL: CRITICAL - load average: 9.44, 7.55, 6.09 [16:24:06] PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.25, 3.88, 3.74 [16:25:31] RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.58, 6.78, 5.90 [16:25:34] PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.75, 7.85, 6.61 [16:26:23] PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 7.38, 7.65, 6.20 [16:27:47] PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.91, 7.29, 6.33 [16:28:06] PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.46, 4.43, 3.98 [16:29:45] RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 6.12, 6.73, 6.23 [16:29:48] PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.51, 7.44, 6.79 [16:30:23] RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.33, 6.06, 5.89 [16:31:30]