[00:02:55] <icinga-miraheze>	 PROBLEM - graylog2 Puppet on graylog2 is CRITICAL: CRITICAL: Failed to apply catalog, zero resources tracked by Puppet. It might be a dependency cycle.
[00:03:24] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 39.79, 27.76, 21.42
[00:03:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.59, 4.00, 3.56
[00:03:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 11.40, 7.88, 5.27
[00:04:16] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:05:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.11, 3.65, 3.49
[00:05:35] <Not-616a>	 [02mw-config] 07Reno-Rex opened pull request 03#4221: hypotheticalhurricaneswiki protection levels - 13https://git.io/J1T06
[00:06:25] <icinga-miraheze>	 RECOVERY - bacula2 Bacula Databases db12 on bacula2 is OK: OK: Full, 70416 files, 28.15GB, 2021-11-07 00:36:00 (1.1 weeks ago)
[00:07:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.01, 3.76, 3.54
[00:09:12] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4039: Bump extensions/cldr from `6b64c58` to `937150a` - 13https://git.io/J1TEu
[00:09:14] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/cldr-937150a [+0/-0/±1] 13https://git.io/J1TEz
[00:09:15] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 031464418 - Bump extensions/cldr from `6b64c58` to `937150a`
[00:09:17] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4039: Bump extensions/cldr from `6b64c58` to `937150a` - 13https://git.io/J1TEu
[00:09:18] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/cldr-937150a - 13https://git.io/vbL5b
[00:09:20] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4039: Bump extensions/cldr from `6b64c58` to `937150a` - 13https://git.io/J1TEu
[00:09:21] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/Video-925c30d [+0/-0/±1] 13https://git.io/J1TEg
[00:09:23] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 030fc9d2a - Bump extensions/Video from `c944e45` to `925c30d`
[00:09:24] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4040: Bump extensions/Video from `c944e45` to `925c30d` - 13https://git.io/J1TE2
[00:09:26] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4040: Bump extensions/Video from `c944e45` to `925c30d` - 13https://git.io/J1TE2
[00:09:27] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/Video-925c30d - 13https://git.io/vbL5b
[00:09:29] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4040: Bump extensions/Video from `c944e45` to `925c30d` - 13https://git.io/J1TE2
[00:09:30] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3984: Bump extensions/Video from `c944e45` to `afa6b40` - 13https://git.io/J1TEV
[00:09:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.74, 3.49, 3.47
[00:09:32] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/QuizGame-de84fef [+0/-0/±1] 13https://git.io/J1TEw
[00:09:33] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03b989e06 - Bump extensions/QuizGame from `a7d93db` to `de84fef`
[00:09:35] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3984: Bump extensions/Video from `c944e45` to `afa6b40` - 13https://git.io/JXBUy
[00:09:36] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/Video-afa6b40
[00:09:38] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/Video-afa6b40 - 13https://git.io/vbL5b
[00:09:39] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4041: Bump extensions/QuizGame from `a7d93db` to `de84fef` - 13https://git.io/J1TEr
[00:09:41] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4041: Bump extensions/QuizGame from `a7d93db` to `de84fef` - 13https://git.io/J1TEr
[00:09:42] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/QuizGame-de84fef - 13https://git.io/vbL5b
[00:09:44] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4041: Bump extensions/QuizGame from `a7d93db` to `de84fef` - 13https://git.io/J1TEr
[00:09:45] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3980: Bump extensions/QuizGame from `a7d93db` to `322074b` - 13https://git.io/J1TEo
[00:09:47] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3980: Bump extensions/QuizGame from `a7d93db` to `322074b` - 13https://git.io/JXBUz
[00:09:47] <MacFan4000>	 Great here we go with lots of dependabot prs
[00:09:48] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/QuizGame-322074b
[00:09:50] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/QuizGame-322074b - 13https://git.io/vbL5b
[00:09:51] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/vendor-e1251ff [+0/-0/±1] 13https://git.io/J1TEK
[00:09:53] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03e754959 - Bump vendor from `8740687` to `e1251ff`
[00:09:54] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/vendor-e1251ff - 13https://git.io/vbL5b
[00:09:56] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4042: Bump vendor from `8740687` to `e1251ff` - 13https://git.io/J1TE6
[00:09:57] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4042: Bump vendor from `8740687` to `e1251ff` - 13https://git.io/J1TE6
[00:09:59] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4042: Bump vendor from `8740687` to `e1251ff` - 13https://git.io/J1TE6
[00:10:00] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/skins/Cosmos-0bc80c2 [+0/-0/±1] 13https://git.io/J1TEX
[00:10:02] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03e2f190e - Bump skins/Cosmos from `1451631` to `0bc80c2`
[00:10:03] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[00:10:03] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4043: Bump skins/Cosmos from `1451631` to `0bc80c2` - 13https://git.io/J1TE1
[00:10:05] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4043: Bump skins/Cosmos from `1451631` to `0bc80c2` - 13https://git.io/J1TE1
[00:10:06] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4043: Bump skins/Cosmos from `1451631` to `0bc80c2` - 13https://git.io/J1TE1
[00:10:08] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/skins/Cosmos-0bc80c2 - 13https://git.io/vbL5b
[00:10:09] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/Cargo-5242754 [+0/-0/±1] 13https://git.io/J1TED
[00:10:11] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03a3513bc - Bump extensions/Cargo from `19b7b42` to `5242754`
[00:10:12] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/Cargo-5242754 - 13https://git.io/vbL5b
[00:10:14] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4044: Bump extensions/Cargo from `19b7b42` to `5242754` - 13https://git.io/J1TES
[00:10:15] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4044: Bump extensions/Cargo from `19b7b42` to `5242754` - 13https://git.io/J1TES
[00:10:17] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3976: Bump extensions/Cargo from `19b7b42` to `b68e912` - 13https://git.io/J1TEH
[00:10:18] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3976: Bump extensions/Cargo from `19b7b42` to `b68e912` - 13https://git.io/JXBUm
[00:10:20] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/skins/chameleon-3b98859 [+0/-0/±1] 13https://git.io/J1TEQ
[00:10:21] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03cdeabc9 - Bump skins/chameleon from `57519ff` to `3b98859`
[00:10:23] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/Cargo-b68e912
[00:10:24] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/skins/chameleon-3b98859 - 13https://git.io/vbL5b
[00:10:26] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4045: Bump skins/chameleon from `57519ff` to `3b98859` - 13https://git.io/J1TE7
[00:10:27] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4045: Bump skins/chameleon from `57519ff` to `3b98859` - 13https://git.io/J1TE7
[00:10:29] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3996: Bump skins/chameleon from `57519ff` to `fbf0e91` - 13https://git.io/J1TE5
[00:10:30] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4044: Bump extensions/Cargo from `19b7b42` to `5242754` - 13https://git.io/J1TES
[00:10:32] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3996: Bump skins/chameleon from `57519ff` to `fbf0e91` - 13https://git.io/JXBTg
[00:10:33] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/CreateWiki-65ad601 [+0/-0/±1] 13https://git.io/J1TEd
[00:10:35] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 031c3d61d - Bump extensions/CreateWiki from `cc781d3` to `65ad601`
[00:10:36] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4046: Bump extensions/CreateWiki from `cc781d3` to `65ad601` - 13https://git.io/J1TEF
[00:10:38] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/skins/chameleon-fbf0e91 - 13https://git.io/vbL5b
[00:10:39] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/skins/chameleon-fbf0e91
[00:10:41] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/CreateWiki-65ad601 - 13https://git.io/vbL5b
[00:10:42] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/ManageWiki-ac06808 [+0/-0/±1] 13https://git.io/J1TEb
[00:10:44] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03fb8f7c2 - Bump extensions/ManageWiki from `d5a1daa` to `ac06808`
[00:10:45] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/ManageWiki-ac06808 - 13https://git.io/vbL5b
[00:10:47] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4047: Bump extensions/ManageWiki from `d5a1daa` to `ac06808` - 13https://git.io/J1TEN
[00:10:48] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4047: Bump extensions/ManageWiki from `d5a1daa` to `ac06808` - 13https://git.io/J1TEN
[00:10:50] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/Cargo-b68e912 - 13https://git.io/vbL5b
[00:10:51] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4045: Bump skins/chameleon from `57519ff` to `3b98859` - 13https://git.io/J1TE7
[00:10:53] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/MintyDocs-35f295c [+0/-0/±1] 13https://git.io/J1TEx
[00:10:54] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 0344bb2b7 - Bump extensions/MintyDocs from `b923810` to `35f295c`
[00:10:56] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4048: Bump extensions/MintyDocs from `b923810` to `35f295c` - 13https://git.io/J1TEp
[00:10:57] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4046: Bump extensions/CreateWiki from `cc781d3` to `65ad601` - 13https://git.io/J1TEF
[00:10:59] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4046: Bump extensions/CreateWiki from `cc781d3` to `65ad601` - 13https://git.io/J1TEF
[00:11:00] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4048: Bump extensions/MintyDocs from `b923810` to `35f295c` - 13https://git.io/J1TEp
[00:11:02] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/MintyDocs-35f295c - 13https://git.io/vbL5b
[00:11:03] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4048: Bump extensions/MintyDocs from `b923810` to `35f295c` - 13https://git.io/J1TEp
[00:11:05] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/BlogPage-ba10f30 [+0/-0/±1] 13https://git.io/J1TEh
[00:11:06] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 030e773e1 - Bump extensions/BlogPage from `489efaa` to `ba10f30`
[00:11:08] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4047: Bump extensions/ManageWiki from `d5a1daa` to `ac06808` - 13https://git.io/J1TEN
[00:11:09] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/BlogPage-ba10f30 - 13https://git.io/vbL5b
[00:11:11] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4049: Bump extensions/BlogPage from `489efaa` to `ba10f30` - 13https://git.io/J1TEj
[00:11:12] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4049: Bump extensions/BlogPage from `489efaa` to `ba10f30` - 13https://git.io/J1TEj
[00:11:14] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4049: Bump extensions/BlogPage from `489efaa` to `ba10f30` - 13https://git.io/J1TEj
[00:11:15] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/Mermaid-077ca5e [+0/-0/±1] 13https://git.io/J1TuJ
[00:11:17] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 039964b31 - Bump extensions/Mermaid from `92df98c` to `077ca5e`
[00:11:18] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/Mermaid-077ca5e - 13https://git.io/vbL5b
[00:11:20] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4050: Bump extensions/Mermaid from `92df98c` to `077ca5e` - 13https://git.io/J1TuT
[00:11:21] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4050: Bump extensions/Mermaid from `92df98c` to `077ca5e` - 13https://git.io/J1TuT
[00:11:23] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4050: Bump extensions/Mermaid from `92df98c` to `077ca5e` - 13https://git.io/J1TuT
[00:11:24] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/skins/Evelution-8075080 [+0/-0/±1] 13https://git.io/J1TuI
[00:11:26] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03bb2ff52 - Bump skins/Evelution from `2a9e7ca` to `8075080`
[00:11:27] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/skins/Evelution-8075080 - 13https://git.io/vbL5b
[00:11:29] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4051: Bump skins/Evelution from `2a9e7ca` to `8075080` - 13https://git.io/J1TuL
[00:11:30] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4051: Bump skins/Evelution from `2a9e7ca` to `8075080` - 13https://git.io/J1TuL
[00:11:32] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4051: Bump skins/Evelution from `2a9e7ca` to `8075080` - 13https://git.io/J1TuL
[00:11:33] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3989: Bump skins/Evelution from `2a9e7ca` to `2d2bba5` - 13https://git.io/J1Tut
[00:11:35] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/UniversalLanguageSelector-ea14d38 [+0/-0/±1] 13https://git.io/J1Tuq
[00:11:36] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03a2520f7 - Bump extensions/UniversalLanguageSelector from `b5ec74d` to `ea14d38`
[00:11:38] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4052: Bump extensions/UniversalLanguageSelector from `b5ec74d` to `ea14d38` - 13https://git.io/J1Tum
[00:11:39] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/UniversalLanguageSelector-ea14d38 - 13https://git.io/vbL5b
[00:11:41] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3989: Bump skins/Evelution from `2a9e7ca` to `2d2bba5` - 13https://git.io/JXBTf
[00:11:42] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4052: Bump extensions/UniversalLanguageSelector from `b5ec74d` to `ea14d38` - 13https://git.io/J1Tum
[00:11:44] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/skins/Evelution-2d2bba5
[00:11:45] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/skins/Evelution-2d2bba5 - 13https://git.io/vbL5b
[00:11:46] <miraheze-github>	 miraheze/mw-config - Universal-Omega the build passed.
[00:11:47] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4052: Bump extensions/UniversalLanguageSelector from `b5ec74d` to `ea14d38` - 13https://git.io/J1Tum
[00:11:48] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3985: Bump extensions/UniversalLanguageSelector from `b5ec74d` to `f0c6bec` - 13https://git.io/J1TuO
[00:11:50] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3985: Bump extensions/UniversalLanguageSelector from `b5ec74d` to `f0c6bec` - 13https://git.io/JXBU9
[00:11:51] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-4071a2a [+0/-0/±1] 13https://git.io/J1Tu3
[00:11:53] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 038391514 - Bump extensions/MirahezeMagic from `14e3cff` to `4071a2a`
[00:11:54] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/UniversalLanguageSelector-f0c6bec - 13https://git.io/vbL5b
[00:11:56] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4053: Bump extensions/MirahezeMagic from `14e3cff` to `4071a2a` - 13https://git.io/J1Tus
[00:11:57] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/UniversalLanguageSelector-f0c6bec
[00:11:59] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/MirahezeMagic-4071a2a - 13https://git.io/vbL5b
[00:12:00] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4053: Bump extensions/MirahezeMagic from `14e3cff` to `4071a2a` - 13https://git.io/J1Tus
[00:12:02] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4053: Bump extensions/MirahezeMagic from `14e3cff` to `4071a2a` - 13https://git.io/J1Tus
[00:12:02] * dmehus suspects CosmicAlpha is going to start merging these in ~20 minutes :P
[00:12:03] <Not-616a>	 [02mw-config] 07Universal-Omega closed pull request 03#4221: hypotheticalhurricaneswiki protection levels - 13https://git.io/J1T06
[00:12:05] <Not-616a>	 [02miraheze/mw-config] 07Universal-Omega pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1TuG
[00:12:06] <Not-616a>	 [02miraheze/mw-config] 07Reno-Rex 03b70d4e9 - hypotheticalhurricaneswiki protection levels (#4221)
[00:12:07] <MirahezeLSBot>	 !log [@mw11] starting deploy of {'config': True} to all
[00:12:08] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4054: Bump extensions/WikiDiscover from `c3d5a06` to `94bc79b` - 13https://git.io/J1TuZ
[00:12:09] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/WikiDiscover-94bc79b [+0/-0/±1] 13https://git.io/J1Tun
[00:12:11] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 0323af5c4 - Bump extensions/WikiDiscover from `c3d5a06` to `94bc79b`
[00:12:12] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:12:12] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4054: Bump extensions/WikiDiscover from `c3d5a06` to `94bc79b` - 13https://git.io/J1TuZ
[00:12:14] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4054: Bump extensions/WikiDiscover from `c3d5a06` to `94bc79b` - 13https://git.io/J1TuZ
[00:12:15] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/WikiDiscover-94bc79b - 13https://git.io/vbL5b
[00:12:17] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3933: Bump extensions/WikiDiscover from `c3d5a06` to `78dd569` - 13https://git.io/J1TuW
[00:12:18] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/WikiDiscover-78dd569 - 13https://git.io/vbL5b
[00:12:19] <MirahezeLSBot>	 !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 11s
[00:12:20] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3933: Bump extensions/WikiDiscover from `c3d5a06` to `78dd569` - 13https://git.io/JPoZ8
[00:12:21] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/PageForms-cc58404 [+0/-0/±1] 13https://git.io/J1Tul
[00:12:22] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:12:23] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03469cafe - Bump extensions/PageForms from `fabcd30` to `cc58404`
[00:12:24] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/WikiDiscover-78dd569
[00:12:26] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4055: Bump extensions/PageForms from `fabcd30` to `cc58404` - 13https://git.io/J1Tu8
[00:12:27] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/PageForms-cc58404 - 13https://git.io/vbL5b
[00:12:29] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4055: Bump extensions/PageForms from `fabcd30` to `cc58404` - 13https://git.io/J1Tu8
[00:12:30] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4055: Bump extensions/PageForms from `fabcd30` to `cc58404` - 13https://git.io/J1Tu8
[00:12:32] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3978: Bump extensions/PageForms from `fabcd30` to `063f7ad` - 13https://git.io/J1Tu4
[00:12:33] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3978: Bump extensions/PageForms from `fabcd30` to `063f7ad` - 13https://git.io/JXBUn
[00:12:35] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/PageForms-063f7ad - 13https://git.io/vbL5b
[00:12:36] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/PageForms-063f7ad
[00:12:38] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/ProtectSite-e5f75aa [+0/-0/±1] 13https://git.io/J1Tu0
[00:12:39] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03e1fa7aa - Bump extensions/ProtectSite from `66d4127` to `e5f75aa`
[00:12:41] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4056: Bump extensions/ProtectSite from `66d4127` to `e5f75aa` - 13https://git.io/J1TuE
[00:12:42] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/ProtectSite-e5f75aa - 13https://git.io/vbL5b
[00:12:44] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4056: Bump extensions/ProtectSite from `66d4127` to `e5f75aa` - 13https://git.io/J1TuE
[00:12:45] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4056: Bump extensions/ProtectSite from `66d4127` to `e5f75aa` - 13https://git.io/J1TuE
[00:12:47] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3900: Bump extensions/ProtectSite from `66d4127` to `f240807` - 13https://git.io/J1Tu2
[00:12:48] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/AutoCreateCategoryPages-4a09a54 [+0/-0/±1] 13https://git.io/J1Tua
[00:12:50] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 030b7516e - Bump extensions/AutoCreateCategoryPages from `1208a92` to `4a09a54`
[00:12:51] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4057: Bump extensions/AutoCreateCategoryPages from `1208a92` to `4a09a54` - 13https://git.io/J1TuV
[00:12:53] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/AutoCreateCategoryPages-4a09a54 - 13https://git.io/vbL5b
[00:12:54] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3900: Bump extensions/ProtectSite from `66d4127` to `f240807` - 13https://git.io/JPoGT
[00:12:56] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4057: Bump extensions/AutoCreateCategoryPages from `1208a92` to `4a09a54` - 13https://git.io/J1TuV
[00:12:57] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/ProtectSite-f240807 - 13https://git.io/vbL5b
[00:12:59] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4057: Bump extensions/AutoCreateCategoryPages from `1208a92` to `4a09a54` - 13https://git.io/J1TuV
[00:13:00] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/ProtectSite-f240807
[00:13:02] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/skins/Femiwiki-3963cb5 [+0/-0/±1] 13https://git.io/J1Tuo
[00:13:03] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 036dee34c - Bump skins/Femiwiki from `07f3028` to `3963cb5`
[00:13:05] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4058: Bump skins/Femiwiki from `07f3028` to `3963cb5` - 13https://git.io/J1TuK
[00:13:06] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/skins/Femiwiki-3963cb5 - 13https://git.io/vbL5b
[00:13:08] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4058: Bump skins/Femiwiki from `07f3028` to `3963cb5` - 13https://git.io/J1TuK
[00:13:09] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4058: Bump skins/Femiwiki from `07f3028` to `3963cb5` - 13https://git.io/J1TuK
[00:13:11] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/WikibaseLocalMedia-82b7cf0 [+0/-0/±1] 13https://git.io/J1Tui
[00:13:12] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 036226a81 - Bump extensions/WikibaseLocalMedia from `18f8c90` to `82b7cf0`
[00:13:14] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4059: Bump extensions/WikibaseLocalMedia from `18f8c90` to `82b7cf0` - 13https://git.io/J1TuP
[00:13:15] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/WikibaseLocalMedia-82b7cf0 - 13https://git.io/vbL5b
[00:13:17] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4059: Bump extensions/WikibaseLocalMedia from `18f8c90` to `82b7cf0` - 13https://git.io/J1TuP
[00:13:18] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4059: Bump extensions/WikibaseLocalMedia from `18f8c90` to `82b7cf0` - 13https://git.io/J1TuP
[00:13:20] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/Translate-2704262 [+0/-0/±1] 13https://git.io/J1Tu1
[00:13:21] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 034c7e1e0 - Bump extensions/Translate from `ebc6560` to `2704262`
[00:13:23] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/Translate-2704262 - 13https://git.io/vbL5b
[00:13:24] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4060: Bump extensions/Translate from `ebc6560` to `2704262` - 13https://git.io/J1TuD
[00:13:26] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4060: Bump extensions/Translate from `ebc6560` to `2704262` - 13https://git.io/J1TuD
[00:13:27] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4060: Bump extensions/Translate from `ebc6560` to `2704262` - 13https://git.io/J1TuD
[00:13:29] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4061: Bump extensions/RemovePII from `aaa510c` to `c712717` - 13https://git.io/J1TuS
[00:13:30] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/RemovePII-c712717 [+0/-0/±1] 13https://git.io/J1Tu9
[00:13:32] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03dea08b3 - Bump extensions/RemovePII from `aaa510c` to `c712717`
[00:13:33] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/RemovePII-c712717 - 13https://git.io/vbL5b
[00:13:35] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4061: Bump extensions/RemovePII from `aaa510c` to `c712717` - 13https://git.io/J1TuS
[00:13:36] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4061: Bump extensions/RemovePII from `aaa510c` to `c712717` - 13https://git.io/J1TuS
[00:13:38] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3991: Bump extensions/Translate from `ebc6560` to `c4a7b24` - 13https://git.io/J1TuH
[00:13:39] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3991: Bump extensions/Translate from `ebc6560` to `c4a7b24` - 13https://git.io/JXBTI
[00:13:41] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/Moderation-916fa2d [+0/-0/±1] 13https://git.io/J1TuQ
[00:13:42] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03a2e3575 - Bump extensions/Moderation from `cbf109b` to `916fa2d`
[00:13:44] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/Translate-c4a7b24 - 13https://git.io/vbL5b
[00:13:45] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/Translate-c4a7b24
[00:13:47] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/Moderation-916fa2d - 13https://git.io/vbL5b
[00:13:48] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4062: Bump extensions/Moderation from `cbf109b` to `916fa2d` - 13https://git.io/J1Tu7
[00:13:50] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3904: Bump extensions/RemovePII from `aaa510c` to `b0dd543` - 13https://git.io/J1Tu5
[00:13:51] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4062: Bump extensions/Moderation from `cbf109b` to `916fa2d` - 13https://git.io/J1Tu7
[00:13:53] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3904: Bump extensions/RemovePII from `aaa510c` to `b0dd543` - 13https://git.io/JPoG3
[00:13:54] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4062: Bump extensions/Moderation from `cbf109b` to `916fa2d` - 13https://git.io/J1Tu7
[00:13:56] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/RemovePII-b0dd543 - 13https://git.io/vbL5b
[00:13:57] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/RemovePII-b0dd543
[00:13:59] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4002: Bump extensions/Moderation from `cbf109b` to `8d72b71` - 13https://git.io/J1Tud
[00:14:00] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4002: Bump extensions/Moderation from `cbf109b` to `8d72b71` - 13https://git.io/JXBT5
[00:14:02] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/Moderation-8d72b71
[00:14:03] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_36/extensions/Moderation-8d72b71 - 13https://git.io/vbL5b
[00:14:05] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/Maps-09499d5 [+0/-0/±1] 13https://git.io/J1TuA
[00:14:06] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 039f53b68 - Bump extensions/Maps from `b43865b` to `09499d5`
[00:14:08] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/Maps-09499d5 - 13https://git.io/vbL5b
[00:14:09] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4063: Bump extensions/Maps from `b43865b` to `09499d5` - 13https://git.io/J1Tux
[00:14:11] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4063: Bump extensions/Maps from `b43865b` to `09499d5` - 13https://git.io/J1Tux
[00:14:12] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4063: Bump extensions/Maps from `b43865b` to `09499d5` - 13https://git.io/J1Tux
[00:14:14] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_36/extensions/WikiForum-887c080 [+0/-0/±1] 13https://git.io/J1Tup
[00:14:15] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 034d273fe - Bump extensions/WikiForum from `7b08807` to `887c080`
[00:14:17] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4064: Bump extensions/WikiForum from `7b08807` to `887c080` - 13https://git.io/J1Tuh
[00:14:18] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_36/extensions/WikiForum-887c080 - 13https://git.io/vbL5b
[00:14:20] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4064: Bump extensions/WikiForum from `7b08807` to `887c080` - 13https://git.io/J1Tuh
[00:14:21] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4064: Bump extensions/WikiForum from `7b08807` to `887c080` - 13https://git.io/J1Tuh
[00:14:53] <MacFan4000>	 129 open prs
[00:15:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.19, 2.93, 3.25
[00:15:33] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is WARNING: WARNING: Full, 81266 files, 13.66GB, 2021-11-07 00:13:00 (1.1 weeks ago)
[00:16:43] <CosmicAlpha>	 MacFan4000: over 500 a little awhile ago.
[00:20:07] <dmehus>	 heh
[00:20:59] <icinga-miraheze>	 RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 78967 MB (11% inode=99%);
[00:21:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 6.37, 4.20, 3.62
[00:23:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.33, 3.35, 3.37
[00:24:49] <icinga-miraheze>	 PROBLEM - cp14 Stunnel Http for mw13 on cp14 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[00:24:54] <MirahezeLSBot>	 !log [@test3] starting deploy of {'config': True} to skip
[00:24:55] <MirahezeLSBot>	 !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 0s
[00:24:59] <icinga-miraheze>	 PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 75848 MB (10% inode=99%);
[00:25:02] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:25:06] <icinga-miraheze>	 PROBLEM - cp15 Stunnel Http for mw13 on cp15 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[00:25:06] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[00:25:14] <icinga-miraheze>	 PROBLEM - mw13 HTTPS on mw13 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[00:25:22] <icinga-miraheze>	 PROBLEM - mw13 MediaWiki Rendering on mw13 is CRITICAL: CRITICAL - Socket timeout after 10 seconds
[00:25:29] <icinga-miraheze>	 PROBLEM - cp13 Stunnel Http for mw13 on cp13 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[00:25:41] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:25:46] <icinga-miraheze>	 PROBLEM - cp12 Stunnel Http for mw13 on cp12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[00:26:05] <icinga-miraheze>	 PROBLEM - cp13 Varnish Backends on cp13 is CRITICAL: 1 backends are down. mw13
[00:26:21] <icinga-miraheze>	 PROBLEM - cp14 Varnish Backends on cp14 is CRITICAL: 1 backends are down. mw13
[00:26:26] <CosmicAlpha>	 Uh...
[00:26:38] <icinga-miraheze>	 PROBLEM - cp12 Varnish Backends on cp12 is CRITICAL: 1 backends are down. mw13
[00:26:42] <icinga-miraheze>	 PROBLEM - cp15 Varnish Backends on cp15 is CRITICAL: 1 backends are down. mw13
[00:26:49] <CosmicAlpha>	 mw13 went down...
[00:27:21] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Private Git on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:27:55] <dmehus>	 oh
[00:28:12] <dmehus>	 you can't restart mw12 can you, CosmicAlpha?
[00:28:18] <dmehus>	 s/mw12/mw13
[00:28:19] <MirahezeBot>	 dmehus meant to say: you can't restart mw13 can you, CosmicAlpha?
[00:28:46] <dmehus>	 !sre ^
[00:28:46] <CosmicAlpha>	 No but let me try something.
[00:28:51] <dmehus>	 okay
[00:29:06] <dmehus>	 running puppet?
[00:29:25] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Private Git on bacula2 is WARNING: WARNING: Full, 6467 files, 49.72MB, 2021-10-31 00:51:00 (2.1 weeks ago)
[00:30:06] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[00:32:54] <icinga-miraheze>	 RECOVERY - graylog2 Puppet on graylog2 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[00:33:33] <icinga-miraheze>	 PROBLEM - mw13 php-fpm on mw13 is CRITICAL: PROCS CRITICAL: 0 processes with command name 'php-fpm7.3'
[00:36:22] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Private Git on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:37:36] <icinga-miraheze>	 alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[00:38:25] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Private Git on bacula2 is WARNING: WARNING: Full, 6467 files, 49.72MB, 2021-10-31 00:51:00 (2.1 weeks ago)
[00:39:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.86, 3.33, 3.15
[00:39:34] <icinga-miraheze>	 RECOVERY - mw13 php-fpm on mw13 is OK: PROCS OK: 33 processes with command name 'php-fpm7.3'
[00:39:48] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:39:59] <CosmicAlpha>	 !log mw13: sudo service php7.3-fpm restart
[00:40:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[00:40:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.17, 7.22, 5.98
[00:41:12] <dmehus>	 did that work?
[00:41:55] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is WARNING: WARNING: Full, 70416 files, 28.15GB, 2021-11-07 00:36:00 (1.1 weeks ago)
[00:42:20] <CosmicAlpha>	 dmehus: I don't think so, still at 100% usage it seems.
[00:42:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.09, 6.83, 5.99
[00:44:25] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.78, 6.21, 5.87
[00:44:59] <icinga-miraheze>	 RECOVERY - graylog2 Disk Space on graylog2 is OK: DISK OK - free space: / 79609 MB (11% inode=99%);
[00:45:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.03, 3.62, 3.35
[00:46:25] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/vendor-65e1254 [+0/-0/±1] 13https://git.io/J1To3
[00:46:27] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03a230f98 - Bump vendor from `0551fb2` to `65e1254`
[00:46:28] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4065: Bump vendor from `0551fb2` to `65e1254` - 13https://git.io/J1Tos
[00:46:30] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/vendor-65e1254 - 13https://git.io/vbL5b
[00:46:31] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4065: Bump vendor from `0551fb2` to `65e1254` - 13https://git.io/J1Tos
[00:46:33] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4024: Bump vendor from `77ebd35` to `0551fb2` - 13https://git.io/J1ToZ
[00:46:34] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4024: Bump vendor from `77ebd35` to `0551fb2` - 13https://git.io/JXBcI
[00:46:36] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4066: Bump extensions/MirahezeMagic from `14e3cff` to `4071a2a` - 13https://git.io/J1Ton
[00:46:37] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/MirahezeMagic-4071a2a [+0/-0/±1] 13https://git.io/J1Toc
[00:46:39] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 034b8c262 - Bump extensions/MirahezeMagic from `14e3cff` to `4071a2a`
[00:46:40] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/vendor-0551fb2 - 13https://git.io/vbL5b
[00:46:42] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/MirahezeMagic-4071a2a - 13https://git.io/vbL5b
[00:46:43] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/vendor-0551fb2
[00:46:45] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4066: Bump extensions/MirahezeMagic from `14e3cff` to `4071a2a` - 13https://git.io/J1Ton
[00:46:46] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/WikiForum-887c080 [+0/-0/±1] 13https://git.io/J1ToC
[00:46:48] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03c40baac - Bump extensions/WikiForum from `7b08807` to `887c080`
[00:46:49] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4067: Bump extensions/WikiForum from `7b08807` to `887c080` - 13https://git.io/J1ToW
[00:46:51] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/WikiForum-887c080 - 13https://git.io/vbL5b
[00:46:52] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4067: Bump extensions/WikiForum from `7b08807` to `887c080` - 13https://git.io/J1ToW
[00:46:54] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Cargo-5242754 [+0/-0/±1] 13https://git.io/J1Tol
[00:46:55] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03bc3f3c3 - Bump extensions/Cargo from `b68e912` to `5242754`
[00:46:57] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Cargo-5242754 - 13https://git.io/vbL5b
[00:46:58] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4068: Bump extensions/Cargo from `b68e912` to `5242754` - 13https://git.io/J1To4
[00:47:00] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4068: Bump extensions/Cargo from `b68e912` to `5242754` - 13https://git.io/J1To4
[00:47:01] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/WikiDiscover-94bc79b [+0/-0/±1] 13https://git.io/J1ToB
[00:47:03] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03c47dc67 - Bump extensions/WikiDiscover from `c3d5a06` to `94bc79b`
[00:47:04] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4069: Bump extensions/WikiDiscover from `c3d5a06` to `94bc79b` - 13https://git.io/J1ToR
[00:47:06] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/WikiDiscover-94bc79b - 13https://git.io/vbL5b
[00:47:07] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4069: Bump extensions/WikiDiscover from `c3d5a06` to `94bc79b` - 13https://git.io/J1ToR
[00:47:09] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3961: Bump extensions/WikiDiscover from `c3d5a06` to `78dd569` - 13https://git.io/J1ToE
[00:47:10] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3961: Bump extensions/WikiDiscover from `c3d5a06` to `78dd569` - 13https://git.io/JPoce
[00:47:12] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/WikiDiscover-78dd569 - 13https://git.io/vbL5b
[00:47:13] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/WikiDiscover-78dd569
[00:47:15] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4070: Bump extensions/ProtectSite from `f240807` to `e5f75aa` - 13https://git.io/J1Toz
[00:47:16] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/ProtectSite-e5f75aa - 13https://git.io/vbL5b
[00:47:18] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/ProtectSite-e5f75aa [+0/-0/±1] 13https://git.io/J1Tog
[00:47:19] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03a358181 - Bump extensions/ProtectSite from `f240807` to `e5f75aa`
[00:47:21] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4070: Bump extensions/ProtectSite from `f240807` to `e5f75aa` - 13https://git.io/J1Toz
[00:47:22] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/cldr-937150a [+0/-0/±1] 13https://git.io/J1Toa
[00:47:24] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 035658480 - Bump extensions/cldr from `6b64c58` to `937150a`
[00:47:25] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4071: Bump extensions/cldr from `6b64c58` to `937150a` - 13https://git.io/J1Tow
[00:47:27] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/cldr-937150a - 13https://git.io/vbL5b
[00:47:28] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4071: Bump extensions/cldr from `6b64c58` to `937150a` - 13https://git.io/J1Tow
[00:47:30] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Moderation-916fa2d [+0/-0/±1] 13https://git.io/J1Tor
[00:47:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.24, 3.61, 3.38
[00:47:31] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 0348e3e35 - Bump extensions/Moderation from `fcfd7e6` to `916fa2d`
[00:47:33] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Moderation-916fa2d - 13https://git.io/vbL5b
[00:47:34] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4072: Bump extensions/Moderation from `fcfd7e6` to `916fa2d` - 13https://git.io/J1Too
[00:47:36] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4072: Bump extensions/Moderation from `fcfd7e6` to `916fa2d` - 13https://git.io/J1Too
[00:47:37] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/QuizGame-de84fef [+0/-0/±1] 13https://git.io/J1To6
[00:47:39] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 035785328 - Bump extensions/QuizGame from `a7d93db` to `de84fef`
[00:47:40] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/QuizGame-de84fef - 13https://git.io/vbL5b
[00:47:42] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4005: Bump extensions/Moderation from `fcfd7e6` to `8d72b71` - 13https://git.io/J1Toi
[00:47:43] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4073: Bump extensions/QuizGame from `a7d93db` to `de84fef` - 13https://git.io/J1ToP
[00:47:45] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4005: Bump extensions/Moderation from `fcfd7e6` to `8d72b71` - 13https://git.io/JXBnJ
[00:47:46] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4073: Bump extensions/QuizGame from `a7d93db` to `de84fef` - 13https://git.io/J1ToP
[00:47:48] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/Moderation-8d72b71
[00:47:49] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/Moderation-8d72b71 - 13https://git.io/vbL5b
[00:47:51] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/WikibaseLocalMedia-82b7cf0 [+0/-0/±1] 13https://git.io/J1To1
[00:47:52] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03431444b - Bump extensions/WikibaseLocalMedia from `b599d5d` to `82b7cf0`
[00:47:54] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4074: Bump extensions/WikibaseLocalMedia from `b599d5d` to `82b7cf0` - 13https://git.io/J1ToM
[00:47:55] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/WikibaseLocalMedia-82b7cf0 - 13https://git.io/vbL5b
[00:47:57] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4074: Bump extensions/WikibaseLocalMedia from `b599d5d` to `82b7cf0` - 13https://git.io/J1ToM
[00:47:58] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4030: Bump extensions/QuizGame from `a7d93db` to `322074b` - 13https://git.io/J1ToD
[00:48:00] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4030: Bump extensions/QuizGame from `a7d93db` to `322074b` - 13https://git.io/JXBc4
[00:48:01] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/QuizGame-322074b
[00:48:03] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/QuizGame-322074b - 13https://git.io/vbL5b
[00:48:04] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/Femiwiki-5aae296 [+0/-0/±1] 13https://git.io/J1ToS
[00:48:06] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 038df4557 - Bump skins/Femiwiki from `dec0b22` to `5aae296`
[00:48:07] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4010: Bump extensions/WikibaseLocalMedia from `b599d5d` to `18f8c90` - 13https://git.io/J1To9
[00:48:09] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/Femiwiki-5aae296 - 13https://git.io/vbL5b
[00:48:10] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4075: Bump skins/Femiwiki from `dec0b22` to `5aae296` - 13https://git.io/J1ToH
[00:48:12] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4010: Bump extensions/WikibaseLocalMedia from `b599d5d` to `18f8c90` - 13https://git.io/JXBn8
[00:48:13] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4075: Bump skins/Femiwiki from `dec0b22` to `5aae296` - 13https://git.io/J1ToH
[00:48:15] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/WikibaseLocalMedia-18f8c90
[00:48:16] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/WikibaseLocalMedia-18f8c90 - 13https://git.io/vbL5b
[00:48:18] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3947: Bump skins/Femiwiki from `dec0b22` to `3e0aeee` - 13https://git.io/J1To7
[00:48:19] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3947: Bump skins/Femiwiki from `dec0b22` to `3e0aeee` - 13https://git.io/JPon0
[00:48:21] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/Femiwiki-3e0aeee - 13https://git.io/vbL5b
[00:48:22] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/Femiwiki-3e0aeee
[00:48:24] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/Evelution-8075080 [+0/-0/±1] 13https://git.io/J1Tod
[00:48:25] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03febb74a - Bump skins/Evelution from `2d2bba5` to `8075080`
[00:48:27] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4076: Bump skins/Evelution from `2d2bba5` to `8075080` - 13https://git.io/J1ToF
[00:48:28] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/Evelution-8075080 - 13https://git.io/vbL5b
[00:48:30] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4076: Bump skins/Evelution from `2d2bba5` to `8075080` - 13https://git.io/J1ToF
[00:48:31] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4077: Bump extensions/PageForms from `6d50e13` to `cc58404` - 13https://git.io/J1ToN
[00:48:33] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/PageForms-cc58404 [+0/-0/±1] 13https://git.io/J1ToA
[00:48:34] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03dbee2f1 - Bump extensions/PageForms from `6d50e13` to `cc58404`
[00:48:36] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4077: Bump extensions/PageForms from `6d50e13` to `cc58404` - 13https://git.io/J1ToN
[00:48:37] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/PageForms-cc58404 - 13https://git.io/vbL5b
[00:48:39] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4028: Bump extensions/PageForms from `6d50e13` to `063f7ad` - 13https://git.io/J1Toh
[00:48:40] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4028: Bump extensions/PageForms from `6d50e13` to `063f7ad` - 13https://git.io/JXBcZ
[00:48:42] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/chameleon-3b98859 [+0/-0/±1] 13https://git.io/J1Toj
[00:48:43] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 035acaf6d - Bump skins/chameleon from `a923c46` to `3b98859`
[00:48:45] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/chameleon-3b98859 - 13https://git.io/vbL5b
[00:48:46] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/PageForms-063f7ad - 13https://git.io/vbL5b
[00:48:48] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4078: Bump skins/chameleon from `a923c46` to `3b98859` - 13https://git.io/J1TKe
[00:48:49] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/PageForms-063f7ad
[00:48:51] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4078: Bump skins/chameleon from `a923c46` to `3b98859` - 13https://git.io/J1TKe
[00:48:52] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/AutoCreateCategoryPages-4a09a54 [+0/-0/±1] 13https://git.io/J1TKf
[00:48:54] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 036b63901 - Bump extensions/AutoCreateCategoryPages from `1208a92` to `4a09a54`
[00:48:55] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/AutoCreateCategoryPages-4a09a54 - 13https://git.io/vbL5b
[00:48:57] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4079: Bump extensions/AutoCreateCategoryPages from `1208a92` to `4a09a54` - 13https://git.io/J1TKJ
[00:48:58] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4079: Bump extensions/AutoCreateCategoryPages from `1208a92` to `4a09a54` - 13https://git.io/J1TKJ
[00:49:00] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4026: Bump skins/chameleon from `a923c46` to `fbf0e91` - 13https://git.io/J1TKU
[00:49:01] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4026: Bump skins/chameleon from `a923c46` to `fbf0e91` - 13https://git.io/JXBcY
[00:49:03] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-fbf0e91 - 13https://git.io/vbL5b
[00:49:04] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/chameleon-fbf0e91
[00:49:06] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Mermaid-077ca5e [+0/-0/±1] 13https://git.io/J1TKI
[00:49:07] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03c250de3 - Bump extensions/Mermaid from `92df98c` to `077ca5e`
[00:49:09] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4080: Bump extensions/Mermaid from `92df98c` to `077ca5e` - 13https://git.io/J1TKL
[00:49:10] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Mermaid-077ca5e - 13https://git.io/vbL5b
[00:49:12] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4080: Bump extensions/Mermaid from `92df98c` to `077ca5e` - 13https://git.io/J1TKL
[00:49:13] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Video-925c30d [+0/-0/±1] 13https://git.io/J1TKt
[00:49:15] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03a90d31a - Bump extensions/Video from `9704a1f` to `925c30d`
[00:49:16] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Video-925c30d - 13https://git.io/vbL5b
[00:49:18] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4081: Bump extensions/Video from `9704a1f` to `925c30d` - 13https://git.io/J1TKq
[00:49:19] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4081: Bump extensions/Video from `9704a1f` to `925c30d` - 13https://git.io/J1TKq
[00:49:21] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/skins/Cosmos-0bc80c2 [+0/-0/±1] 13https://git.io/J1TKm
[00:49:22] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 0303b6264 - Bump skins/Cosmos from `334218f` to `0bc80c2`
[00:49:24] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/skins/Cosmos-0bc80c2 - 13https://git.io/vbL5b
[00:49:25] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4082: Bump skins/Cosmos from `334218f` to `0bc80c2` - 13https://git.io/J1TKY
[00:49:27] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4018: Bump extensions/Video from `9704a1f` to `afa6b40` - 13https://git.io/J1TKO
[00:49:28] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4082: Bump skins/Cosmos from `334218f` to `0bc80c2` - 13https://git.io/J1TKY
[00:49:30] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4018: Bump extensions/Video from `9704a1f` to `afa6b40` - 13https://git.io/JXBnH
[00:49:31] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/Video-afa6b40 - 13https://git.io/vbL5b
[00:49:33] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/Video-afa6b40
[00:49:34] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4009: Bump skins/Cosmos from `334218f` to `1451631` - 13https://git.io/J1TK3
[00:49:36] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/BlogPage-ba10f30 [+0/-0/±1] 13https://git.io/J1TKs
[00:49:37] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 039de8e0d - Bump extensions/BlogPage from `4ee49d9` to `ba10f30`
[00:49:39] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4083: Bump extensions/BlogPage from `4ee49d9` to `ba10f30` - 13https://git.io/J1TKG
[00:49:40] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4009: Bump skins/Cosmos from `334218f` to `1451631` - 13https://git.io/JXBnC
[00:49:42] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/BlogPage-ba10f30 - 13https://git.io/vbL5b
[00:49:43] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4083: Bump extensions/BlogPage from `4ee49d9` to `ba10f30` - 13https://git.io/J1TKG
[00:49:45] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/Cosmos-1451631 - 13https://git.io/vbL5b
[00:49:46] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/skins/Cosmos-1451631
[00:49:48] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3940: Bump extensions/BlogPage from `4ee49d9` to `489efaa` - 13https://git.io/J1TKn
[00:49:49] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/ManageWiki-ac06808 [+0/-0/±1] 13https://git.io/J1TKc
[00:49:51] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Private Git on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[00:49:51] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 034f8ac50 - Bump extensions/ManageWiki from `d5a1daa` to `ac06808`
[00:49:52] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4084: Bump extensions/ManageWiki from `d5a1daa` to `ac06808` - 13https://git.io/J1TKC
[00:49:54] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3940: Bump extensions/BlogPage from `4ee49d9` to `489efaa` - 13https://git.io/JPont
[00:49:55] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/ManageWiki-ac06808 - 13https://git.io/vbL5b
[00:49:57] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4084: Bump extensions/ManageWiki from `d5a1daa` to `ac06808` - 13https://git.io/J1TKC
[00:49:58] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/BlogPage-489efaa
[00:50:00] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/BlogPage-489efaa - 13https://git.io/vbL5b
[00:50:01] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Maps-09499d5 [+0/-0/±1] 13https://git.io/J1TKW
[00:50:03] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 0337e4e95 - Bump extensions/Maps from `9ffb477` to `09499d5`
[00:50:04] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Maps-09499d5 - 13https://git.io/vbL5b
[00:50:06] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4085: Bump extensions/Maps from `9ffb477` to `09499d5` - 13https://git.io/J1TKl
[00:50:07] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4085: Bump extensions/Maps from `9ffb477` to `09499d5` - 13https://git.io/J1TKl
[00:50:09] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/Translate-2704262 [+0/-0/±1] 13https://git.io/J1TK8
[00:50:10] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 03f0b0e56 - Bump extensions/Translate from `05557c3` to `2704262`
[00:50:12] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/Translate-2704262 - 13https://git.io/vbL5b
[00:50:13] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4086: Bump extensions/Translate from `05557c3` to `2704262` - 13https://git.io/J1TK4
[00:50:15] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4086: Bump extensions/Translate from `05557c3` to `2704262` - 13https://git.io/J1TK4
[00:50:16] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-ea14d38 [+0/-0/±1] 13https://git.io/J1TKB
[00:50:18] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 032039b15 - Bump extensions/UniversalLanguageSelector from `6d8a408` to `ea14d38`
[00:50:19] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-ea14d38 - 13https://git.io/vbL5b
[00:50:21] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4087: Bump extensions/UniversalLanguageSelector from `6d8a408` to `ea14d38` - 13https://git.io/J1TKR
[00:50:22] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4023: Bump extensions/Translate from `05557c3` to `c4a7b24` - 13https://git.io/J1TK0
[00:50:24] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4087: Bump extensions/UniversalLanguageSelector from `6d8a408` to `ea14d38` - 13https://git.io/J1TKR
[00:50:25] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4023: Bump extensions/Translate from `05557c3` to `c4a7b24` - 13https://git.io/JXBcJ
[00:50:27] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/Translate-c4a7b24 - 13https://git.io/vbL5b
[00:50:28] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/Translate-c4a7b24
[00:50:30] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#4006: Bump extensions/UniversalLanguageSelector from `6d8a408` to `f0c6bec` - 13https://git.io/J1TKu
[00:50:31] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#4006: Bump extensions/UniversalLanguageSelector from `6d8a408` to `f0c6bec` - 13https://git.io/JXBnI
[00:50:33] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-f0c6bec - 13https://git.io/vbL5b
[00:50:34] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/UniversalLanguageSelector-f0c6bec
[00:50:36] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/CreateWiki-65ad601 [+0/-0/±1] 13https://git.io/J1TKz
[00:50:37] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 032e9426f - Bump extensions/CreateWiki from `cc781d3` to `65ad601`
[00:50:39] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4088: Bump extensions/CreateWiki from `cc781d3` to `65ad601` - 13https://git.io/J1TKg
[00:50:40] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/CreateWiki-65ad601 - 13https://git.io/vbL5b
[00:50:42] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4088: Bump extensions/CreateWiki from `cc781d3` to `65ad601` - 13https://git.io/J1TKg
[00:50:43] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/RemovePII-c712717 [+0/-0/±1] 13https://git.io/J1TKa
[00:50:45] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 0312389ab - Bump extensions/RemovePII from `9aa7cca` to `c712717`
[00:50:46] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/RemovePII-c712717 - 13https://git.io/vbL5b
[00:50:48] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4089: Bump extensions/RemovePII from `9aa7cca` to `c712717` - 13https://git.io/J1TKw
[00:50:49] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4089: Bump extensions/RemovePII from `9aa7cca` to `c712717` - 13https://git.io/J1TKw
[00:50:51] <Not-616a>	 [02mediawiki] 07dependabot[bot] commented on pull request 03#3950: Bump extensions/RemovePII from `9aa7cca` to `b0dd543` - 13https://git.io/J1TKr
[00:50:52] <Not-616a>	 [02mediawiki] 07dependabot[bot] closed pull request 03#3950: Bump extensions/RemovePII from `9aa7cca` to `b0dd543` - 13https://git.io/JPonr
[00:50:54] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/RemovePII-b0dd543
[00:50:55] <Not-616a>	 [02mediawiki] 07dependabot[bot] deleted branch 03dependabot/submodules/REL1_37/extensions/RemovePII-b0dd543 - 13https://git.io/vbL5b
[00:50:57] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_37/extensions/MintyDocs-35f295c [+0/-0/±1] 13https://git.io/J1TKo
[00:50:58] <Not-616a>	 [02miraheze/mediawiki] 07dependabot[bot] 038c8a685 - Bump extensions/MintyDocs from `b9d49f6` to `35f295c`
[00:51:00] <Not-616a>	 [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_37/extensions/MintyDocs-35f295c - 13https://git.io/vbL5b
[00:51:01] <Not-616a>	 [02mediawiki] 07dependabot[bot] opened pull request 03#4090: Bump extensions/MintyDocs from `b9d49f6` to `35f295c` - 13https://git.io/J1TKK
[00:51:03] <Not-616a>	 [02mediawiki] 07dependabot[bot] labeled pull request 03#4090: Bump extensions/MintyDocs from `b9d49f6` to `35f295c` - 13https://git.io/J1TKK
[00:51:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.41, 4.20, 3.68
[00:51:38] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 7.27, 6.49, 5.94
[00:52:24] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.18, 7.32, 6.25
[00:52:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.91, 6.78, 6.16
[00:53:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.63, 3.66, 3.54
[00:53:37] <icinga-miraheze>	 PROBLEM - mw13 Puppet on mw13 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[nginx]
[00:53:38] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 4.12, 5.58, 5.67
[00:54:23] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.08, 7.20, 6.34
[00:54:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 9.52, 7.53, 6.50
[00:55:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.63, 4.17, 3.75
[00:56:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.29, 6.98, 6.43
[00:58:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 10.74, 8.23, 6.93
[00:58:59] <icinga-miraheze>	 PROBLEM - graylog2 Disk Space on graylog2 is WARNING: DISK WARNING - free space: / 78573 MB (10% inode=99%);
[00:59:56] <dmehus>	 CosmicAlpha, any idea why the wordmark icon isn't showing on Cosmos for Meta?
[01:00:00] <dmehus>	 It shows on Vector
[01:01:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.26, 3.52, 3.66
[01:02:17] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.89, 6.30, 6.34
[01:02:52] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:03:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 5.69, 5.14, 5.89
[01:04:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.70, 7.94, 7.38
[01:04:55] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is WARNING: WARNING: Full, 70911 files, 26.39GB, 2021-11-07 00:59:00 (1.1 weeks ago)
[01:06:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.25, 7.91, 7.41
[01:09:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.37, 4.18, 3.84
[01:11:37] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.70, 3.53, 4.81
[01:13:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.11, 3.86, 3.81
[01:16:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.40, 7.63, 7.57
[01:16:59] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 19.86, 21.31, 23.89
[01:18:59] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.89, 22.00, 23.78
[01:22:02] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 14.22, 10.14, 7.92
[01:22:57] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 21.27, 23.07, 23.93
[01:26:00] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 5.56, 7.39, 7.26
[01:26:18] <CosmicAlpha>	 paladox, JohnLewis, Reception123: if around, can you please reboot mw13?
[01:26:19] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:27:36] <paladox>	 !log reboot mw13
[01:27:44] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[01:28:03] <CosmicAlpha>	 dmehus: wordmark appears for me.
[01:28:08] <CosmicAlpha>	 Thanks paladox
[01:28:25] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is WARNING: WARNING: Full, 81266 files, 13.66GB, 2021-11-07 00:13:00 (1.2 weeks ago)
[01:28:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 8.12, 7.35, 7.28
[01:29:32] <icinga-miraheze>	 PROBLEM - mw13 Current Load on mw13 is CRITICAL: connect to address 51.195.236.251 port 5666: Connection refusedconnect to host 51.195.236.251 port 5666: Connection refused
[01:29:33] <icinga-miraheze>	 PROBLEM - mw13 php-fpm on mw13 is CRITICAL: connect to address 51.195.236.251 port 5666: Connection refusedconnect to host 51.195.236.251 port 5666: Connection refused
[01:29:40] <icinga-miraheze>	 PROBLEM - mw13 Check Gluster Clients on mw13 is CRITICAL: connect to address 51.195.236.251 port 5666: Connection refusedconnect to host 51.195.236.251 port 5666: Connection refused
[01:29:42] <icinga-miraheze>	 PROBLEM - mw13 NTP time on mw13 is CRITICAL: connect to address 51.195.236.251 port 5666: Connection refusedconnect to host 51.195.236.251 port 5666: Connection refused
[01:29:47] <icinga-miraheze>	 PROBLEM - mw13 Disk Space on mw13 is CRITICAL: connect to address 51.195.236.251 port 5666: Connection refusedconnect to host 51.195.236.251 port 5666: Connection refused
[01:30:07] <icinga-miraheze>	 PROBLEM - mw13 APT on mw13 is CRITICAL: connect to address 51.195.236.251 port 5666: Connection refusedconnect to host 51.195.236.251 port 5666: Connection refused
[01:30:08] <CosmicAlpha>	 dmehus: Also nice new style for cosmos on meta.
[01:30:10] <icinga-miraheze>	 PROBLEM - mw13 JobRunner Service on mw13 is CRITICAL: connect to address 51.195.236.251 port 5666: Connection refusedconnect to host 51.195.236.251 port 5666: Connection refused
[01:30:17] <icinga-miraheze>	 PROBLEM - mw13 conntrack_table_size on mw13 is CRITICAL: connect to address 51.195.236.251 port 5666: Connection refusedconnect to host 51.195.236.251 port 5666: Connection refused
[01:30:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.93, 7.06, 7.20
[01:30:57] <icinga-miraheze>	 PROBLEM - mw13 SSH on mw13 is CRITICAL: connect to address 51.195.236.251 and port 22: Connection refused
[01:31:27] <icinga-miraheze>	 RECOVERY - mw13 HTTPS on mw13 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 559 bytes in 0.026 second response time
[01:31:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.06, 3.19, 3.40
[01:31:32] <icinga-miraheze>	 RECOVERY - mw13 Current Load on mw13 is OK: OK - load average: 0.80, 0.22, 0.08
[01:31:33] <icinga-miraheze>	 RECOVERY - mw13 php-fpm on mw13 is OK: PROCS OK: 33 processes with command name 'php-fpm7.3'
[01:31:41] <icinga-miraheze>	 RECOVERY - mw13 Check Gluster Clients on mw13 is OK: PROCS OK: 1 process with args '/usr/sbin/glusterfs'
[01:31:42] <icinga-miraheze>	 RECOVERY - mw13 NTP time on mw13 is OK: NTP OK: Offset 0.0003160238266 secs
[01:31:47] <icinga-miraheze>	 RECOVERY - mw13 Disk Space on mw13 is OK: DISK OK - free space: / 9461 MB (52% inode=77%);
[01:31:52] <icinga-miraheze>	 RECOVERY - cp15 Varnish Backends on cp15 is OK: All 9 backends are healthy
[01:31:54] <icinga-miraheze>	 RECOVERY - cp13 Stunnel Http for mw13 on cp13 is OK: HTTP OK: HTTP/1.1 200 OK - 15861 bytes in 0.240 second response time
[01:31:55] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.14, 5.46, 6.46
[01:32:05] <icinga-miraheze>	 RECOVERY - cp13 Varnish Backends on cp13 is OK: All 9 backends are healthy
[01:32:08] <icinga-miraheze>	 RECOVERY - mw13 APT on mw13 is OK: APT OK: 1 packages available for upgrade (0 critical updates).
[01:32:10] <icinga-miraheze>	 RECOVERY - mw13 JobRunner Service on mw13 is OK: PROCS OK: 1 process with args 'redisJobRunnerService'
[01:32:16] <icinga-miraheze>	 RECOVERY - cp15 Stunnel Http for mw13 on cp15 is OK: HTTP OK: HTTP/1.1 200 OK - 15861 bytes in 0.346 second response time
[01:32:17] <icinga-miraheze>	 RECOVERY - mw13 conntrack_table_size on mw13 is OK: OK: nf_conntrack is 1 % full
[01:32:21] <icinga-miraheze>	 RECOVERY - cp14 Varnish Backends on cp14 is OK: All 9 backends are healthy
[01:32:21] <icinga-miraheze>	 RECOVERY - cp12 Stunnel Http for mw13 on cp12 is OK: HTTP OK: HTTP/1.1 200 OK - 15861 bytes in 0.311 second response time
[01:32:36] <icinga-miraheze>	 ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[01:32:38] <icinga-miraheze>	 RECOVERY - cp12 Varnish Backends on cp12 is OK: All 9 backends are healthy
[01:32:39] <icinga-miraheze>	 RECOVERY - mw13 MediaWiki Rendering on mw13 is OK: HTTP OK: HTTP/1.1 200 OK - 20009 bytes in 0.315 second response time
[01:32:55] <icinga-miraheze>	 RECOVERY - cp14 Stunnel Http for mw13 on cp14 is OK: HTTP OK: HTTP/1.1 200 OK - 15861 bytes in 0.006 second response time
[01:32:57] <icinga-miraheze>	 RECOVERY - mw13 SSH on mw13 is OK: SSH OK - OpenSSH_7.9p1 Debian-10+deb10u2 (protocol 2.0)
[01:33:36] <icinga-miraheze>	 RECOVERY - mw13 Puppet on mw13 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures
[01:34:25] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.45, 5.11, 6.37
[01:34:53] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 12.53, 15.56, 19.69
[01:35:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.73, 3.61, 3.54
[01:35:50] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[01:37:54] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is WARNING: WARNING: Full, 70416 files, 28.15GB, 2021-11-07 00:36:00 (1.1 weeks ago)
[01:39:32] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.54, 3.63, 3.54
[01:41:38] <Agent>	 I agree, the new style looks nice on Meta :P
[01:42:12] <dmehus>	 CosmicAlpha, np. Yeah, I don't really use Cosmos, but I know there's a few people that do and Agent requested it
[01:42:41] <dmehus>	 the wordmark appears, but not the honeycomb icon
[01:42:50] <dmehus>	 does Cosmos not support both wordmark + icon?
[01:43:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.36, 3.77, 3.64
[01:47:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.67, 4.06, 3.76
[01:47:40] <CosmicAlpha>	 dmehus: oh no it doesn't use the icon in addition to wordmark, only uses custom config for Cosmos only, falling back to wordmark, and finally falling back to logo. Maybe that's something I need to think about adding support for.
[01:49:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.83, 3.94, 3.75
[01:51:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.18, 4.11, 3.84
[01:57:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.23, 3.76, 3.80
[01:59:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.97, 4.16, 3.93
[02:08:51] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:10:55] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is WARNING: WARNING: Full, 70911 files, 26.39GB, 2021-11-07 00:59:00 (1.1 weeks ago)
[02:15:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.48, 3.59, 3.92
[02:16:27] <icinga-miraheze>	 PROBLEM - matttest.mtwiki.cf - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'matttest.mtwiki.cf' expires in 15 day(s) (Wed 01 Dec 2021 02:12:02 GMT +0000).
[02:17:42] <icinga-miraheze>	 PROBLEM - wiki.umbranet.mandelbrotgames.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.umbranet.mandelbrotgames.com' expires in 15 day(s) (Wed 01 Dec 2021 02:14:42 GMT +0000).
[02:18:20] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:19:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.43, 3.60, 3.81
[02:20:24] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is WARNING: WARNING: Full, 81266 files, 13.66GB, 2021-11-07 00:13:00 (1.2 weeks ago)
[02:21:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.87, 3.52, 3.78
[02:27:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.31, 3.83, 3.77
[02:29:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.14, 3.48, 3.64
[02:31:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.36, 3.86, 3.77
[02:36:21] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[02:38:33] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is WARNING: WARNING: Full, 70911 files, 26.39GB, 2021-11-07 00:59:00 (1.2 weeks ago)
[02:43:29] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.64, 18.66, 15.80
[02:43:59] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.99, 6.75, 5.02
[02:45:09] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 11.71, 7.93, 5.53
[02:45:28] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 14.63, 17.25, 15.65
[02:45:59] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.80, 6.14, 5.01
[02:46:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.03, 5.94, 4.68
[02:47:08] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 4.95, 6.83, 5.42
[02:47:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.90, 3.67, 3.93
[02:48:25] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.32, 5.32, 4.61
[02:49:07] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.05, 6.22, 5.37
[02:49:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.26, 4.19, 4.08
[02:56:58] <icinga-miraheze>	 PROBLEM - cp15 Current Load on cp15 is CRITICAL: CRITICAL - load average: 1.92, 2.08, 1.25
[02:58:58] <icinga-miraheze>	 PROBLEM - cp15 Current Load on cp15 is WARNING: WARNING - load average: 1.34, 1.81, 1.25
[03:00:58] <icinga-miraheze>	 RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 1.09, 1.63, 1.26
[03:05:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.65, 3.76, 3.91
[03:11:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.25, 4.04, 3.93
[03:13:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.48, 3.80, 3.86
[03:17:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.39, 3.78, 3.82
[03:25:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.47, 3.92, 3.93
[03:33:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.64, 4.21, 3.98
[03:35:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.90, 3.59, 3.78
[03:41:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.26, 3.27, 3.51
[03:47:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.25, 3.31, 3.53
[03:51:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.96, 4.33, 3.86
[03:55:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.47, 3.59, 3.70
[04:01:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.50, 3.72, 3.68
[04:03:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.16, 3.48, 3.60
[04:09:32] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.24, 3.08, 3.37
[04:13:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.52, 3.58, 3.53
[04:19:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.52, 3.85, 3.63
[04:23:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.60, 3.87, 3.71
[04:37:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.02, 3.79, 3.70
[04:39:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.82, 3.88, 3.75
[04:40:41] <icinga-miraheze>	 alerting : [FIRING:1] (!sre MediaWiki Exception Rate yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[04:45:41] <icinga-miraheze>	 ok : [RESOLVED] (!sre MediaWiki Exception Rate yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki
[04:51:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.64, 3.94, 3.70
[04:57:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.55, 3.41, 3.57
[04:58:50] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:00:54] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is WARNING: WARNING: Full, 70911 files, 26.39GB, 2021-11-07 00:59:00 (1.2 weeks ago)
[05:01:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.32, 3.98, 3.77
[05:03:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.44, 3.41, 3.59
[05:05:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.19, 3.57, 3.61
[05:07:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.57, 3.61
[05:17:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.83, 3.10, 3.36
[05:21:50] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:23:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.31, 3.70, 3.50
[05:23:54] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is WARNING: WARNING: Full, 70416 files, 28.15GB, 2021-11-07 00:36:00 (1.2 weeks ago)
[05:25:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.33, 3.05, 3.28
[05:35:20] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:37:25] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is WARNING: WARNING: Full, 81266 files, 13.66GB, 2021-11-07 00:13:00 (1.2 weeks ago)
[05:39:27] <ugochimobi>	 @CosmicAlpha  https://phabricator.miraheze.org/T8289
[05:39:28] <MirahezeBot>	 [url] ⚓ T8289 Import XML dump | phabricator.miraheze.org
[05:40:45] <CosmicAlpha>	 ugochimobi: haven't done that yet because it's multiple Imports. I wanted to wait for my others to finish first, then I can probably get to it if no one else does first.
[05:42:07] <ugochimobi>	 CosmicAlpha: no wahala, I'd be waiting.
[05:43:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.57, 3.36, 3.19
[05:45:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.44, 2.79, 2.98
[05:46:51] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:48:55] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is WARNING: WARNING: Full, 70911 files, 26.39GB, 2021-11-07 00:59:00 (1.2 weeks ago)
[05:53:51] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:55:51] <CosmicAlpha>	 Ugochimobi: my big import should be done by tomorrow. It's at 850,000 pages done now, so should be able to try and get to yours tomorrow or Tuesday.
[05:55:54] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is WARNING: WARNING: Full, 70911 files, 26.39GB, 2021-11-07 00:59:00 (1.2 weeks ago)
[05:56:18] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:57:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.58, 3.41, 3.22
[05:58:24] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is WARNING: WARNING: Full, 81266 files, 13.66GB, 2021-11-07 00:13:00 (1.2 weeks ago)
[05:58:50] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[05:59:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.37, 3.06, 3.12
[06:00:57] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db13 on bacula2 is WARNING: WARNING: Full, 70911 files, 26.39GB, 2021-11-07 00:59:00 (1.2 weeks ago)
[06:04:55] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 8.37, 6.38, 4.02
[06:06:52] <icinga-miraheze>	 PROBLEM - db12 APT on db12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[06:06:56] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.67, 6.92, 4.52
[06:08:45] <MirahezeLSBot>	 !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/refreshLinks.php --wiki=hypotheticalhurricaneswiki (END - exit=256)
[06:08:49] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:08:50] <icinga-miraheze>	 RECOVERY - db12 APT on db12 is OK: APT OK: 9 packages available for upgrade (0 critical updates).
[06:08:55] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is CRITICAL: CRITICAL - load average: 12.09, 8.87, 5.53
[06:09:42] <icinga-miraheze>	 PROBLEM - db12 Current Load on db12 is CRITICAL: CRITICAL - load average: 13.32, 11.29, 6.29
[06:12:55] <icinga-miraheze>	 PROBLEM - db11 Current Load on db11 is WARNING: WARNING - load average: 7.28, 7.87, 5.88
[06:13:35] <icinga-miraheze>	 RECOVERY - db12 Current Load on db12 is OK: OK - load average: 2.66, 6.18, 5.29
[06:16:55] <icinga-miraheze>	 RECOVERY - db11 Current Load on db11 is OK: OK - load average: 5.18, 6.56, 5.81
[06:25:21] <icinga-miraheze>	 PROBLEM - wiki.dunmoore.net - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.dunmoore.net' expires in 15 day(s) (Wed 01 Dec 2021 06:18:39 GMT +0000).
[06:32:24] <icinga-miraheze>	 PROBLEM - wiki.simorgh.me - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.simorgh.me' expires in 15 day(s) (Wed 01 Dec 2021 06:26:48 GMT +0000).
[06:32:42] <icinga-miraheze>	 PROBLEM - pwsc.polandballwiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'pwsc.polandballwiki.com' expires in 15 day(s) (Wed 01 Dec 2021 06:24:59 GMT +0000).
[06:44:36] <icinga-miraheze>	 PROBLEM - db13 APT on db13 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[06:46:57] <MirahezeLSBot>	 !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=monstergirlencyclopediawiki /home/reception/monstergirlencyclopedia_pages_full.xml --username-prefix wikia:monstergirlencyclopedia --report 1 --no-updates (END - exit=256)
[06:47:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[06:47:11] <icinga-miraheze>	 PROBLEM - db13 Current Load on db13 is CRITICAL: CRITICAL - load average: 22.92, 10.48, 6.26
[06:48:42] <icinga-miraheze>	 RECOVERY - db13 APT on db13 is OK: APT OK: 9 packages available for upgrade (0 critical updates).
[06:49:11] <icinga-miraheze>	 PROBLEM - db13 Current Load on db13 is WARNING: WARNING - load average: 5.02, 7.66, 5.73
[06:51:11] <icinga-miraheze>	 RECOVERY - db13 Current Load on db13 is OK: OK - load average: 2.44, 5.86, 5.30
[06:51:37] <icinga-miraheze>	 PROBLEM - parapedia.pl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'parapedia.pl' expires in 7 day(s) (Tue 23 Nov 2021 06:49:10 GMT +0000).
[06:57:07] <icinga-miraheze>	 PROBLEM - heavyironmodding.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'heavyironmodding.org' expires in 7 day(s) (Tue 23 Nov 2021 06:53:30 GMT +0000).
[07:00:01] <icinga-miraheze>	 PROBLEM - popira.info - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'popira.info' expires in 15 day(s) (Wed 01 Dec 2021 06:51:00 GMT +0000).
[07:52:20] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[07:53:21] <icinga-miraheze>	 PROBLEM - nl.xliving.tk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Certificate 'nl.xliving.tk' expires in 7 day(s) (Tue 23 Nov 2021 07:49:11 GMT +0000).
[07:54:24] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is WARNING: WARNING: Full, 70416 files, 28.15GB, 2021-11-07 00:36:00 (1.2 weeks ago)
[08:04:50] <ugochimobi>	 CosmicAlpha Alright sir, no problem.
[10:06:20] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[10:08:25] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is WARNING: WARNING: Full, 70416 files, 28.15GB, 2021-11-07 00:36:00 (1.2 weeks ago)
[10:15:20] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[10:17:26] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is WARNING: WARNING: Full, 70416 files, 28.15GB, 2021-11-07 00:36:00 (1.2 weeks ago)
[10:22:20] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[10:24:26] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is WARNING: WARNING: Full, 70416 files, 28.15GB, 2021-11-07 00:36:00 (1.2 weeks ago)
[11:04:44] <ugochimobi>	 [ecfd15c3b0cd5f4143d46bc1] 2021-11-15 11:03:00: Fatal exception of type "Wikimedia\Rdbms\DBQueryError"
[11:05:01] <ugochimobi>	 Database Error on Gratispaideia
[11:22:09] <RhinosF1>	 Is it persistent?
[11:22:12] <RhinosF1>	 What doing?
[11:24:21] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[11:26:26] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db11 on bacula2 is WARNING: WARNING: Full, 81266 files, 13.66GB, 2021-11-07 00:13:00 (1.2 weeks ago)
[11:29:37] <ugochimobi>	 RhinosF1 it is 
[11:31:57] <RhinosF1>	 ugochimobi: on what page
[11:32:13] <ugochimobi>	 https://gratispaideia.miraheze.org/wiki/User:Ugochimobi/ManageWiki_Log
[11:32:14] <MirahezeBot>	 [url] User:Ugochimobi/ManageWiki Log - Gratispaideia | gratispaideia.miraheze.org
[11:32:17] <ugochimobi>	 RhinosF1
[11:32:30] <RhinosF1>	 Fun
[11:32:38] <ugochimobi>	 heh
[11:32:39] <RhinosF1>	 I'm mobile but you'll have to file a bug
[11:32:48] <RhinosF1>	 s/but/so
[11:32:48] <MirahezeBot>	 RhinosF1 meant to say: I'm mobile so you'll have to file a bug
[11:32:59] <ugochimobi>	 Almost doing that, but on it
[11:36:59] <ugochimobi>	 RhinosF1 done now
[11:37:12] <RhinosF1>	 Seen
[11:37:29] <ugochimobi>	 you're sharp 🙃
[11:37:51] <icinga-miraheze>	 PROBLEM - bacula2 Bacula Databases db12 on bacula2 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 60 seconds.
[11:38:47] <RhinosF1>	 Shut up icinga-miraheze
[11:40:03] <RhinosF1>	 !log downtime bacula2 database on db* check for 48 hours
[11:40:07] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[11:45:06] <ugochimobi>	 heh, RhinosF1 icinga-miraheze is quite stubborn 
[11:45:29] <RhinosF1>	 That's why I hit it with a stick
[11:45:39] <ugochimobi>	 lol
[12:07:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.71, 3.08, 2.59
[12:09:04] <Not-616a>	 [02miraheze/CreateWiki] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/J1q6s
[12:09:05] <Not-616a>	 [02miraheze/CreateWiki] 07translatewiki 03e74134b - Localisation updates from https://translatewiki.net.
[12:09:06] <MirahezeBot>	 [url] Main page - translatewiki.net | translatewiki.net
[12:09:07] <Not-616a>	 [02miraheze/MatomoAnalytics] 07translatewiki pushed 031 commit to 03master [+1/-0/±0] 13https://git.io/J1q6G
[12:09:08] <Not-616a>	 [02miraheze/MatomoAnalytics] 07translatewiki 03357cdc0 - Localisation updates from https://translatewiki.net.
[12:09:09] <MirahezeBot>	 [url] Main page - translatewiki.net | translatewiki.net
[12:09:10] <Not-616a>	 [02miraheze/WikiDiscover] 07translatewiki pushed 031 commit to 03master [+1/-0/±1] 13https://git.io/J1q6Z
[12:09:11] <Not-616a>	 [02miraheze/WikiDiscover] 07translatewiki 03d6aac79 - Localisation updates from https://translatewiki.net.
[12:09:12] <MirahezeBot>	 [url] Main page - translatewiki.net | translatewiki.net
[12:09:13] <Not-616a>	 [02miraheze/MirahezeMagic] 07translatewiki pushed 031 commit to 03master [+0/-0/±2] 13https://git.io/J1q6c
[12:09:14] <Not-616a>	 [02miraheze/MirahezeMagic] 07translatewiki 0313581e7 - Localisation updates from https://translatewiki.net.
[12:09:15] <MirahezeBot>	 [url] Main page - translatewiki.net | translatewiki.net
[12:09:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.09, 3.08, 2.65
[12:11:16] <miraheze-github>	 miraheze/MirahezeMagic - translatewiki the build passed.
[12:11:50] <miraheze-github>	 miraheze/MatomoAnalytics - translatewiki the build passed.
[12:19:27] <miraheze-github>	 miraheze/WikiDiscover - translatewiki the build passed.
[12:19:35] <miraheze-github_>	 miraheze/CreateWiki - translatewiki the build passed.
[12:21:27] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 10.32, 7.26, 4.78
[12:23:25] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.34, 6.32, 4.73
[12:23:48] <ugochimobi>	 Can we have it that All Sysops and Crats should or must have 2FA turned on? on Gratispaideia
[12:52:12] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.56, 3.80, 3.10
[12:54:07] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.58, 3.65, 3.12
[12:57:57] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.97, 3.17, 3.06
[13:03:54] <Not-616a>	 [02mw-config] 07stranger195 opened pull request 03#4222: Allow zealandiawiki to import templates from wikia:adoriasim - 13https://git.io/J1mIQ
[13:05:04] <miraheze-github>	 miraheze/mw-config - stranger195 the build passed.
[13:05:38] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.10, 3.49, 3.17
[13:07:34] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.61, 3.44, 3.19
[13:09:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.04, 3.63, 3.29
[13:11:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.18, 3.61, 3.33
[13:13:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.07, 3.66, 3.38
[13:15:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.58, 3.23, 3.25
[13:16:44] <RhinosF1>	 .in 3hours answer ugochimobi about 2FA
[13:16:44] <MirahezeBot>	 RhinosF1: Okay, will remind at 2021-11-15 - 16:16:44GMT
[13:21:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.92, 3.31, 3.23
[13:23:16] <ugochimobi>	 .in 3hours 5minutes remind RhinosF1 about 2FA
[13:23:17] <MirahezeBot>	 ugochimobi: Okay, will remind at 2021-11-15 - 16:28:16GMT
[13:23:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.10, 3.24, 3.22
[13:24:25] <RhinosF1>	 ugochimobi: the short answer is no but there's a long answer that ends with yes
[13:25:05] <ugochimobi>	 heh, please share long answer when you have the time
[13:25:19] <RhinosF1>	 You have two options: ask some group to check status on wiki or use the rights function to pick a right in the admin group
[13:25:36] <RhinosF1>	 But I'm only on a 15 minute lunch
[13:25:52] <RhinosF1>	 You can say the 'delete' or 'managewiki' requires 2FA
[13:26:04] <RhinosF1>	 But if you want on giving admin or crat than we can check
[13:26:07] <RhinosF1>	 The user
[13:26:19] <RhinosF1>	 But that wouldn't be revoked on disable
[13:26:33] <RhinosF1>	 Only if it you said like delete requires 2FA
[13:26:57] <RhinosF1>	 And I don't think it's been used anywhere before so I'm not 100% it'll work
[13:27:16] <RhinosF1>	 majavah might know if CA provides right info or if it's all core
[13:28:29] <ugochimobi>	 okay?.....
[13:29:29] <RhinosF1>	 Do I make sense?
[13:30:39] <ugochimobi>	 yeah, enough
[13:30:54] <ugochimobi>	 but
[13:31:11] <ugochimobi>	 can we just try and see if it'll work
[13:31:17] <ugochimobi>	 ?
[13:31:33] <RhinosF1>	 If you pick some rights
[13:31:38] <RhinosF1>	 We can try later ye
[13:31:56] <RhinosF1>	 delete & ManageWiki we're just suggestions
[13:31:59] <RhinosF1>	 You can have any
[13:32:13] <ugochimobi>	 okay...
[13:33:09] <RhinosF1>	 You got a few hours before you have to pick
[13:33:16] <RhinosF1>	 I got lesson in a few minutes
[13:33:24] <ugochimobi>	 that's right, I think only admins can literally delete on a wiki, unless on an exceptional case where we have translators
[13:33:39] <ugochimobi>	 No problem, RhinosF1
[13:33:51] <RhinosF1>	 Normally ye
[13:34:00] <RhinosF1>	 Unless individual wiki has changed it
[13:34:54] <ugochimobi>	 exactly
[13:35:17] <ugochimobi>	 but for crats I'd prefer override-antispoof to managewiki, I think
[13:51:49] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 4.00, 3.59, 3.34
[13:53:44] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.93, 3.24, 3.24
[14:22:35] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.33, 3.43, 3.28
[14:24:30] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.37, 3.08, 3.17
[14:29:10] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 10.42, 8.00, 5.93
[14:31:04] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.81, 6.61, 5.65
[14:48:32] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.63, 3.40, 3.23
[14:50:27] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.54, 3.90, 3.44
[14:52:22] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.09, 3.55, 3.36
[14:54:17] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.39, 3.82, 3.48
[15:00:03] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.63, 3.95, 3.64
[15:11:33] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.49, 3.62, 3.59
[15:13:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.39, 3.49, 3.55
[15:21:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.34, 3.82, 3.68
[15:25:32] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.21, 3.75, 3.71
[15:29:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.36, 4.02, 3.82
[15:31:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.79, 3.69, 3.73
[15:34:51] <Cocopuff2018>	 [bc04cead718875f680834cee] 2021-11-15 15:34:37: Fatal exception of type "Wikimedia\Rdbms\DBQueryError"
[15:35:00] <Cocopuff2018>	 https://gratispaideia.miraheze.org/wiki/User:Ugochimobi/ManageWiki_Log
[15:35:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.59, 3.74, 3.69
[15:36:11] <ugochimobi>	 Cocopuff2018 heh, that's been reported since morning, you can track it here
[15:36:17] <ugochimobi>	 .task 8295
[15:36:19] <MirahezeBot>	 https://phabricator.miraheze.org/T8295 - Wikimedia\Rdbms\DBQueryError on Gratispaideia, authored by Ugochimobi, assigned to None, Priority: High, Status: Open
[15:36:38] <RhinosF1>	 CosmicAlpha: ^
[15:36:41] <RhinosF1>	 Cocopuff2018: ^
[15:37:25] <Not-616a>	 [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03RhinosF1-patch-3 [+0/-0/±1] 13https://git.io/J1YBn
[15:37:27] <Not-616a>	 [02miraheze/mw-config] 07RhinosF1 03588fd49 - MWE: add SQL for DT
[15:37:28] <Not-616a>	 [02mw-config] 07RhinosF1 created branch 03RhinosF1-patch-3 - 13https://git.io/vbvb3
[15:37:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.51, 3.32, 3.55
[15:37:34] <RhinosF1>	 Reception123: around ^
[15:37:54] <Not-616a>	 [02mw-config] 07RhinosF1 opened pull request 03#4223: MWE: add SQL for DT - 13https://git.io/J1YB6
[15:39:07] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[15:39:36] <Cocopuff2018>	 @Rhinosf1 Yes? i saw a ping
[15:39:56] <RhinosF1>	 Cocopuff2018: patch incoming
[15:40:06] <Cocopuff2018>	 ok.
[15:40:16] <Not-616a>	 [02mw-config] 07RhinosF1 closed pull request 03#4223: MWE: add SQL for DT - 13https://git.io/J1YB6
[15:40:18] <Not-616a>	 [02miraheze/mw-config] 07RhinosF1 pushed 031 commit to 03master [+0/-0/±1] 13https://git.io/J1YRE
[15:40:19] <Not-616a>	 [02miraheze/mw-config] 07RhinosF1 0323a52ac - MWE: add SQL for DT (#4223)
[15:40:21] <Not-616a>	 [02mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-3 - 13https://git.io/vbvb3
[15:40:22] <Not-616a>	 [02miraheze/mw-config] 07RhinosF1 deleted branch 03RhinosF1-patch-3
[15:41:19] <miraheze-github>	 miraheze/mw-config - RhinosF1 the build passed.
[15:43:17] <RhinosF1>	 puppet is running
[15:43:41] <MirahezeLSBot>	 !log [@mw11] starting deploy of {'config': True} to all
[15:43:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:43:56] <MirahezeLSBot>	 !log [@mw11] finished deploy of {'config': True} to all - SUCCESS in 14s
[15:44:01] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:44:07] <MirahezeLSBot>	 !log [rhinos@mwtask1] sudo -u www-data /usr/local/bin/foreachwikiindblist /home/rhinos/discussiontools.json /srv/mediawiki/w/maintenance/sql.php /home/rhinos/dtsqlifexist.sql (START)
[15:44:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:44:35] <RhinosF1>	 Cocopuff2018, ugochimobi: when that says END, it fixed
[15:44:42] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 7.57, 8.32, 6.28
[15:44:51] <MirahezeLSBot>	 !log [rhinos@mwtask1] sudo -u www-data /usr/local/bin/foreachwikiindblist /home/rhinos/discussiontools.json /srv/mediawiki/w/maintenance/sql.php /home/rhinos/dtsqlifexist.sql (END - exit=0)
[15:45:05] <RhinosF1>	 there
[15:45:09] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:45:21] <ugochimobi>	 RhinosF1 Yay
[15:46:14] <ugochimobi>	 It worked immediately
[15:46:41] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 6.69, 7.68, 6.28
[15:47:30] <RhinosF1>	 ugochimobi: should be fixed on all wikis now
[15:47:50] <ugochimobi>	 Oh was it affecting all wikis?
[15:48:19] <ugochimobi>	 I think specifically it's the DiscussionTools extension if I guess correctly
[15:48:25] <RhinosF1>	 yes
[15:48:27] <RhinosF1>	 a fair few
[15:48:40] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.40, 6.59, 6.06
[15:49:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.59, 3.45, 3.45
[15:51:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.94, 3.62, 3.51
[15:52:17] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.75, 21.04, 18.49
[15:52:43] <ugochimobi>	 okay
[15:52:58] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.35, 5.16, 4.17
[15:53:08] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 12.84, 8.59, 6.34
[15:53:09] <Cocopuff2018>	 great
[15:53:32] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.11, 3.96, 3.67
[15:54:18] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.83, 18.33, 17.81
[15:54:20] <MirahezeLSBot>	 !log [@test3] starting deploy of {'config': True} to skip
[15:54:21] <MirahezeLSBot>	 !log [@test3] finished deploy of {'config': True} to skip - SUCCESS in 1s
[15:54:23] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:54:27] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:54:52] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.81, 4.21, 3.93
[15:55:10] <MirahezeLSBot>	 !log [rhinos@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/runJobs.php --wiki=metawiki (END - exit=0)
[15:55:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:55:27] <MirahezeLSBot>	 !log [rhinos@mwtask1] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/runJobs.php (START)
[15:55:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.61, 3.46, 3.52
[15:55:36] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:57:06] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.07, 7.56, 6.44
[15:58:13] <MirahezeLSBot>	 !log [rhinos@mwtask1] sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/runJobs.php --type refreshLinks (START)
[15:58:17] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[15:59:05] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 4.29, 6.35, 6.13
[15:59:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.96, 4.08, 3.73
[16:01:29] <RhinosF1>	 !sre
[16:01:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.82, 3.93, 3.71
[16:01:54] <RhinosF1>	 cc Agent paladox 
[16:07:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 5.90, 4.06, 3.73
[16:08:34] <RhinosF1>	 Voidwalker: access?
[16:09:06] <Voidwalker>	 yup, for about 20 minutes
[16:09:25] <RhinosF1>	 Voidwalker: can you look at JQ logs
[16:09:42] <RhinosF1>	 template purges were very slow on meta
[16:10:12] <RhinosF1>	 1952 were showing waiting in grafana
[16:10:17] <RhinosF1>	 and it was climbing
[16:11:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.54, 3.99, 3.81
[16:13:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 3.76, 4.16, 3.91
[16:13:57] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 6.66, 6.88, 6.47
[16:14:59] <RhinosF1>	 Reception123: can you check imports are definately --no-updates
[16:15:11] <Reception123>	 can do, but that's what CosmicAlpha told me iirc
[16:15:26] <Voidwalker>	 hmm, looks like storage on graylog is getting rather low, not terribly relevant, but should still look at that shortly
[16:15:36] <Reception123>	 one of them is already done but can confirm it was --no-updates
[16:15:55] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.45, 6.21, 6.27
[16:15:56] <RhinosF1>	 import on mwtask via htop shows 2 images ones
[16:16:20] <Reception123>	 image ones? there's nothing running on any screens
[16:16:32] <Reception123>	 let me check htop
[16:16:44] <MirahezeBot>	 RhinosF1: answer ugochimobi about 2FA
[16:16:51] <Reception123>	 ah, John is probably running those then not in a screen
[16:16:55] <RhinosF1>	 ye
[16:17:02] <RhinosF1>	 shouldn't be an issue
[16:17:26] <Reception123>	 RhinosF1: that's weird because I don't see John logged into the server currently so how could he be running those and not be using a screen?
[16:17:33] <Reception123>	 is there another way to do that that I'm not aware of?
[16:17:37] <RhinosF1>	 Reception123: it's running as root
[16:17:51] <Reception123>	 ah ok that explains it
[16:18:07] <Voidwalker>	 I'm seeing some "redis server error: socket error on read socket" in logs
[16:18:40] <RhinosF1>	 Voidwalker: often
[16:18:50] <RhinosF1>	 redis crashing would slow jobs
[16:19:04] <RhinosF1>	 but it won't stop them unless it's constant enough
[16:19:17] <Voidwalker>	 two major spikes at 15:20 and 15:50 (should be UTC)
[16:19:27] <Voidwalker>	 however brief
[16:19:46] <Reception123>	 as far as I can see John's import started 2 hours and 33 mins ago
[16:19:57] <RhinosF1>	 Voidwalker: hmm
[16:20:02] <RhinosF1>	 i see 2 LGUP jobs
[16:20:06] <Voidwalker>	 there appears to be some bugs however
[16:20:15] <Voidwalker>	 I'm seeing at least two php errors
[16:20:22] <Voidwalker>	 one with timedmediahandler and one with pollny
[16:20:41] <Reception123>	 have we updated extensions recently?
[16:23:04] <RhinosF1>	 Reception123: run sudo service jobrunner status everywhere
[16:25:49] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 8.58, 7.29, 6.51
[16:27:48] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 5.75, 6.92, 6.48
[16:28:17] <MirahezeBot>	 ugochimobi: remind RhinosF1 about 2FA
[16:31:45] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.06, 6.27, 6.37
[16:43:00] <Reception123>	 https://www.irccloud.com/pastebin/Byz1ayOp/
[16:43:18] <Reception123>	 https://www.irccloud.com/pastebin/5HymAUYh/
[16:46:12] <RhinosF1>	 Reception123: hmm
[16:47:02] <Reception123>	 yeah..
[16:48:50] <RhinosF1>	 Not seeing anything obvious
[16:48:56] <RhinosF1>	 But backlog was big
[16:51:12] <RhinosF1>	 Reception123: my pc went off and. they jumped again
[16:51:23] <RhinosF1>	 Reception123: can you put em off in a screen
[16:51:27] <RhinosF1>	 runJobs.php 
[16:51:37] <RhinosF1>	 and one with --type refreshLinks
[16:51:48] <Reception123>	 ah you think I should try running manually on say mw11?
[16:52:17] <RhinosF1>	 Reception123: 100000000%
[16:52:22] <RhinosF1>	 but task
[16:52:50] <Reception123>	 !log  sudo -u www-data /usr/local/bin/foreachwikiindblist /srv/mediawiki/cache/databases.json /srv/mediawiki/w/maintenance/runJobs.php '--type=refreshLinks'
[16:52:56] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[16:53:03] <Reception123>	 so far most are empty
[16:53:08] <RhinosF1>	 will be
[16:53:47] <RhinosF1>	 https://phabricator.miraheze.org/T8296 for tracking
[16:53:48] <MirahezeBot>	 [url] ⚓ T8296 refreshLinks has huge backlog | phabricator.miraheze.org
[16:54:05] <RhinosF1>	 Reception123: run without --type. too
[16:54:09] <RhinosF1>	 in seperate screens
[16:56:58] <icinga-miraheze>	 PROBLEM - cp15 Current Load on cp15 is WARNING: WARNING - load average: 1.93, 1.86, 1.06
[16:57:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.54, 3.67, 3.94
[16:58:58] <icinga-miraheze>	 RECOVERY - cp15 Current Load on cp15 is OK: OK - load average: 0.69, 1.42, 0.99
[17:04:10] <RhinosF1>	 Hi CosmicAlpha
[17:07:00] <RhinosF1>	 Voidwalker: test3 & mwtask1 are bullseye so yes it's known
[17:09:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.05, 3.39, 3.54
[17:13:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.97, 3.60, 3.61
[17:17:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.22, 2.83, 3.28
[17:22:17] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.59, 6.70, 4.98
[17:24:17] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.92, 5.52, 4.75
[17:30:13] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.94, 3.53, 3.45
[17:35:45] <CosmicAlpha>	 Hi RhinosF1. What happened?
[17:35:48] <Voidwalker>	 yeah, I figured
[17:35:58] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.67, 3.61, 3.47
[17:37:53] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 3.23, 3.16, 3.31
[17:40:11] <Voidwalker>	 I'm going to be out for lunch for a bit, but I'll be available a bit later to investigate
[17:53:59] <RhinosF1>	 CosmicAlpha: job queue had a large refreshLinks backlog
[17:54:06] <RhinosF1>	 And it seemed to be growing
[17:54:16] <RhinosF1>	 Some on wikis with no activity
[17:54:26] <RhinosF1>	 Noticed because impact on meta
[18:08:40] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.15, 3.41, 3.25
[18:10:35] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.48, 3.85, 3.43
[18:12:30] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.04, 3.47, 3.33
[18:14:25] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.74, 3.34, 3.31
[18:21:10] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.26, 3.97, 3.59
[18:25:00] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.12, 3.56, 3.50
[18:30:45] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.26, 3.01, 3.31
[18:34:54] <ugochimobi>	 CosmicAlpha: any luck?
[18:35:44] <ugochimobi>	 RhinosF1 do you by any chance know how global Interface messages are edited?
[18:36:08] <RhinosF1>	 Any specific ones?
[18:37:22] <ugochimobi>	 Yeah, I'd show you the one I talked about yesterday later on
[18:37:23] <ugochimobi>	 But
[18:38:05] <ugochimobi>	 The MediaWiki:Right-edittemplateprotected needs to be "Edit protect template" 
[18:38:18] <ugochimobi>	 I think it's currently not globally created 
[18:39:10] <RhinosF1>	 That's not global
[18:39:16] <RhinosF1>	 Just create it locally
[18:40:14] <ugochimobi>	 Isn't it supposed to be Global? For wikis that uses it?
[18:40:14] <ugochimobi>	 Just as we have the review right but review is globally created and not all wikis uses it.
[18:40:24] <ugochimobi>	 So?... All the same
[18:40:46] <RhinosF1>	 No
[18:40:58] <ugochimobi>	 Okay
[18:41:03] <RhinosF1>	 The review rights are from an extension aren't they
[18:41:08] <RhinosF1>	 Not local modifications
[18:41:24] <ugochimobi>	 Okay.
[18:41:54] <ugochimobi>	 I got it.
[18:51:52] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.35, 3.61, 3.36
[18:59:03] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.46, 6.85, 5.67
[19:00:58] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.50, 5.90, 5.46
[19:03:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.49, 3.10, 3.30
[19:12:18] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.58, 3.58, 3.45
[19:16:08] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.10, 3.13, 3.33
[19:21:55] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.82, 3.41, 3.40
[19:23:50] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.72, 3.80, 3.53
[19:25:45] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.62, 3.38, 3.41
[19:29:32] <MirahezeLSBot>	 !log [universalomega@mwtask1] sudo -u www-data php /srv/mediawiki/w/maintenance/importDump.php --wiki=monstergirlencyclopediawiki /home/reception/monstergirlencyclopedia_pages_full.xml --username-prefix wikia:monstergirlencyclopedia --report 1 --no-updates --skip-to 853646 (START)
[19:29:46] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[19:30:53] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.71, 7.60, 6.35
[19:31:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.67, 2.84, 3.25
[19:32:47] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.15, 6.45, 6.08
[19:39:55] <RhinosF1>	 CosmicAlpha: haven't checked the job stats in a while and nothing from Reception123 but can we be careful with load pls?
[19:46:15] <majavah>	 RhinosF1: centralauth has nothing to do with 2fa enforcement, if that was what you were asking earlier
[19:46:40] <RhinosF1>	 majavah: didn't know if it screwed with sessions in a way that would confuse it
[19:47:10] <CosmicAlpha>	 RhinosF1: yeah, and also, I wonder if jobs was due to my refreshLinks scripts I've been running after imports? It failed yesterday after about 71,000 pages on hypotheticalhurricaneswiki. Need to restart but won't yet due to issue. But I was thinking it may be the cause. The script is also necessary though to get stats working if set to links, and also to update category members, and template transclusions (sometimes anyways) it 
[19:47:10] <CosmicAlpha>	 seems. If my fault, apologies, but does still need done.
[19:47:23] <RhinosF1>	 Or if the logged in with 2FA data would simply work for wikis CA did it's magic one
[19:47:34] <RhinosF1>	 CosmicAlpha: that's an interesting point
[19:47:45] <RhinosF1>	 On what wikis were you running?
[19:50:17] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.48, 6.53, 5.61
[19:50:19] <CosmicAlpha>	 RhinosF1: hypotheticalhurricaneswiki, and mgqwiki.
[19:50:28] <RhinosF1>	 I saw
[19:50:44] <RhinosF1>	 It on Batmanwikiwiki so I doubt it
[19:52:06] <CosmicAlpha>	 RhinosF1: Ah, its the only thing I could really think of why it couldn't happen now. Poor timing I guess.
[19:52:17] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.82, 6.98, 5.86
[19:52:18] <RhinosF1>	 Ye
[19:54:17] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.89, 6.42, 5.79
[20:00:13] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.87, 3.81, 3.51
[20:02:08] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.96, 4.22, 3.69
[20:05:58] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.24, 3.98, 3.74
[20:17:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.65, 2.69, 3.21
[20:28:13] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.34, 3.69, 3.49
[20:33:58] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.31, 3.90, 3.64
[20:37:48] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.20, 3.79, 3.67
[20:38:58] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.86, 6.68, 5.83
[20:40:52] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.93, 6.38, 5.82
[20:43:34] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.63, 3.71, 3.65
[20:45:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 2.60, 3.38, 3.54
[20:51:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.40, 3.78, 3.62
[20:53:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.03, 3.57, 3.57
[20:59:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.46, 2.86, 3.27
[21:06:34] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 24.42, 21.88, 19.22
[21:11:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.54, 3.55, 3.32
[21:13:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.98, 3.22, 3.22
[21:14:31] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 23.20, 23.63, 21.47
[21:15:38] <icinga-miraheze>	 PROBLEM - mw8 Current Load on mw8 is WARNING: WARNING - load average: 6.81, 6.33, 5.59
[21:16:30] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 28.53, 25.84, 22.54
[21:17:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 6.10, 5.69, 4.25
[21:17:38] <icinga-miraheze>	 RECOVERY - mw8 Current Load on mw8 is OK: OK - load average: 5.21, 5.97, 5.56
[21:23:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.45, 3.75, 3.51
[21:25:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.25, 3.24, 3.36
[21:30:36] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 7.02, 7.46, 6.62
[21:33:31] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.68, 3.31, 3.24
[21:34:25] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.27, 6.44, 6.40
[21:35:31] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.69, 3.15, 3.20
[21:41:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.41, 4.45, 5.74
[21:42:30] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 7.03, 7.65, 6.24
[21:44:29] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 3.63, 6.16, 5.86
[21:45:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is CRITICAL: CRITICAL - load average: 8.24, 5.52, 5.84
[21:47:37] <icinga-miraheze>	 PROBLEM - gluster3 Current Load on gluster3 is WARNING: WARNING - load average: 3.30, 4.51, 5.43
[21:51:37] <icinga-miraheze>	 RECOVERY - gluster3 Current Load on gluster3 is OK: OK - load average: 2.69, 3.87, 4.98
[21:54:17] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 14.32, 18.42, 23.06
[21:56:17] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is CRITICAL: CRITICAL - load average: 25.98, 21.55, 23.66
[22:00:18] <icinga-miraheze>	 PROBLEM - cloud4 Current Load on cloud4 is WARNING: WARNING - load average: 20.93, 21.76, 23.39
[22:10:17] <icinga-miraheze>	 RECOVERY - cloud4 Current Load on cloud4 is OK: OK - load average: 13.24, 15.83, 19.55
[22:21:06] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is CRITICAL: CRITICAL - load average: 4.48, 3.42, 3.09
[22:23:01] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.43, 3.13, 3.03
[23:00:01] <MirahezeLSBot>	 !log [@test3] starting deploy of {'l10nupdate': True} to skip
[23:00:05] <MirahezeLSBot>	 !log [@mw11] starting deploy of {'l10nupdate': True} to all
[23:00:10] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:00:14] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:04:00] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is CRITICAL: CRITICAL - load average: 20.40, 9.34, 5.59
[23:04:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 13.11, 8.80, 6.04
[23:05:45] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 8.50, 7.94, 5.84
[23:05:53] <MirahezeLSBot>	 !log [@mw11] finished deploy of {'l10nupdate': True} to all - FAIL: [35072, 0, 0, 0, 0, 0, 0, 0, 0] in 348s
[23:05:57] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:07:44] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is WARNING: WARNING - load average: 6.01, 7.15, 5.80
[23:08:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 5.79, 7.50, 6.17
[23:09:42] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 4.24, 6.07, 5.56
[23:09:59] <icinga-miraheze>	 PROBLEM - mw11 Current Load on mw11 is WARNING: WARNING - load average: 4.32, 7.17, 6.06
[23:10:25] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 4.78, 6.66, 6.03
[23:11:59] <icinga-miraheze>	 RECOVERY - mw11 Current Load on mw11 is OK: OK - load average: 4.80, 6.57, 5.98
[23:14:01] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 4.26, 7.09, 5.81
[23:15:59] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 3.53, 5.88, 5.52
[23:17:15] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 12.17, 8.50, 6.88
[23:21:11] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.70, 3.53, 3.16
[23:21:33] <icinga-miraheze>	 PROBLEM - mw9 Current Load on mw9 is CRITICAL: CRITICAL - load average: 9.21, 7.12, 5.98
[23:22:59] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.07, 6.85, 6.80
[23:23:31] <icinga-miraheze>	 RECOVERY - mw9 Current Load on mw9 is OK: OK - load average: 5.18, 6.43, 5.86
[23:23:53] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is CRITICAL: CRITICAL - load average: 13.39, 9.98, 7.33
[23:24:53] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 3.55, 5.84, 6.44
[23:25:02] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 2.78, 3.32, 3.17
[23:27:50] <icinga-miraheze>	 PROBLEM - mw10 Current Load on mw10 is WARNING: WARNING - load average: 7.49, 7.75, 6.94
[23:30:04] <icinga-miraheze>	 PROBLEM - mw12 APT on mw12 is CRITICAL: CHECK_NRPE STATE CRITICAL: Socket timeout after 10 seconds.
[23:30:29] <MirahezeLSBot>	 !log [@test3] finished deploy of {'l10nupdate': True} to skip - SUCCESS in 1828s
[23:30:33] <MirahezeLogbot>	 Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log
[23:30:38] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is CRITICAL: CRITICAL - load average: 10.70, 9.87, 7.96
[23:31:48] <icinga-miraheze>	 RECOVERY - mw10 Current Load on mw10 is OK: OK - load average: 5.07, 6.24, 6.50
[23:32:05] <icinga-miraheze>	 RECOVERY - mw12 APT on mw12 is OK: APT OK: 1 packages available for upgrade (0 critical updates).
[23:32:32] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 4.70, 7.91, 7.46
[23:32:43] <icinga-miraheze>	 PROBLEM - mon2 Current Load on mon2 is WARNING: WARNING - load average: 3.32, 3.58, 3.34
[23:34:38] <icinga-miraheze>	 RECOVERY - mon2 Current Load on mon2 is OK: OK - load average: 1.77, 2.93, 3.13
[23:38:25] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 5.27, 6.02, 6.72
[23:42:25] <icinga-miraheze>	 PROBLEM - mw12 Current Load on mw12 is WARNING: WARNING - load average: 6.11, 6.86, 6.95
[23:46:25] <icinga-miraheze>	 RECOVERY - mw12 Current Load on mw12 is OK: OK - load average: 6.79, 6.52, 6.77