[00:00:00] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.42, 3.21, 2.92 [00:00:40] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 1.84, 1.82 [00:01:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.39, 3.41, 3.48 [00:01:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.63, 3.04, 2.89 [00:02:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.76, 1.82, 1.81 [00:03:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.34, 3.82, 3.62 [00:05:53] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.36, 3.88, 3.27 [00:06:58] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.43, 3.64, 3.28 [00:07:23] Hispano76: is https://meta.miraheze.org/wiki/User:Ucronista76 by chance you? [00:07:28] [url] User:Ucronista76 - Miraheze Meta | meta.miraheze.org [00:08:04] might not be around at this hour [00:08:41] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [00:08:41] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [00:08:55] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.15, 3.25, 3.19 [00:09:49] MacFan4000 message private! [00:09:49] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.98, 3.37, 3.19 [00:11:28] i think you'd still be able to message from Hispano76 irc connection, as it is still online [00:11:49] MacFan4000 ? [00:12:36] MacFan4000 !! [00:12:36] PROBLEM - db101 Current Load on db101 is WARNING: WARNING - load average: 7.64, 6.28, 4.81 [00:12:48] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.37, 3.58, 3.37 [00:13:36] stop pinging me please [00:13:52] ._. [00:14:10] you received my message? [00:14:36] RECOVERY - db101 Current Load on db101 is OK: OK - load average: 6.44, 6.36, 5.03 [00:14:39] yes, i choose not to reply [00:16:04] MacFan4000 jaja, chistoso... entra a #wikipedia-es-biblios y pide la confirmación que tanto deseas [00:16:13] y no, ya no hablaré en inglés... [00:16:20] .op [00:16:20] porque lo elijo :D [00:16:20] Attempting to OP... [00:16:27] Oye, comportate [00:16:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.30, 1.95, 1.85 [00:16:43] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.87, 3.40, 3.37 [00:20:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.09, 9.80, 9.12 [00:20:36] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.89, 3.95, 3.63 [00:21:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.39, 3.67, 3.99 [00:23:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.06, 3.72, 3.96 [00:24:31] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.76, 2.94, 3.30 [00:24:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.84, 1.97, 1.94 [00:25:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.48, 3.84 [00:30:15] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/Moderation-306a51d [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/a9f663dbb08f [00:30:16] [02miraheze/mediawiki] 07dependabot[bot] 03a9f663d - Bump extensions/Moderation from `50b78c6` to `306a51d` [00:30:18] [02mediawiki] 07dependabot[bot] opened pull request 03#6865: Bump extensions/Moderation from `50b78c6` to `306a51d` - 13https://github.com/miraheze/mediawiki/pull/6865 [00:30:19] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/Moderation-306a51d - 13https://github.com/miraheze/mediawiki [00:30:22] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/Quiz-9dc289b [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/f065350b1db3 [00:30:23] [02miraheze/mediawiki] 07dependabot[bot] 03f065350 - Bump extensions/Quiz from `1a007d7` to `9dc289b` [00:30:25] [02mediawiki] 07dependabot[bot] opened pull request 03#6866: Bump extensions/Quiz from `1a007d7` to `9dc289b` - 13https://github.com/miraheze/mediawiki/pull/6866 [00:30:26] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/Quiz-9dc289b - 13https://github.com/miraheze/mediawiki [00:30:31] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/skins/Cosmos-e94bacf [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/7e813bad8f38 [00:30:33] [02miraheze/mediawiki] 07dependabot[bot] 037e813ba - Bump skins/Cosmos from `1a69692` to `e94bacf` [00:30:34] [02mediawiki] 07dependabot[bot] opened pull request 03#6867: Bump skins/Cosmos from `1a69692` to `e94bacf` - 13https://github.com/miraheze/mediawiki/pull/6867 [00:30:36] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/skins/Cosmos-e94bacf - 13https://github.com/miraheze/mediawiki [00:30:40] [02mediawiki] 07github-actions[bot] labeled pull request 03#6865: Bump extensions/Moderation from `50b78c6` to `306a51d` - 13https://github.com/miraheze/mediawiki/pull/6865 [00:30:41] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/RottenLinks-a5c783c [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/c48d91501b66 [00:30:43] [02miraheze/mediawiki] 07dependabot[bot] 03c48d915 - Bump extensions/RottenLinks from `3c4a633` to `a5c783c` [00:30:44] [02mediawiki] 07dependabot[bot] opened pull request 03#6868: Bump extensions/RottenLinks from `3c4a633` to `a5c783c` - 13https://github.com/miraheze/mediawiki/pull/6868 [00:30:46] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/RottenLinks-a5c783c - 13https://github.com/miraheze/mediawiki [00:30:47] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/SandboxLink-5078a5b [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/45e7d322f75a [00:30:49] [02miraheze/mediawiki] 07dependabot[bot] 0345e7d32 - Bump extensions/SandboxLink from `4b96d2e` to `5078a5b` [00:30:50] [02mediawiki] 07dependabot[bot] opened pull request 03#6869: Bump extensions/SandboxLink from `4b96d2e` to `5078a5b` - 13https://github.com/miraheze/mediawiki/pull/6869 [00:30:52] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/SandboxLink-5078a5b - 13https://github.com/miraheze/mediawiki [00:30:53] [02mediawiki] 07github-actions[bot] labeled pull request 03#6866: Bump extensions/Quiz from `1a007d7` to `9dc289b` - 13https://github.com/miraheze/mediawiki/pull/6866 [00:30:55] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/Josa-d6ab56e [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/6a959b715432 [00:30:56] [02miraheze/mediawiki] 07dependabot[bot] 036a959b7 - Bump extensions/Josa from `e93d1ea` to `d6ab56e` [00:30:58] [02mediawiki] 07dependabot[bot] opened pull request 03#6870: Bump extensions/Josa from `e93d1ea` to `d6ab56e` - 13https://github.com/miraheze/mediawiki/pull/6870 [00:30:59] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/Josa-d6ab56e - 13https://github.com/miraheze/mediawiki [00:31:01] [02mediawiki] 07github-actions[bot] labeled pull request 03#6867: Bump skins/Cosmos from `1a69692` to `e94bacf` - 13https://github.com/miraheze/mediawiki/pull/6867 [00:31:02] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/skins/Citizen-fae6062 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/af01ade722a0 [00:31:04] [02miraheze/mediawiki] 07dependabot[bot] 03af01ade - Bump skins/Citizen from `0f38149` to `fae6062` [00:31:05] [02mediawiki] 07dependabot[bot] opened pull request 03#6871: Bump skins/Citizen from `0f38149` to `fae6062` - 13https://github.com/miraheze/mediawiki/pull/6871 [00:31:07] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/skins/Citizen-fae6062 - 13https://github.com/miraheze/mediawiki [00:31:09] [02mediawiki] 07github-actions[bot] labeled pull request 03#6869: Bump extensions/SandboxLink from `4b96d2e` to `5078a5b` - 13https://github.com/miraheze/mediawiki/pull/6869 [00:31:10] [02mediawiki] 07github-actions[bot] labeled pull request 03#6870: Bump extensions/Josa from `e93d1ea` to `d6ab56e` - 13https://github.com/miraheze/mediawiki/pull/6870 [00:31:12] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/skins/Evelution-ddc4b4b [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/d3fce5c0f97a [00:31:13] [02miraheze/mediawiki] 07dependabot[bot] 03d3fce5c - Bump skins/Evelution from `5fdff8f` to `ddc4b4b` [00:31:15] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/skins/Evelution-ddc4b4b - 13https://github.com/miraheze/mediawiki [00:31:16] [02mediawiki] 07dependabot[bot] opened pull request 03#6872: Bump skins/Evelution from `5fdff8f` to `ddc4b4b` - 13https://github.com/miraheze/mediawiki/pull/6872 [00:31:18] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/Maps-dbc0597 [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/9a21db872457 [00:31:19] [02miraheze/mediawiki] 07dependabot[bot] 039a21db8 - Bump extensions/Maps from `85d18cb` to `dbc0597` [00:31:21] [02mediawiki] 07dependabot[bot] opened pull request 03#6873: Bump extensions/Maps from `85d18cb` to `dbc0597` - 13https://github.com/miraheze/mediawiki/pull/6873 [00:31:22] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/Maps-dbc0597 - 13https://github.com/miraheze/mediawiki [00:31:24] [02miraheze/mediawiki] 07dependabot[bot] pushed 031 commit to 03dependabot/submodules/REL1_38/extensions/TabberNeue-b9eda4c [+0/-0/±1] 13https://github.com/miraheze/mediawiki/commit/30551e300069 [00:31:25] [02miraheze/mediawiki] 07dependabot[bot] 0330551e3 - Bump extensions/TabberNeue from `e642364` to `b9eda4c` [00:31:27] [02mediawiki] 07dependabot[bot] opened pull request 03#6874: Bump extensions/TabberNeue from `e642364` to `b9eda4c` - 13https://github.com/miraheze/mediawiki/pull/6874 [00:31:28] [02mediawiki] 07dependabot[bot] created branch 03dependabot/submodules/REL1_38/extensions/TabberNeue-b9eda4c - 13https://github.com/miraheze/mediawiki [00:31:30] [02mediawiki] 07github-actions[bot] labeled pull request 03#6871: Bump skins/Citizen from `0f38149` to `fae6062` - 13https://github.com/miraheze/mediawiki/pull/6871 [00:31:31] [02mediawiki] 07github-actions[bot] labeled pull request 03#6871: Bump skins/Citizen from `0f38149` to `fae6062` - 13https://github.com/miraheze/mediawiki/pull/6871 [00:31:37] [02mediawiki] 07github-actions[bot] labeled pull request 03#6872: Bump skins/Evelution from `5fdff8f` to `ddc4b4b` - 13https://github.com/miraheze/mediawiki/pull/6872 [00:31:43] [02mediawiki] 07github-actions[bot] labeled pull request 03#6873: Bump extensions/Maps from `85d18cb` to `dbc0597` - 13https://github.com/miraheze/mediawiki/pull/6873 [00:31:45] [02mediawiki] 07github-actions[bot] labeled pull request 03#6873: Bump extensions/Maps from `85d18cb` to `dbc0597` - 13https://github.com/miraheze/mediawiki/pull/6873 [00:31:46] [02mediawiki] 07github-actions[bot] labeled pull request 03#6874: Bump extensions/TabberNeue from `e642364` to `b9eda4c` - 13https://github.com/miraheze/mediawiki/pull/6874 [00:31:48] [02mediawiki] 07github-actions[bot] labeled pull request 03#6874: Bump extensions/TabberNeue from `e642364` to `b9eda4c` - 13https://github.com/miraheze/mediawiki/pull/6874 [00:37:11] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.83, 3.68, 3.36 [00:39:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.86, 4.51, 3.70 [00:39:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.79, 5.25, 4.27 [00:40:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [00:40:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.10, 1.39, 1.65 [00:41:22] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.54, 3.47, 3.26 [00:42:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.88, 10.08, 10.05 [00:43:04] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.92, 3.86, 3.60 [00:43:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.47, 3.79, 3.39 [00:45:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.46, 3.26, 3.24 [00:48:56] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 3.11, 3.26, 3.40 [00:50:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.11, 1.99, 1.82 [00:51:10] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.83, 10.70, 10.28 [00:51:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.52, 3.88, 4.00 [00:52:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.19, 1.70, 1.73 [00:54:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.12, 1.52, 1.66 [00:56:41] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.49, 4.12, 3.64 [00:57:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.13, 4.15, 4.06 [00:58:14] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.70, 3.41, 3.30 [01:00:12] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.50, 3.06, 3.18 [01:02:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:02:59] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.37, 11.24, 10.65 [01:04:32] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.03, 3.39, 3.60 [01:04:58] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.78, 10.96, 10.62 [01:07:16] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [01:10:52] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.86, 9.31, 10.00 [01:11:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.31, 3.63, 3.98 [01:12:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:12:22] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.29, 3.69, 3.59 [01:13:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 3.62, 3.90, 4.05 [01:14:19] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.86, 3.54, 3.54 [01:15:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.74, 3.50, 3.89 [01:16:17] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.45, 3.10, 3.37 [01:19:42] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.39, 1.67, 1.18 [01:20:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:20:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.18, 3.42, 3.42 [01:20:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.24, 1.89, 1.61 [01:20:42] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.91, 10.51, 10.01 [01:21:40] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.82, 1.81, 1.30 [01:22:07] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.69, 3.44, 3.42 [01:22:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.83, 1.87, 1.64 [01:22:41] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.24, 10.12, 9.94 [01:23:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.01, 3.95, 3.92 [01:23:40] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.33, 1.57, 1.27 [01:25:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.11, 3.65, 3.82 [01:26:36] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 12.12, 10.95, 10.28 [01:26:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.64, 1.61 [01:28:00] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.46, 3.28, 3.40 [01:28:34] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.00, 10.47, 10.21 [01:29:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.59, 3.89, 3.86 [01:30:32] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.55, 9.54, 9.90 [01:31:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.50, 3.49, 3.73 [01:35:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:35:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.80, 3.85, 3.79 [01:37:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.37, 3.77, 3.78 [01:37:42] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.45, 3.69, 3.48 [01:39:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.36, 4.08, 3.89 [01:39:40] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.94, 3.38, 3.39 [01:42:18] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.30, 10.01, 9.88 [01:43:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.89, 3.74, 3.80 [01:44:17] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.38, 9.20, 9.61 [01:44:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.97, 1.67, 1.58 [01:46:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.24, 1.82, 1.65 [01:48:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:53:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [01:58:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.90, 1.98, 1.90 [02:00:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.75, 3.23, 2.94 [02:00:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.52, 10.40, 10.08 [02:00:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:00:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 1.96, 2.02, 1.93 [02:02:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.30, 3.19, 2.96 [02:02:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.54, 10.13, 10.03 [02:02:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.85, 1.96, 1.91 [02:03:05] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.54, 1.86, 1.61 [02:03:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.18, 3.81, 3.67 [02:05:03] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.99, 1.53, 1.52 [02:05:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:06:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.64, 10.93, 10.36 [02:07:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.02, 3.65, 3.65 [02:10:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.26, 10.07, 10.17 [02:11:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.26, 2.89, 3.33 [02:14:09] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.22, 3.52, 3.10 [02:14:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.12, 1.88, 1.89 [02:15:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.93, 4.39, 3.87 [02:15:56] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.22, 3.98, 3.33 [02:17:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.26, 3.61, 3.27 [02:18:04] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.23, 3.05, 3.02 [02:19:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.75, 3.61, 3.68 [02:21:51] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.40, 3.57, 3.31 [02:22:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.14, 1.84, 1.92 [02:23:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.02, 3.86, 3.78 [02:23:49] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.95, 3.66, 3.37 [02:25:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.75, 3.74, 3.73 [02:25:47] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.87, 3.31, 3.27 [02:28:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.14, 1.32, 1.65 [02:33:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.29, 2.75, 3.27 [02:41:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.74, 3.56, 3.45 [02:45:26] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.71, 3.43, 3.17 [02:45:37] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.67, 4.08, 3.68 [02:47:24] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.26, 3.07, 3.08 [02:47:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.57, 3.58, 3.55 [02:48:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.10, 1.63, 1.44 [02:52:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.27, 1.58, 1.48 [02:53:47] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.70, 10.19, 9.41 [02:55:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.37, 3.13, 3.38 [02:55:45] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.23, 9.47, 9.25 [02:55:59] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.41, 1.72, 1.50 [02:56:02] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [02:57:57] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.66, 1.68, 1.51 [03:05:56] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 5.18, 3.92, 3.35 [03:06:02] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:07:53] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.31, 3.27, 3.18 [03:17:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:19:17] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.53, 1.83, 1.59 [03:19:36] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.34, 3.64, 3.22 [03:20:00] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.93, 3.93, 3.41 [03:20:11] PROBLEM - cp31 Current Load on cp31 is CRITICAL: CRITICAL - load average: 2.06, 1.39, 1.11 [03:20:12] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.27, 3.09 [03:21:20] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.44, 10.05, 9.26 [03:21:33] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.96, 3.37, 3.17 [03:22:08] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.10, 1.22, 1.07 [03:22:10] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.31, 3.35, 3.14 [03:23:09] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.49, 1.78, 1.63 [03:23:19] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 9.00, 9.66, 9.22 [03:23:50] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 6.05, 4.83, 3.86 [03:28:03] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 6.20, 4.64, 3.68 [03:29:22] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.61, 4.23, 3.55 [03:30:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.45, 10.79, 9.90 [03:31:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.42, 3.92, 3.52 [03:32:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.37, 10.13, 9.78 [03:33:22] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.87, 4.18, 3.66 [03:37:54] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.68, 3.81, 3.80 [03:39:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.04, 3.55, 3.58 [03:41:22] PROBLEM - gluster111 Current Load on gluster111 is CRITICAL: CRITICAL - load average: 4.26, 3.77, 3.65 [03:42:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:45:22] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 2.34, 3.43, 3.57 [03:46:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.04, 1.88, 1.79 [03:47:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 2.42, 3.41, 3.98 [03:47:45] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.98, 2.86, 3.40 [03:49:22] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 2.02, 2.68, 3.23 [03:51:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [03:54:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.69, 1.91, 1.89 [04:01:29] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.32, 1.71, 1.37 [04:01:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.23, 2.59, 3.25 [04:03:27] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.80, 1.42, 1.31 [04:06:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.08, 1.44, 1.68 [04:11:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [04:20:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.39, 1.83, 1.63 [04:22:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.33, 1.61, 1.57 [04:28:24] PROBLEM - cp31 Current Load on cp31 is WARNING: WARNING - load average: 1.46, 1.79, 1.36 [04:30:22] RECOVERY - cp31 Current Load on cp31 is OK: OK - load average: 1.23, 1.54, 1.31 [04:34:08] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.11, 3.38, 2.89 [04:35:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.53, 3.71, 3.39 [04:35:45] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.26, 1.89, 1.54 [04:36:06] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.33, 3.03, 2.83 [04:37:43] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 1.22, 1.65, 1.50 [04:39:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.29, 3.38, 3.32 [04:41:59] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.52, 3.07, 2.86 [04:43:40] PROBLEM - cp30 Current Load on cp30 is WARNING: WARNING - load average: 1.79, 1.87, 1.65 [04:43:58] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 3.11, 3.09, 2.90 [04:44:13] PROBLEM - mw102 Current Load on mw102 is WARNING: WARNING - load average: 11.26, 8.81, 7.72 [04:45:37] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.14, 3.50, 3.40 [04:45:40] RECOVERY - cp30 Current Load on cp30 is OK: OK - load average: 0.86, 1.52, 1.55 [04:46:12] RECOVERY - mw102 Current Load on mw102 is OK: OK - load average: 7.62, 8.18, 7.62 [04:47:37] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 3.13, 3.31, 3.34 [04:48:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.19, 1.78, 1.53 [04:50:17] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 16.59, 10.39, 8.72 [04:52:16] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 7.15, 9.14, 8.49 [04:52:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.55, 1.77, 1.60 [04:54:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.38, 1.64, 1.57 [05:16:36] alerting : [FIRING:1] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:18:26] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.58, 3.44, 3.15 [05:18:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.36, 1.98, 1.73 [05:20:20] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.71, 3.22, 3.11 [05:24:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.84, 2.00, 1.84 [05:26:36] ok : [RESOLVED] (!sre High Job Queue Backlog yes mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:28:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.06, 2.06, 1.91 [05:30:32] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:30:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.89, 1.97, 1.90 [05:35:32] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [05:41:22] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.72, 3.78, 3.13 [05:43:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 1.97, 3.06, 2.94 [05:48:16] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.28, 3.45, 3.18 [05:48:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.51, 1.99, 1.88 [05:49:21] PROBLEM - storytime.jdstroy.cf - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'storytime.jdstroy.cf' expires in 15 day(s) (Wed 18 May 2022 05:45:45 GMT +0000). [05:50:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.15, 3.00, 3.05 [05:52:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.42, 1.89, 1.88 [05:56:33] PROBLEM - dnd.bellinrattin.it - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'dnd.bellinrattin.it' expires in 15 day(s) (Wed 18 May 2022 05:38:27 GMT +0000). [05:57:24] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/008b7c55d764...e7375de2f27b [05:57:25] [url] Comparing 008b7c55d764...e7375de2f27b · miraheze/ssl · GitHub | github.com [05:57:25] [02miraheze/ssl] 07MirahezeSSLBot 03e7375de - Bot: Update SSL cert for storytime.jdstroy.cf [05:58:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 0.97, 1.34, 1.63 [06:03:29] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/e7375de2f27b...ce8d937d756b [06:03:30] [url] Comparing e7375de2f27b...ce8d937d756b · miraheze/ssl · GitHub | github.com [06:03:31] [02miraheze/ssl] 07MirahezeSSLBot 03ce8d937 - Bot: Update SSL cert for dnd.bellinrattin.it [06:06:47] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 11.25, 10.19, 8.94 [06:08:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.61, 2.06, 1.76 [06:12:42] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 10.18, 10.09, 9.29 [06:14:09] PROBLEM - arrieretoile.fr - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'arrieretoile.fr' expires in 15 day(s) (Wed 18 May 2022 05:42:51 GMT +0000). [06:16:11] PROBLEM - wiki.sketch.town - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.sketch.town' expires in 15 day(s) (Wed 18 May 2022 05:47:06 GMT +0000). [06:21:26] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/ce8d937d756b...37cf31059132 [06:21:27] [url] Comparing ce8d937d756b...37cf31059132 · miraheze/ssl · GitHub | github.com [06:21:28] [02miraheze/ssl] 07MirahezeSSLBot 0337cf310 - Bot: Update SSL cert for arrieretoile.fr [06:25:42] PROBLEM - cloud11 Puppet on cloud11 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 3 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ulogd2] [06:25:59] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/37cf31059132...5510dddb52d7 [06:25:59] [url] Comparing 37cf31059132...5510dddb52d7 · miraheze/ssl · GitHub | github.com [06:26:00] [02miraheze/ssl] 07MirahezeSSLBot 035510ddd - Bot: Update SSL cert for wiki.sketch.town [06:28:14] PROBLEM - gluster111 Current Load on gluster111 is WARNING: WARNING - load average: 3.14, 3.43, 3.01 [06:32:09] RECOVERY - gluster111 Current Load on gluster111 is OK: OK - load average: 1.88, 2.91, 2.91 [06:37:18] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 73, in check_records nameserversans = dns_resolver.resolve(root_domain, 'NS') File "/usr/l [06:37:18] n3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query bellinrattin.it. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [06:48:03] RECOVERY - storytime.jdstroy.cf - LetsEncrypt on sslhost is OK: OK - Certificate 'storytime.jdstroy.cf' will expire on Sun 31 Jul 2022 04:57:19 GMT +0000. [06:51:42] RECOVERY - cloud11 Puppet on cloud11 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures [06:54:37] RECOVERY - dnd.bellinrattin.it - LetsEncrypt on sslhost is OK: OK - Certificate 'dnd.bellinrattin.it' will expire on Sun 31 Jul 2022 05:03:24 GMT +0000. [07:06:35] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp21.miraheze.org - CNAME OK [07:13:42] RECOVERY - arrieretoile.fr - LetsEncrypt on sslhost is OK: OK - Certificate 'arrieretoile.fr' will expire on Sun 31 Jul 2022 05:21:21 GMT +0000. [07:15:09] Reception123: can you restart MirahezeRC? [07:15:22] Feeds are down for the past ~8 hours or so [07:15:46] Oh wow, yeah sure [07:15:54] RECOVERY - wiki.sketch.town - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.sketch.town' will expire on Sun 31 Jul 2022 05:25:53 GMT +0000. [07:15:55] Just a sec [07:16:55] Reception123, thanks :) [07:17:06] I wish we had a `bot-admin` access level :P [07:17:10] I'd apply for that [07:20:49] Reception123: looks like MirahezeRC disconnected only 3 hours ago, not 8 hours ago as first thought, due to a net split and never reconnected automatically [07:21:19] A net split that long is rare [07:21:32] RhinosF1, yeah, very rare [07:22:16] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 10.86, 9.62, 8.52 [07:22:27] We don't need to do an IR for an SRE-operated IRC bot being down though, right? [07:23:16] !log restarted mirahezerc bot [07:23:23] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [07:23:30] dmehus: I wouldn't think so no, it's not a 'service' per se [07:23:43] and even if we did, it's 100% not preventable or our fault [07:23:48] so an IR wouldn't be of use [07:24:32] It wasn't us that went down [07:24:33] Reception123, yeah [07:24:47] and thanks for restarting :) [07:24:57] no problem [07:28:17] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.82, 10.06, 9.18 [07:39:13] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 4.96, 3.67, 2.98 [07:41:08] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.75, 3.25, 2.90 [08:04:16] PROBLEM - gluster101 Current Load on gluster101 is CRITICAL: CRITICAL - load average: 5.14, 3.62, 2.98 [08:05:23] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.51, 3.32, 2.58 [08:06:11] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 2.87, 3.31, 2.94 [08:07:22] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.50, 2.93, 2.54 [08:24:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:29:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [08:45:54] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.67, 2.96, 2.71 [08:47:49] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.68, 2.41, 2.53 [08:56:35] PROBLEM - mw111 Current Load on mw111 is CRITICAL: CRITICAL - load average: 14.39, 11.51, 9.02 [08:59:16] PROBLEM - mw112 Current Load on mw112 is WARNING: WARNING - load average: 10.58, 9.27, 7.86 [09:01:16] RECOVERY - mw112 Current Load on mw112 is OK: OK - load average: 6.59, 8.27, 7.68 [09:01:30] PROBLEM - mw101 Current Load on mw101 is WARNING: WARNING - load average: 11.03, 10.22, 8.25 [09:02:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:02:30] PROBLEM - mw111 Current Load on mw111 is WARNING: WARNING - load average: 9.40, 11.62, 10.05 [09:03:30] RECOVERY - mw101 Current Load on mw101 is OK: OK - load average: 7.08, 9.20, 8.13 [09:07:01] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [09:07:50] PROBLEM - dnd.bellinrattin.it - reverse DNS on sslhost is WARNING: Traceback (most recent call last): File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 155, in main() File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 136, in main records = check_records(args.hostname) File "/usr/lib/nagios/plugins/check_reverse_dns.py", line 86, in check_records cname = str(dns_resolver.resolve(hostname, 'CNAME')[0]) File "/usr/li [09:07:50] 3/dist-packages/dns/resolver.py", line 1040, in resolve (nameserver, port, tcp, backoff) = resolution.next_nameserver() File "/usr/lib/python3/dist-packages/dns/resolver.py", line 598, in next_nameserver raise NoNameservers(request=self.request, errors=self.errors)dns.resolver.NoNameservers: All nameservers failed to answer the query dnd.bellinrattin.it. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:08:37] [02puppet] 07RhinosF1 opened pull request 03#2524: users: add agent to the internal network - 13https://github.com/miraheze/puppet/pull/2524 [09:08:37] [url] Page not found · GitHub · GitHub | github.com [09:09:50] Reception123: ^ [09:12:22] RECOVERY - mw111 Current Load on mw111 is OK: OK - load average: 8.86, 10.11, 10.04 [09:15:04] Reception123, RhinosF1, or CosmicAlpha, can either of you please run `mwscript extensions/SemanticMediaWiki/setupStore.php` on all MediaWiki servers on `ruletheseaswiki`? Thanks. [09:16:05] dmehus: can i please have a reply to my pm by the time I'm done [09:16:05] [02puppet] 07JohnFLewis closed pull request 03#2524: users: add agent to the internal network - 13https://github.com/miraheze/puppet/pull/2524 [09:16:07] [url] Page not found · GitHub · GitHub | github.com [09:16:07] [02miraheze/puppet] 07JohnFLewis pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/669f26eb8967...61d6122ca6eb [09:16:08] [url] Comparing 669f26eb8967...61d6122ca6eb · miraheze/puppet · GitHub | github.com [09:16:08] [02miraheze/puppet] 07RhinosF1 0361d6122 - users: add agent to the internal network (#2524) [09:17:39] RhinosF1, sure, and thanks :) [09:22:58] dmehus: has it been enabled [09:30:49] ok it's working now [09:33:17] !log sudo -u www-data php /srv/mediawiki/w/extensions/SemanticMediaWiki/maintenance/setupStore.php --wiki=ruletheseaswiki (END - exit=0) on mw* [09:33:21] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:33:49] Reception123: server log bot is dead [09:40:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 0.99, 1.20, 1.90 [09:41:05] PROBLEM - cp21 Current Load on cp21 is CRITICAL: CRITICAL - load average: 3.23, 3.79, 2.25 [09:42:19] !log restart LSBot [09:42:24] Logged the message at https://meta.miraheze.org/wiki/Tech:Server_admin_log [09:46:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.10, 1.55, 1.81 [09:46:54] PROBLEM - cp21 Current Load on cp21 is WARNING: WARNING - load average: 0.45, 1.63, 1.75 [09:48:04] PROBLEM - gluster101 Current Load on gluster101 is WARNING: WARNING - load average: 3.79, 3.22, 2.75 [09:48:50] RECOVERY - cp21 Current Load on cp21 is OK: OK - load average: 0.68, 1.37, 1.64 [09:50:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.66, 1.76, 1.85 [09:51:00] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 4.87, 4.03, 2.94 [09:51:53] RECOVERY - gluster101 Current Load on gluster101 is OK: OK - load average: 1.81, 2.85, 2.73 [09:52:58] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.13, 3.62, 2.92 [09:54:56] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.17, 3.05, 2.79 [09:56:38] RECOVERY - test101 Current Load on test101 is OK: OK - load average: 1.40, 1.51, 1.70 [10:01:48] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 2.54, 3.47, 3.13 [10:03:46] RECOVERY - gluster121 Current Load on gluster121 is OK: OK - load average: 2.76, 3.28, 3.10 [10:09:31] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:12:15] RhinosF1, thanks [10:12:28] JohnLewis, thanks for restarting MirahezeLSBot [10:14:31] ok : [RESOLVED] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:20:38] PROBLEM - test101 Current Load on test101 is CRITICAL: CRITICAL - load average: 2.37, 1.97, 1.72 [10:22:38] PROBLEM - test101 Current Load on test101 is WARNING: WARNING - load average: 1.72, 1.83, 1.71 [10:24:25] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.31, 3.71, 3.29 [10:26:01] alerting : [FIRING:1] (PHP-FPM Worker Usage High mediawiki) https://grafana.miraheze.org/d/dsHv5-4nz/mediawiki [10:26:23] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.12, 3.88, 3.38 [10:30:20] PROBLEM - gluster121 Current Load on gluster121 is WARNING: WARNING - load average: 3.12, 3.80, 3.48 [10:35:42] RECOVERY - dnd.bellinrattin.it - reverse DNS on sslhost is OK: SSL OK - dnd.bellinrattin.it reverse DNS resolves to cp20.miraheze.org - CNAME OK [10:36:14] PROBLEM - gluster121 Current Load on gluster121 is CRITICAL: CRITICAL - load average: 5.55, 4.07, 3.68 [10:40:11]