[00:05:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 8.19, 4.51, 2.45 [00:49:18] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:18:37] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp24.miraheze.org - CNAME OK [01:19:01] PROBLEM - ns1 NTP time on ns1 is CRITICAL: NTP CRITICAL: Offset 0.5011888742 secs [03:02:00] RECOVERY - db142 Backups SQL on db142 is OK: FILE_AGE OK: /var/log/sql-backup.log is 119 seconds old and 0 bytes [03:39:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 0.82, 2.63, 3.93 [03:45:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.34, 3.51, 3.86 [03:49:19] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.88, 5.92, 5.47 [03:51:14] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.65, 5.50, 5.38 [03:51:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.07, 3.67, 3.86 [03:53:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.97, 4.11, 3.99 [05:47:38] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [05:59:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 0.42, 1.69, 3.68 [06:01:47] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 0.65, 1.39, 3.33 [06:17:38] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.gab.pt.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:17:39] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [07:47:39] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['NS.ANKH.FR.eu.org.', 'NS1.eu.org.', 'NS1.ERIOMEM.NET.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [08:05:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 8.37, 4.39, 2.33 [08:14:39] PROBLEM - hcw.tomat.dev - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'hcw.tomat.dev' expires in 15 day(s) (Mon 23 Oct 2023 07:43:11 GMT +0000). [08:17:38] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [08:21:04] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/397092ee9a7f...c4f25a7d2626 [08:21:07] [02miraheze/ssl] 07MirahezeSSLBot 03c4f25a7 - Bot: Update SSL cert for hcw.tomat.dev [08:43:48] RECOVERY - hcw.tomat.dev - LetsEncrypt on sslhost is OK: OK - Certificate 'hcw.tomat.dev' will expire on Fri 05 Jan 2024 07:20:56 GMT +0000. [08:47:39] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query pt.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [09:17:39] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [09:29:53] PROBLEM - gtfo-wiki.cn - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'gtfo-wiki.cn' expires in 15 day(s) (Mon 23 Oct 2023 09:23:07 GMT +0000). [09:31:17] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/c4f25a7d2626...41c42d072a4f [09:31:20] [02miraheze/ssl] 07MirahezeSSLBot 0341c42d0 - Bot: Update SSL cert for gtfo-wiki.cn [09:59:16] RECOVERY - gtfo-wiki.cn - LetsEncrypt on sslhost is OK: OK - Certificate 'gtfo-wiki.cn' will expire on Fri 05 Jan 2024 08:31:09 GMT +0000. [10:17:38] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [10:19:18] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [10:48:36] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp25.miraheze.org - CNAME OK [11:47:39] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [12:13:14] PROBLEM - swiftobject113 APT on swiftobject113 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [12:15:13] PROBLEM - swiftobject113 APT on swiftobject113 is CRITICAL: APT CRITICAL: 83 packages available for upgrade (26 critical updates). [12:17:39] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [12:21:50] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.99, 6.58, 5.83 [12:23:45] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.63, 6.17, 5.76 [12:43:14] PROBLEM - mw141 Current Load on mw141 is WARNING: WARNING - load average: 11.96, 9.44, 5.89 [12:45:12] RECOVERY - mw141 Current Load on mw141 is OK: OK - load average: 3.69, 7.24, 5.52 [13:09:23] [02miraheze/ManageWiki] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/postcss-8.4.31 [+0/-0/±1] 13https://github.com/miraheze/ManageWiki/commit/f21aab77f2c4 [13:09:26] [02miraheze/ManageWiki] 07dependabot[bot] 03f21aab7 - Bump postcss from 8.4.21 to 8.4.31 [13:09:32] [02ManageWiki] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/postcss-8.4.31 - 13https://github.com/miraheze/ManageWiki [13:09:34] [02ManageWiki] 07dependabot[bot] opened pull request 03#427: Bump postcss from 8.4.21 to 8.4.31 - 13https://github.com/miraheze/ManageWiki/pull/427 [13:09:35] [02ManageWiki] 07dependabot[bot] labeled pull request 03#427: Bump postcss from 8.4.21 to 8.4.31 - 13https://github.com/miraheze/ManageWiki/pull/427 [13:09:37] [02ManageWiki] 07dependabot[bot] labeled pull request 03#427: Bump postcss from 8.4.21 to 8.4.31 - 13https://github.com/miraheze/ManageWiki/pull/427 [13:10:03] [02CreateWiki] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/postcss-8.4.31 - 13https://github.com/miraheze/CreateWiki [13:10:05] [02CreateWiki] 07dependabot[bot] opened pull request 03#446: Bump postcss from 8.4.21 to 8.4.31 - 13https://github.com/miraheze/CreateWiki/pull/446 [13:10:06] [02miraheze/CreateWiki] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/postcss-8.4.31 [+0/-0/±1] 13https://github.com/miraheze/CreateWiki/commit/07fdeaa69b8d [13:10:09] [02miraheze/CreateWiki] 07dependabot[bot] 0307fdeaa - Bump postcss from 8.4.21 to 8.4.31 [13:10:10] [02CreateWiki] 07dependabot[bot] labeled pull request 03#446: Bump postcss from 8.4.21 to 8.4.31 - 13https://github.com/miraheze/CreateWiki/pull/446 [13:10:13] [02CreateWiki] 07dependabot[bot] labeled pull request 03#446: Bump postcss from 8.4.21 to 8.4.31 - 13https://github.com/miraheze/CreateWiki/pull/446 [13:15:35] miraheze/ManageWiki - dependabot[bot] the build passed. [13:21:44] miraheze/CreateWiki - dependabot[bot] the build passed. [14:01:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.15, 1.78, 3.97 [14:05:47] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 1.27, 1.45, 3.32 [15:19:56] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [15:49:16] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:05:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 8.41, 4.25, 2.31 [16:18:34] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [16:47:53] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp25.miraheze.org - CNAME OK [18:01:32] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 9.86, 6.86, 5.71 [18:03:30] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.60, 6.69, 5.77 [18:05:29] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 5.02, 6.03, 5.64 [18:34:39] PROBLEM - wiki.denby.tech - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.denby.tech' expires in 15 day(s) (Mon 23 Oct 2023 18:30:19 GMT +0000). [18:35:16] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/41c42d072a4f...930d146b2215 [18:35:19] [02miraheze/ssl] 07MirahezeSSLBot 03930d146 - Bot: Update SSL cert for wiki.denby.tech [18:49:18] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [19:18:37] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.andreijiroh.uk.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [19:33:58] RECOVERY - wiki.denby.tech - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.denby.tech' will expire on Fri 05 Jan 2024 17:35:07 GMT +0000. [19:47:38] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [19:47:55] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp25.miraheze.org - CNAME OK [20:09:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 1.61, 2.92, 3.73 [20:11:47] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 0.93, 2.20, 3.36 [20:15:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.69, 3.40, 3.58 [20:17:38] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [21:07:33] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 7.46, 6.91, 6.12 [21:09:31] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 4.65, 6.14, 5.94 [21:15:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.15, 3.64, 3.94 [21:25:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.42, 3.78, 3.82 [21:29:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 3.69, 3.93, 3.89 [21:35:47] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: LOAD CRITICAL - total load average: 4.85, 4.16, 3.94 [21:57:18] RECOVERY - cloud11 IPMI Sensors on cloud11 is OK: IPMI Status: OK [22:01:17] PROBLEM - cloud11 IPMI Sensors on cloud11 is CRITICAL: IPMI Status: Critical [Cntlr 2 Bay 8 = Critical] [22:49:40] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.andreijiroh.uk.eu.org. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [22:51:47] PROBLEM - matomo121 Current Load on matomo121 is WARNING: LOAD WARNING - total load average: 0.98, 2.66, 3.92 [22:55:47] RECOVERY - matomo121 Current Load on matomo121 is OK: LOAD OK - total load average: 0.73, 1.68, 3.23 [23:02:58] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 11.80, 6.02, 3.53 [23:06:58] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 4.18, 7.67, 4.99 [23:08:58] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.80, 5.21, 4.41 [23:18:59] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp25.miraheze.org - CNAME OK