[00:00:15] PROBLEM - hr.petrawiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'hr.petrawiki.org' expires in 15 day(s) (Sat 07 Oct 2023 23:40:21 GMT +0000). [00:02:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.03, 3.63, 3.77 [00:02:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/aa0f16ba086e...5470bada3eeb [00:02:44] [02miraheze/ssl] 07MirahezeSSLBot 035470bad - Bot: Update SSL cert for acgn.sfdev.eu.org [00:03:25] RECOVERY - wiki.blockate.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.blockate.com' will expire on Wed 20 Dec 2023 22:38:14 GMT +0000. [00:04:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.88, 3.62, 3.75 [00:04:48] RECOVERY - www.twistwoodtaleswiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'www.twistwoodtaleswiki.com' will expire on Wed 20 Dec 2023 22:08:34 GMT +0000. [00:06:52] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/5470bada3eeb...66f09a5edbbf [00:06:54] [02miraheze/ssl] 07MirahezeSSLBot 0366f09a5 - Bot: Update SSL cert for thestories.kr [00:10:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.91, 4.10, 3.87 [00:10:11] RECOVERY - translate.petrawiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'translate.petrawiki.org' will expire on Wed 20 Dec 2023 22:42:39 GMT +0000. [00:15:11] PROBLEM - wiki.templeofludus.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.templeofludus.org' expires in 15 day(s) (Sat 07 Oct 2023 23:51:33 GMT +0000). [00:18:10] PROBLEM - swiftobject101 Current Load on swiftobject101 is WARNING: WARNING - load average: 6.60, 7.04, 6.34 [00:18:32] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.09, 7.12, 6.36 [00:20:09] RECOVERY - swiftobject101 Current Load on swiftobject101 is OK: OK - load average: 6.04, 6.59, 6.26 [00:22:20] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 5.02, 6.17, 6.17 [00:24:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.23, 3.68, 3.98 [00:25:04] [02miraheze/puppet] 07The-Voidwalker pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/puppet/compare/e6f6e46ede15...c6b39d800b3d [00:25:05] [02miraheze/puppet] 07The-Voidwalker 03c6b39d8 - fail2ban: set logging to NOTICE for testing [00:27:41] RECOVERY - cp34 Puppet on cp34 is OK: OK: Puppet is currently enabled, last run 48 seconds ago with 0 failures [00:27:52] RECOVERY - acgn.sfdev.eu.org - LetsEncrypt on sslhost is OK: OK - Certificate 'acgn.sfdev.eu.org' will expire on Wed 20 Dec 2023 23:02:34 GMT +0000. [00:29:55] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.25, 6.35, 6.17 [00:31:48] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.28, 5.54, 5.89 [00:37:24] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.12, 3.24, 2.65 [00:39:24] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.37, 2.87, 2.59 [00:43:11] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.00, 6.25, 5.93 [00:46:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.08, 3.10, 3.36 [00:47:04] RECOVERY - psychevos.org - LetsEncrypt on sslhost is OK: OK - Certificate 'psychevos.org' will expire on Wed 20 Dec 2023 22:52:24 GMT +0000. [00:49:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 14.87, 8.98, 7.01 [00:53:06] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 5.52, 7.25, 6.78 [00:54:22] RECOVERY - ewgf.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'ewgf.wiki' will expire on Wed 20 Dec 2023 22:59:05 GMT +0000. [00:55:01] RECOVERY - thestories.kr - LetsEncrypt on sslhost is OK: OK - Certificate 'thestories.kr' will expire on Wed 20 Dec 2023 23:06:44 GMT +0000. [00:55:06] RECOVERY - swiftobject122 Current Load on swiftobject122 is OK: OK - load average: 4.99, 6.40, 6.52 [01:04:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [01:04:44] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.95, 3.51, 3.35 [01:06:41] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.06, 3.65, 3.42 [01:08:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.74, 3.64, 3.44 [01:12:33] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.63, 3.34, 3.38 [01:22:16] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.49, 3.74, 3.50 [01:24:13] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.39, 3.51, 3.44 [01:25:18] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 7.86, 5.74, 5.11 [01:28:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.45, 3.87, 3.59 [01:29:16] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 4.22, 5.20, 5.04 [01:34:19] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [04:02:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.61, 3.37, 3.99 [04:18:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.09, 3.11, 3.39 [04:22:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.09, 3.69, 3.57 [04:26:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.85, 3.91, 3.71 [04:28:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.23, 3.88, 3.71 [04:36:10] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zulaclub.net All nameservers failed to answer the query. [04:44:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.99, 3.89, 4.00 [04:52:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.44, 3.98, 3.95 [04:54:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.30, 3.59, 3.81 [05:05:52] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp24.miraheze.org - CNAME OK [05:14:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.15, 3.82, 3.63 [05:16:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.96, 3.43, 3.51 [05:20:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.09, 3.79, 3.64 [05:30:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.46, 3.89, 3.85 [05:34:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.45, 3.97, 3.87 [05:37:45] [02miraheze/RemovePII] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 [+0/-0/±1] 13https://github.com/miraheze/RemovePII/commit/db5c53ae0e51 [05:37:47] [02miraheze/RemovePII] 07dependabot[bot] 03db5c53a - Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 [05:37:51] [02RemovePII] 07dependabot[bot] opened pull request 03#76: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/RemovePII/pull/76 [05:37:54] [02RemovePII] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 - 13https://github.com/miraheze/RemovePII [05:38:02] [02RemovePII] 07dependabot[bot] labeled pull request 03#76: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/RemovePII/pull/76 [05:38:05] [02RemovePII] 07dependabot[bot] labeled pull request 03#76: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/RemovePII/pull/76 [05:38:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.38, 3.80, 3.85 [05:40:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.86, 4.16, 3.97 [05:46:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.69, 4.00, 3.97 [05:48:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.79, 4.23, 4.05 [05:50:04] miraheze/RemovePII - dependabot[bot] the build passed. [05:54:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.33, 3.82, 3.93 [06:06:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 6.76, 4.48, 4.03 [06:12:57] [02miraheze/phabricator-extensions] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 [+0/-0/±1] 13https://github.com/miraheze/phabricator-extensions/commit/fb3026c00efd [06:13:00] [02miraheze/phabricator-extensions] 07dependabot[bot] 03fb3026c - Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 [06:13:03] [02phabricator-extensions] 07dependabot[bot] opened pull request 03#39: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/phabricator-extensions/pull/39 [06:13:05] [02phabricator-extensions] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 - 13https://github.com/miraheze/phabricator-extensions [06:13:07] [02phabricator-extensions] 07dependabot[bot] labeled pull request 03#39: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/phabricator-extensions/pull/39 [06:13:09] [02phabricator-extensions] 07dependabot[bot] labeled pull request 03#39: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/phabricator-extensions/pull/39 [06:13:54] miraheze/phabricator-extensions - dependabot[bot] the build passed. [07:46:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.33, 3.71, 3.99 [07:52:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.02, 3.87, 3.97 [07:54:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.50, 3.57, 3.84 [08:04:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [08:20:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.10, 3.72, 3.62 [08:22:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.32, 3.63, 3.60 [08:26:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.25, 3.02, 3.36 [08:34:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.11, 3.52, 3.42 [08:34:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [08:48:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.24, 3.95, 3.91 [08:56:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.94, 2.86, 3.35 [09:06:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.92, 3.50, 3.38 [09:10:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.53, 4.30, 3.70 [10:10:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.08, 3.68, 3.95 [10:38:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.08, 3.26, 3.39 [10:40:26] PROBLEM - db101 Backups SQL on db101 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864160 seconds old and 108822 bytes [10:42:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.43, 3.43, 3.44 [10:52:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.14, 3.32, 3.40 [10:56:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.82, 3.65, 3.52 [11:00:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.76, 3.24, 3.39 [11:10:58] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.64, 3.47, 3.39 [11:12:55] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.99, 3.29, 3.33 [11:20:41] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.29, 3.45, 3.38 [11:22:38] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.86, 3.19, 3.29 [11:24:24] PROBLEM - mon141 APT on mon141 is WARNING: APT WARNING: 0 packages available for upgrade (0 critical updates). warnings detected, errors detected. [11:30:24] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.69, 3.40, 3.30 [11:32:22] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.51, 3.11, 3.21 [11:57:14] [02miraheze/YouTube] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 [+0/-0/±1] 13https://github.com/miraheze/YouTube/commit/83b7113c5945 [11:57:17] [02miraheze/YouTube] 07dependabot[bot] 0383b7113 - Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 [11:57:19] [02YouTube] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 - 13https://github.com/miraheze/YouTube [11:57:21] [02YouTube] 07dependabot[bot] opened pull request 03#24: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/YouTube/pull/24 [11:57:22] [02YouTube] 07dependabot[bot] labeled pull request 03#24: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/YouTube/pull/24 [12:04:04] miraheze/YouTube - dependabot[bot] the build passed. [12:08:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.59, 3.68, 3.27 [12:35:56] PROBLEM - wiki.leapit.no - reverse DNS on sslhost is WARNING: Timeout: The DNS operation timed out after 5.406437397003174 seconds [12:39:04] PROBLEM - notes.mridulpm.in - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [13:05:05] RECOVERY - wiki.leapit.no - reverse DNS on sslhost is OK: SSL OK - wiki.leapit.no reverse DNS resolves to cp24.miraheze.org - CNAME OK [13:09:04] PROBLEM - notes.mridulpm.in - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'notes.mridulpm.in' expires in 14 day(s) (Fri 06 Oct 2023 19:11:31 GMT +0000). [13:18:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 1.71, 3.08, 3.84 [13:24:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.47, 2.56, 3.35 [13:54:47] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.49, 3.14, 2.91 [13:56:44] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.33, 3.23, 2.98 [13:59:48] PROBLEM - sparabel.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'sparabel.wiki' expires in 15 day(s) (Sat 07 Oct 2023 20:33:09 GMT +0000). [14:00:06] [02miraheze/ImportDump] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 [+0/-0/±1] 13https://github.com/miraheze/ImportDump/commit/68102c86fcb9 [14:00:09] [02miraheze/ImportDump] 07dependabot[bot] 0368102c8 - Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 [14:00:11] [02ImportDump] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 - 13https://github.com/miraheze/ImportDump [14:00:14] [02ImportDump] 07dependabot[bot] opened pull request 03#52: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/ImportDump/pull/52 [14:00:17] [02ImportDump] 07dependabot[bot] labeled pull request 03#52: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/ImportDump/pull/52 [14:00:20] [02ImportDump] 07dependabot[bot] labeled pull request 03#52: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/ImportDump/pull/52 [14:02:33] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.55, 3.43, 3.14 [14:04:30] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.88, 3.25, 3.11 [14:10:19] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.95, 3.53, 3.23 [14:12:16] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.17, 3.05, 3.09 [14:15:10] miraheze/ImportDump - dependabot[bot] the build passed. [14:18:30] [02miraheze/mw-config] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 [+0/-0/±1] 13https://github.com/miraheze/mw-config/commit/041b6dca9e1d [14:18:31] [02miraheze/mw-config] 07dependabot[bot] 03041b6dc - Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 [14:18:32] [02mw-config] 07dependabot[bot] opened pull request 03#5321: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/mw-config/pull/5321 [14:18:34] [02mw-config] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 - 13https://github.com/miraheze/mw-config [14:18:35] [02mw-config] 07dependabot[bot] labeled pull request 03#5321: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/mw-config/pull/5321 [14:18:36] [02mw-config] 07dependabot[bot] labeled pull request 03#5321: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/mw-config/pull/5321 [14:19:35] miraheze/mw-config - dependabot[bot] the build has errored. [14:29:40] PROBLEM - sparabel.wiki - LetsEncrypt on sslhost is CRITICAL: connect to address sparabel.wiki and port 443: Network is unreachableHTTP CRITICAL - Unable to open TCP socket [14:34:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [14:38:03] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.andreijiroh.uk.eu.org All nameservers failed to answer the query. [14:40:33] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.09, 3.73, 3.41 [14:42:30] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.45, 3.58, 3.39 [14:44:27] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.35, 3.14, 3.25 [14:50:21] [02miraheze/PDFEmbed] 07dependabot[bot] pushed 031 commit to 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 [+0/-0/±1] 13https://github.com/miraheze/PDFEmbed/commit/cb835ad28256 [14:50:21] [02miraheze/PDFEmbed] 07dependabot[bot] 03cb835ad - Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 [14:50:24] [02PDFEmbed] 07dependabot[bot] opened pull request 03#17: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/PDFEmbed/pull/17 [14:50:27] [02PDFEmbed] 07dependabot[bot] created branch 03dependabot/composer/mediawiki/mediawiki-codesniffer-42.0.0 - 13https://github.com/miraheze/PDFEmbed [14:50:28] [02PDFEmbed] 07dependabot[bot] labeled pull request 03#17: Update mediawiki/mediawiki-codesniffer requirement from 41.0.0 to 42.0.0 - 13https://github.com/miraheze/PDFEmbed/pull/17 [14:57:55] miraheze/PDFEmbed - dependabot[bot] the build passed. [14:59:06] PROBLEM - fallofsanctuary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:02:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.06, 3.31, 3.03 [15:04:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.13, 3.22, 3.03 [15:04:20] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query pt.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:06:35] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [15:08:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.47, 3.45, 3.18 [15:12:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.85, 3.31, 3.20 [15:12:19] PROBLEM - wiki.nmc.games - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.nmc.games' expires in 15 day(s) (Sun 08 Oct 2023 15:02:01 GMT +0000). [15:13:31] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/66f09a5edbbf...a9b5bbc7579d [15:13:33] [02miraheze/ssl] 07MirahezeSSLBot 03a9b5bbc - Bot: Update SSL cert for wiki.nmc.games [15:13:39] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 1 datacenter is down: 2607:5300:205:200::3121/cpweb [15:15:39] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [15:18:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.29, 3.68, 3.37 [15:22:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.95, 3.92, 3.55 [15:24:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.08, 3.95, 3.60 [15:26:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.79, 3.82, 3.59 [15:29:03] PROBLEM - fallofsanctuary.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'fallofsanctuary.com' expires in 15 day(s) (Sat 07 Oct 2023 19:25:16 GMT +0000). [15:31:53] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/a9b5bbc7579d...7ba999296889 [15:31:56] [02miraheze/ssl] 07MirahezeSSLBot 037ba9992 - Bot: Update SSL cert for fallofsanctuary.com [15:32:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.02, 3.77, 3.65 [15:34:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.31, 3.57, 3.59 [15:36:02] RECOVERY - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is OK: SSL OK - wiki.andreijiroh.uk.eu.org reverse DNS resolves to cp25.miraheze.org - CNAME OK [15:40:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.24, 3.89, 3.73 [15:42:07] RECOVERY - wiki.nmc.games - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.nmc.games' will expire on Thu 21 Dec 2023 14:13:22 GMT +0000. [15:42:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.79, 3.80, 3.71 [15:45:50] PROBLEM - cp25 HTTP 4xx/5xx ERROR Rate on cp25 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [15:46:05] PROBLEM - cp35 HTTPS on cp35 is CRITICAL: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - 8191 bytes in 2.117 second response time [15:46:07] PROBLEM - cp24 Current Load on cp24 is CRITICAL: LOAD CRITICAL - total load average: 73.56, 32.34, 13.13 [15:46:19] PROBLEM - cp34 HTTP 4xx/5xx ERROR Rate on cp34 is CRITICAL: CRITICAL - NGINX Error Rate is 96% [15:46:20] PROBLEM - cp25 Current Load on cp25 is CRITICAL: LOAD CRITICAL - total load average: 93.36, 53.15, 21.59 [15:46:31] PROBLEM - ns2 GDNSD Datacenters on ns2 is CRITICAL: CRITICAL - 6 datacenters are down: 51.195.201.140/cpweb, 51.89.139.24/cpweb, 2001:41d0:801:2000::5d68/cpweb, 2001:41d0:801:2000::3a18/cpweb, 51.222.14.30/cpweb, 2607:5300:205:200::3121/cpweb [15:46:37] PROBLEM - cp35 HTTP 4xx/5xx ERROR Rate on cp35 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [15:46:50] PROBLEM - cp35 Varnish Backends on cp35 is CRITICAL: 8 backends are down. mw131 mw132 mw141 mw142 mw133 mw134 mw143 mediawiki [15:46:56] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 4.83, 3.47, 2.57 [15:46:58] PROBLEM - rct.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:06] PROBLEM - squareenixwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:11] PROBLEM - wiki.mikrodev.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:47:14] PROBLEM - cp24 HTTP 4xx/5xx ERROR Rate on cp24 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [15:47:25] PROBLEM - cp35 Stunnel for mw131 on cp35 is CRITICAL: connect to address localhost and port 8106: Connection refused [15:47:31] PROBLEM - cp34 Current Load on cp34 is CRITICAL: LOAD CRITICAL - total load average: 240.73, 143.08, 56.73 [15:47:33] PROBLEM - cp35 Stunnel for mon141 on cp35 is CRITICAL: connect to address localhost and port 8201: Connection refused [15:47:39] PROBLEM - ns1 GDNSD Datacenters on ns1 is CRITICAL: CRITICAL - 7 datacenters are down: 51.195.201.140/cpweb, 51.89.139.24/cpweb, 2001:41d0:801:2000::5d68/cpweb, 2001:41d0:801:2000::3a18/cpweb, 51.222.14.30/cpweb, 51.222.12.133/cpweb, 2607:5300:205:200::3121/cpweb [15:47:41] PROBLEM - cp35 Stunnel for mw143 on cp35 is CRITICAL: connect to address localhost and port 8112: Connection refused [15:47:49] PROBLEM - cp35 Stunnel for matomo121 on cp35 is CRITICAL: connect to address localhost and port 8203: Connection refused [15:47:50] PROBLEM - cp35 Current Load on cp35 is CRITICAL: LOAD CRITICAL - total load average: 35.39, 60.69, 29.18 [15:47:54] PROBLEM - cp35 Stunnel for reports121 on cp35 is CRITICAL: connect to address localhost and port 8205: Connection refused [15:47:54] PROBLEM - cp35 Stunnel for puppet141 on cp35 is CRITICAL: connect to address localhost and port 8204: Connection refused [15:47:56] PROBLEM - cp35 Stunnel for phab121 on cp35 is CRITICAL: connect to address localhost and port 8202: Connection refused [15:48:01] PROBLEM - wc.miraheze.org on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:02] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: CRITICAL - Cannot make SSL connection. [15:48:08] PROBLEM - cp35 Stunnel for mwtask141 on cp35 is CRITICAL: connect to address localhost and port 8150: Connection refused [15:48:13] PROBLEM - cp35 Stunnel for mw132 on cp35 is CRITICAL: connect to address localhost and port 8107: Connection refused [15:48:34] PROBLEM - cp35 Stunnel for mw142 on cp35 is CRITICAL: connect to address localhost and port 8109: Connection refused [15:48:35] PROBLEM - cp35 Stunnel for mw134 on cp35 is CRITICAL: connect to address localhost and port 8111: Connection refused [15:48:38] PROBLEM - cp35 Stunnel for mail121 on cp35 is CRITICAL: connect to address localhost and port 8200: Connection refused [15:48:45] PROBLEM - www.journeytheword.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:48] PROBLEM - wiki.esnmilanostatale.it - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:48] PROBLEM - cp35 Stunnel for test131 on cp35 is CRITICAL: connect to address localhost and port 8180: Connection refused [15:48:50] PROBLEM - cp35 Stunnel for mw141 on cp35 is CRITICAL: connect to address localhost and port 8108: Connection refused [15:48:50] PROBLEM - cp24 Varnish Backends on cp24 is WARNING: No backends detected. If this is an error, see readme.txt [15:48:51] PROBLEM - pwiki.drydraytonvillagehall.org.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:52] PROBLEM - wario.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:48:57] PROBLEM - cp35 Stunnel for mw133 on cp35 is CRITICAL: connect to address localhost and port 8110: Connection refused [15:49:15] PROBLEM - cp25 Varnish Backends on cp25 is CRITICAL: 8 backends are down. mw131 mw132 mw141 mw142 mw133 mw134 mw143 mediawiki [15:49:47] PROBLEM - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:49:48] PROBLEM - wiki.digitalcandela.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:49:58] PROBLEM - civwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:18] PROBLEM - history.sdtef.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:19] PROBLEM - wiki.misslessfighters.club - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:39] PROBLEM - 9b9t.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:48] RECOVERY - cp24 Varnish Backends on cp24 is OK: All 15 backends are healthy [15:50:50] PROBLEM - gs.sidem.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:53] PROBLEM - www.moiswiki.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:53] PROBLEM - bushcraftwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:57] PROBLEM - wiki.esufranchise.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:50:59] PROBLEM - cp34 HTTPS on cp34 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:01] PROBLEM - minescape.wiki - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:02] PROBLEM - wiki.triplescripts.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:03] PROBLEM - feathercare.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:03] PROBLEM - cp24 HTTPS on cp24 is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:51:15] RECOVERY - cp25 Varnish Backends on cp25 is OK: All 15 backends are healthy [15:51:50] PROBLEM - allthetropes.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:52:05] RECOVERY - wc.miraheze.org on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Sat 11 Nov 2023 23:59:59 GMT +0000. [15:52:33] PROBLEM - thestarsareright.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:53:03] PROBLEM - theenglishlakes.uk - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:53:08] PROBLEM - m.miraheze.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:53:09] PROBLEM - yoshi.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:53:44] PROBLEM - www.publictestwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:54:11] PROBLEM - test2.specialchat.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:54:20] PROBLEM - wiki.zulaclub.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:54:28] PROBLEM - crashspyro.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:55:25] PROBLEM - hastursnotebook.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:55:36] PROBLEM - wiki.slimelab.net - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:55:37] PROBLEM - dkwiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:55:52] PROBLEM - small.polandballwiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:56:08] PROBLEM - wiki.aoemods.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:56:17] PROBLEM - wiki.wilderyogi.eu - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:57:41] PROBLEM - fotnswiki.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:58:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.67, 3.09, 3.36 [15:58:24] PROBLEM - christipedia.nl - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:58:25] PROBLEM - hr.petrawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:58:27] PROBLEM - wiki.leapit.no - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:58:42] PROBLEM - dodgecircle.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [15:58:48] PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 3.27, 3.92, 3.37 [15:59:10] PROBLEM - fallofsanctuary.com - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:00:36] PROBLEM - wiki.zahira.me - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:01:33] RECOVERY - m.miraheze.org - LetsEncrypt on sslhost is OK: OK - Certificate 'm.miraheze.org' will expire on Sun 05 Nov 2023 16:43:26 GMT +0000. [16:01:35] PROBLEM - croc.miraheze.org - Sectigo on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:02:47] PROBLEM - graylog131 Current Load on graylog131 is CRITICAL: CRITICAL - load average: 5.37, 4.45, 3.69 [16:03:45] RECOVERY - cp25 HTTP 4xx/5xx ERROR Rate on cp25 is OK: OK - NGINX Error Rate is 8% [16:04:37] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is CRITICAL: CRITICAL - load average: 16.52, 11.03, 6.14 [16:04:54] PROBLEM - cp24 Varnish Backends on cp24 is CRITICAL: 8 backends are down. mw131 mw132 mw141 mw142 mw133 mw134 mw143 mediawiki [16:06:22] RECOVERY - cp25 HTTPS on cp25 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3724 bytes in 0.133 second response time [16:06:47] PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 3.92, 3.98, 3.66 [16:07:46] PROBLEM - cp25 HTTP 4xx/5xx ERROR Rate on cp25 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [16:09:58] PROBLEM - cp24 Varnish Backends on cp24 is WARNING: No backends detected. If this is an error, see readme.txt [16:10:39] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 7.360 second response time [16:10:44] PROBLEM - cp25 Varnish Backends on cp25 is WARNING: No backends detected. If this is an error, see readme.txt [16:10:47] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 1.60, 2.79, 3.26 [16:11:45] RECOVERY - cp25 HTTP 4xx/5xx ERROR Rate on cp25 is OK: OK - NGINX Error Rate is 11% [16:12:22] PROBLEM - cp24 Varnish Backends on cp24 is CRITICAL: 8 backends are down. mw131 mw132 mw141 mw142 mw133 mw134 mw143 mediawiki [16:12:37] RECOVERY - cp25 HTTPS on cp25 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3724 bytes in 0.020 second response time [16:12:44] RECOVERY - cp25 Varnish Backends on cp25 is OK: All 15 backends are healthy [16:12:54] PROBLEM - cp35 Puppet on cp35 is UNKNOWN: NRPE: Unable to read output [16:14:07] PROBLEM - wiki.kinkpedia.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:14:25] PROBLEM - cp24 Varnish Backends on cp24 is WARNING: No backends detected. If this is an error, see readme.txt [16:15:41] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 6.21, 7.74, 6.44 [16:15:47] PROBLEM - cp25 HTTP 4xx/5xx ERROR Rate on cp25 is CRITICAL: CRITICAL - NGINX Error Rate is 100% [16:16:47] PROBLEM - graylog131 Current Load on graylog131 is WARNING: WARNING - load average: 3.19, 3.41, 3.38 [16:16:54] PROBLEM - cp25 HTTPS on cp25 is CRITICAL: HTTP CRITICAL: HTTP/1.1 502 Bad Gateway - 328 bytes in 3.337 second response time [16:16:57] PROBLEM - cp25 Varnish Backends on cp25 is WARNING: No backends detected. If this is an error, see readme.txt [16:17:00] RECOVERY - wiki.mikrodev.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mikrodev.com' will expire on Mon 18 Dec 2023 11:17:23 GMT +0000. [16:17:34] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.04, 8.06, 6.67 [16:17:45] RECOVERY - cp25 HTTP 4xx/5xx ERROR Rate on cp25 is OK: OK - NGINX Error Rate is 5% [16:18:23] RECOVERY - cp24 Varnish Backends on cp24 is OK: All 15 backends are healthy [16:18:34] RECOVERY - cp35 HTTP 4xx/5xx ERROR Rate on cp35 is OK: OK - NGINX Error Rate is 38% [16:18:37] RECOVERY - www.journeytheword.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'www.journeytheword.wiki' will expire on Tue 19 Dec 2023 12:23:47 GMT +0000. [16:18:47] RECOVERY - graylog131 Current Load on graylog131 is OK: OK - load average: 2.69, 3.27, 3.35 [16:18:48] RECOVERY - pwiki.drydraytonvillagehall.org.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'pwiki.drydraytonvillagehall.org.uk' will expire on Tue 19 Dec 2023 11:50:52 GMT +0000. [16:18:48] RECOVERY - history.sdtef.org - LetsEncrypt on sslhost is OK: OK - Certificate 'history.sdtef.org' will expire on Mon 18 Dec 2023 18:56:42 GMT +0000. [16:18:49] PROBLEM - files.petrawiki.org - LetsEncrypt on sslhost is CRITICAL: CRITICAL - Socket timeout after 10 seconds [16:18:50] RECOVERY - wario.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Sat 11 Nov 2023 23:59:59 GMT +0000. [16:18:53] RECOVERY - cp25 HTTPS on cp25 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3724 bytes in 0.071 second response time [16:18:56] RECOVERY - cp25 Varnish Backends on cp25 is OK: All 15 backends are healthy [16:19:25] RECOVERY - 9b9t.wiki - LetsEncrypt on sslhost is OK: OK - Certificate '9b9t.wiki' will expire on Wed 18 Oct 2023 20:35:50 GMT +0000. [16:19:30] PROBLEM - swiftobject122 Current Load on swiftobject122 is WARNING: WARNING - load average: 7.54, 7.67, 6.69 [16:19:31] RECOVERY - civwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'civwiki.org' will expire on Tue 19 Dec 2023 03:30:32 GMT +0000. [16:19:43] RECOVERY - gs.sidem.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'gs.sidem.wiki' will expire on Tue 19 Dec 2023 19:25:53 GMT +0000. [16:19:53] RECOVERY - bushcraftwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'bushcraftwiki.com' will expire on Tue 24 Oct 2023 15:04:26 GMT +0000. [16:19:53] RECOVERY - www.moiswiki.net - LetsEncrypt on sslhost is OK: OK - Certificate 'www.moiswiki.net' will expire on Sat 11 Nov 2023 18:09:25 GMT +0000. [16:20:00] RECOVERY - wiki.esufranchise.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.esufranchise.com' will expire on Sun 05 Nov 2023 15:38:07 GMT +0000. [16:20:08] RECOVERY - feathercare.net - LetsEncrypt on sslhost is OK: OK - Certificate 'feathercare.net' will expire on Wed 20 Dec 2023 15:54:25 GMT +0000. [16:20:09] RECOVERY - wiki.triplescripts.org - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.triplescripts.org' will expire on Mon 18 Dec 2023 21:28:20 GMT +0000. [16:20:10] RECOVERY - wiki.misslessfighters.club - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.misslessfighters.club' will expire on Tue 19 Dec 2023 13:29:33 GMT +0000. [16:20:36] RECOVERY - cp24 HTTPS on cp24 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3724 bytes in 0.161 second response time [16:20:58] RECOVERY - minescape.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'minescape.wiki' will expire on Wed 20 Dec 2023 21:26:46 GMT +0000. [16:21:23] PROBLEM - swiftobject122 Current Load on swiftobject122 is CRITICAL: CRITICAL - load average: 10.03, 8.52, 7.10 [16:21:41] RECOVERY - thestarsareright.org - LetsEncrypt on sslhost is OK: OK - Certificate 'thestarsareright.org' will expire on Tue 19 Dec 2023 14:40:09 GMT +0000. [16:21:49] RECOVERY - allthetropes.org - LetsEncrypt on sslhost is OK: OK - Certificate 'allthetropes.org' will expire on Mon 18 Dec 2023 00:54:01 GMT +0000. [16:22:01] RECOVERY - cp24 HTTP 4xx/5xx ERROR Rate on cp24 is OK: OK - NGINX Error Rate is 4% [16:22:30] RECOVERY - www.publictestwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'publictestwiki.com' will expire on Mon 18 Dec 2023 01:02:13 GMT +0000. [16:22:34] PROBLEM - cp35 HTTP 4xx/5xx ERROR Rate on cp35 is CRITICAL: CRITICAL - NGINX Error Rate is 97% [16:22:40] RECOVERY - theenglishlakes.uk - LetsEncrypt on sslhost is OK: OK - Certificate 'theenglishlakes.uk' will expire on Mon 06 Nov 2023 05:13:09 GMT +0000. [16:22:53] RECOVERY - yoshi.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Sat 11 Nov 2023 23:59:59 GMT +0000. [16:23:24] RECOVERY - test2.specialchat.org - LetsEncrypt on sslhost is OK: OK - Certificate 'test2.specialchat.org' will expire on Fri 24 Nov 2023 14:51:14 GMT +0000. [16:23:29] PROBLEM - swiftobject101 Current Load on swiftobject101 is CRITICAL: CRITICAL - load average: 10.34, 8.09, 6.08 [16:23:44] RECOVERY - wiki.zulaclub.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zulaclub.net' will expire on Sat 28 Oct 2023 13:06:40 GMT +0000. [16:23:47] PROBLEM - cp35 Current Load on cp35 is WARNING: LOAD WARNING - total load average: 0.33, 3.40, 7.84 [16:24:00] RECOVERY - crashspyro.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Sat 11 Nov 2023 23:59:59 GMT +0000. [16:24:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.87, 3.40, 3.25 [16:24:23] RECOVERY - hastursnotebook.org - LetsEncrypt on sslhost is OK: OK - Certificate 'hastursnotebook.org' will expire on Wed 20 Dec 2023 16:28:10 GMT +0000. [16:24:46] RECOVERY - wiki.slimelab.net - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.slimelab.net' will expire on Tue 19 Dec 2023 03:56:52 GMT +0000. [16:24:47] RECOVERY - dkwiki.org - LetsEncrypt on sslhost is OK: OK - Certificate 'dkwiki.org' will expire on Tue 19 Dec 2023 19:38:18 GMT +0000. [16:25:19] RECOVERY - small.polandballwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'small.polandballwiki.com' will expire on Tue 19 Dec 2023 14:46:39 GMT +0000. [16:25:39] RECOVERY - ns1 GDNSD Datacenters on ns1 is OK: OK - all datacenters are online [16:25:50] RECOVERY - wiki.aoemods.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.aoemods.com' will expire on Wed 20 Dec 2023 03:33:23 GMT +0000. [16:25:56] RECOVERY - ns2 GDNSD Datacenters on ns2 is OK: OK - all datacenters are online [16:26:06] RECOVERY - wiki.wilderyogi.eu - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.wilderyogi.eu' will expire on Tue 19 Dec 2023 04:06:28 GMT +0000. [16:26:18] RECOVERY - cp34 HTTP 4xx/5xx ERROR Rate on cp34 is OK: OK - NGINX Error Rate is 2% [16:26:26] RECOVERY - cp34 HTTPS on cp34 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3725 bytes in 0.419 second response time [16:27:24] RECOVERY - christipedia.nl - LetsEncrypt on sslhost is OK: OK - Certificate 'www.christipedia.nl' will expire on Tue 19 Dec 2023 02:27:03 GMT +0000. [16:27:29] RECOVERY - wiki.leapit.no - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.leapit.no' will expire on Tue 19 Dec 2023 19:06:34 GMT +0000. [16:27:32] PROBLEM - fotnswiki.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'fotnswiki.com' expires in 15 day(s) (Sat 07 Oct 2023 20:03:55 GMT +0000). [16:27:32] 503 Backend fetch failed [16:27:46] RECOVERY - cp35 Current Load on cp35 is OK: LOAD OK - total load average: 0.33, 1.71, 6.12 [16:27:52] We are aware [16:27:57] RECOVERY - dodgecircle.com - LetsEncrypt on sslhost is OK: OK - Certificate 'dodgecircle.com' will expire on Mon 11 Dec 2023 09:46:04 GMT +0000. [16:28:09] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.07, 3.57, 3.33 [16:28:15] PROBLEM - hr.petrawiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'hr.petrawiki.org' expires in 15 day(s) (Sat 07 Oct 2023 23:40:21 GMT +0000). [16:29:08] RECOVERY - fallofsanctuary.com - LetsEncrypt on sslhost is OK: OK - Certificate 'fallofsanctuary.com' will expire on Thu 21 Dec 2023 14:31:43 GMT +0000. [16:30:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.96, 3.67, 3.40 [16:30:16] RECOVERY - wiki.zahira.me - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.zahira.me' will expire on Wed 20 Dec 2023 19:59:20 GMT +0000. [16:30:42] RECOVERY - croc.miraheze.org - Sectigo on sslhost is OK: OK - Certificate '*.miraheze.org' will expire on Sat 11 Nov 2023 23:59:59 GMT +0000. [16:31:51] The miraheze.org website shows '503 Backend fetch failed'. When will things return to normal? [16:31:58] PROBLEM - swiftproxy111 Current Load on swiftproxy111 is WARNING: WARNING - load average: 0.75, 1.35, 7.33 [16:32:50] System administrators are currently working on, please be patient [16:33:58] RECOVERY - swiftproxy111 Current Load on swiftproxy111 is OK: OK - load average: 0.36, 0.99, 6.46 [16:34:37] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is WARNING: WARNING - load average: 5.09, 5.52, 7.99 [16:35:51] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/7ba999296889...d9cca6cb38dc [16:35:53] [02miraheze/ssl] 07MirahezeSSLBot 03d9cca6c - Bot: Update SSL cert for hr.petrawiki.org [16:37:03] I’ve now posted alerts on the social media accounts [16:38:03] PROBLEM - wiki.andreijiroh.uk.eu.org - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.eu.org. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:39:31] PROBLEM - cp34 Current Load on cp34 is WARNING: LOAD WARNING - total load average: 0.22, 0.29, 7.87 [16:40:10] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.11, 3.29, 3.34 [16:40:34] Also Guest76 disconnected before zpp-ix’ response was sent [16:40:34] RECOVERY - cp35 Stunnel for mw142 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8109 [16:40:34] RECOVERY - cp35 Stunnel for mw134 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8111 [16:40:38] RECOVERY - cp35 Stunnel for mail121 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8200 [16:40:43] RECOVERY - cp35 Puppet on cp35 is OK: OK: Puppet is currently enabled, last run 25 seconds ago with 0 failures [16:40:47] RECOVERY - cp35 Stunnel for test131 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8180 [16:40:50] RECOVERY - cp35 Stunnel for mw141 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8108 [16:40:56] RECOVERY - cp35 Stunnel for mw133 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8110 [16:41:25] RECOVERY - cp35 Stunnel for mw131 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8106 [16:41:32] RECOVERY - cp35 Stunnel for mon141 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8201 [16:41:41] RECOVERY - cp35 Stunnel for mw143 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8112 [16:41:49] RECOVERY - cp35 Stunnel for matomo121 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8203 [16:41:54] RECOVERY - cp35 Stunnel for reports121 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8205 [16:41:54] RECOVERY - cp35 Stunnel for puppet141 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8204 [16:41:55] RECOVERY - cp35 Stunnel for phab121 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8202 [16:41:57] RECOVERY - cp35 HTTPS on cp35 is OK: HTTP OK: HTTP/1.1 301 Moved Permanently - 3724 bytes in 0.397 second response time [16:42:08] RECOVERY - cp35 Stunnel for mwtask141 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8150 [16:42:13] RECOVERY - cp35 Stunnel for mw132 on cp35 is OK: TCP OK - 0.000 second response time on localhost port 8107 [16:42:34] RECOVERY - cp35 HTTP 4xx/5xx ERROR Rate on cp35 is OK: OK - NGINX Error Rate is 3% [16:42:37] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is CRITICAL: CRITICAL - load average: 9.08, 6.67, 7.33 [16:42:47] RECOVERY - cp35 Varnish Backends on cp35 is OK: All 15 backends are healthy [16:43:31] RECOVERY - cp34 Current Load on cp34 is OK: LOAD OK - total load average: 0.09, 0.16, 6.08 [16:43:59] PROBLEM - wiki.kinkpedia.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'wiki.kinkpedia.org' expires in 15 day(s) (Sat 07 Oct 2023 22:16:05 GMT +0000). [16:44:09] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.41, 3.49, 3.41 [16:44:37] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is WARNING: WARNING - load average: 7.30, 6.94, 7.35 [16:46:06] RECOVERY - rct.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'rct.wiki' will expire on Tue 19 Dec 2023 14:20:26 GMT +0000. [16:46:33] RECOVERY - squareenixwiki.com - LetsEncrypt on sslhost is OK: OK - Certificate 'squareenixwiki.com' will expire on Wed 20 Dec 2023 03:55:30 GMT +0000. [16:46:37] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is CRITICAL: CRITICAL - load average: 8.38, 7.66, 7.57 [16:48:09] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.15, 3.33, 3.37 [16:48:37] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is WARNING: WARNING - load average: 7.68, 7.69, 7.59 [16:48:37] RECOVERY - wiki.esnmilanostatale.it - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.esnmilanostatale.it' will expire on Fri 17 Nov 2023 14:26:31 GMT +0000. [16:48:39] PROBLEM - files.petrawiki.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'files.petrawiki.org' expires in 15 day(s) (Sat 07 Oct 2023 19:33:45 GMT +0000). [16:48:45] RECOVERY - abeyancewiki.bumblebee-studios.se - LetsEncrypt on sslhost is OK: OK - Certificate 'abeyancewiki.bumblebee-studios.se' will expire on Wed 20 Dec 2023 13:57:25 GMT +0000. [16:48:45] RECOVERY - wiki.digitalcandela.com - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.digitalcandela.com' will expire on Tue 19 Dec 2023 18:02:04 GMT +0000. [16:50:37] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is CRITICAL: CRITICAL - load average: 8.85, 8.67, 8.00 [16:50:38] PROBLEM - swiftobject121 Current Load on swiftobject121 is WARNING: WARNING - load average: 7.80, 7.28, 6.69 [16:51:31] PROBLEM - mw131 Current Load on mw131 is WARNING: WARNING - load average: 10.41, 9.68, 6.69 [16:53:46] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/d9cca6cb38dc...affd3cfdf545 [16:53:49] [02miraheze/ssl] 07MirahezeSSLBot 03affd3cf - Bot: Update SSL cert for files.petrawiki.org [16:54:27] RECOVERY - swiftobject121 Current Load on swiftobject121 is OK: OK - load average: 6.15, 6.75, 6.61 [16:55:28] RECOVERY - mw131 Current Load on mw131 is OK: OK - load average: 8.86, 9.57, 7.34 [16:56:37] PROBLEM - swiftproxy131 Current Load on swiftproxy131 is WARNING: WARNING - load average: 5.04, 6.96, 7.53 [17:00:37]