[00:02:14] PROBLEM - cp23 Current Load on cp23 is CRITICAL: LOAD CRITICAL - total load average: 40.41, 21.21, 8.47 [00:03:14] PROBLEM - cp22 Current Load on cp22 is CRITICAL: LOAD CRITICAL - total load average: 9.05, 6.84, 3.12 [00:03:33] PROBLEM - cp33 Current Load on cp33 is WARNING: LOAD WARNING - total load average: 3.72, 3.34, 2.43 [00:05:29] RECOVERY - cp33 Current Load on cp33 is OK: LOAD OK - total load average: 1.57, 2.69, 2.30 [00:28:14] PROBLEM - cp23 Current Load on cp23 is WARNING: LOAD WARNING - total load average: 0.30, 1.15, 3.74 [00:30:14] RECOVERY - cp23 Current Load on cp23 is OK: LOAD OK - total load average: 0.24, 0.84, 3.31 [00:33:14] PROBLEM - cp22 Current Load on cp22 is WARNING: LOAD WARNING - total load average: 0.24, 1.18, 3.76 [00:35:14] RECOVERY - cp22 Current Load on cp22 is OK: LOAD OK - total load average: 0.43, 0.94, 3.35 [00:57:31] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query en.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:23:31] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query uk.religiononfire.mar.in.ua. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [01:26:01] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [01:52:32] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [02:33:11] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.gab.pt.eu.org All nameservers failed to answer the query. [03:03:11] PROBLEM - wiki.gab.pt.eu.org - reverse DNS on sslhost is WARNING: SSL WARNING - rDNS OK but records conflict. {'NS': ['ns.ankh.fr.eu.org.', 'ns1.eu.org.', 'ns1.eriomem.net.'], 'CNAME': 'bouncingwiki.miraheze.org.'} [03:09:59] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.99, 3.68, 3.14 [03:11:55] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.40, 3.53, 3.16 [03:17:44] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.27, 3.40, 3.23 [04:18:50] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query zulaclub.net. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [04:47:38] PROBLEM - wiki.zulaclub.net - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.zulaclub.net All nameservers failed to answer the query. [05:16:49] RECOVERY - wiki.zulaclub.net - reverse DNS on sslhost is OK: SSL OK - wiki.zulaclub.net reverse DNS resolves to cp23.miraheze.org - CNAME OK [05:27:31] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [05:55:49] PROBLEM - db101 Backups SQL on db101 is WARNING: FILE_AGE WARNING: /var/log/sql-backup.log is 864229 seconds old and 41080 bytes [05:56:01] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [06:09:44] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.24, 3.40, 2.69 [06:15:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.90, 3.60, 3.01 [06:19:38] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.40, 3.94, 3.27 [06:28:14] PROBLEM - cp23 Current Load on cp23 is CRITICAL: LOAD CRITICAL - total load average: 9.09, 11.26, 5.35 [06:29:14] PROBLEM - cp22 Current Load on cp22 is CRITICAL: LOAD CRITICAL - total load average: 2.48, 4.09, 2.32 [06:31:14] RECOVERY - cp22 Current Load on cp22 is OK: LOAD OK - total load average: 1.05, 3.03, 2.14 [06:33:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.44, 3.90, 3.83 [06:34:14] PROBLEM - cp23 Current Load on cp23 is WARNING: LOAD WARNING - total load average: 0.31, 3.68, 3.77 [06:35:38] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.93, 4.30, 3.99 [06:36:14] RECOVERY - cp23 Current Load on cp23 is OK: LOAD OK - total load average: 0.55, 2.62, 3.37 [07:03:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.88, 3.65, 3.94 [07:09:38] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.36, 2.64, 3.36 [08:12:03] PROBLEM - matomo121 Current Load on matomo121 is CRITICAL: CRITICAL - load average: 4.13, 2.88, 1.81 [08:14:03] PROBLEM - matomo121 Current Load on matomo121 is WARNING: WARNING - load average: 3.61, 3.01, 1.99 [08:16:03] RECOVERY - matomo121 Current Load on matomo121 is OK: OK - load average: 2.79, 3.01, 2.12 [08:34:34] [02mw-config] 07ugochimobi opened pull request 03#5307: T11148: added reviewer protection for infopediawiki - 13https://github.com/miraheze/mw-config/pull/5307 [08:35:29] miraheze/mw-config - ugochimobi the build passed. [09:17:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.44, 3.00, 2.67 [09:19:38] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.22, 3.13, 2.76 [09:23:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.46, 3.45, 2.99 [09:27:38] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.39, 3.13, 2.99 [10:27:31] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - en.religiononfire.mar.in.ua All nameservers failed to answer the query. [10:56:02] PROBLEM - en.religiononfire.mar.in.ua - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query mar.in.ua. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [11:06:28] PROBLEM - itadminwiki.pl - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'itadminwiki.pl' expires in 15 day(s) (Thu 07 Sep 2023 10:45:19 GMT +0000). [11:09:43] [02miraheze/ssl] 07MirahezeSSLBot pushed 031 commit to 03master [+0/-0/±1] 13https://github.com/miraheze/ssl/compare/8eb0e6997b48...329e0e74417c [11:09:46] [02miraheze/ssl] 07MirahezeSSLBot 03329e0e7 - Bot: Update SSL cert for itadminwiki.pl [11:25:31] RECOVERY - en.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - en.religiononfire.mar.in.ua reverse DNS resolves to cp22.miraheze.org - CNAME OK [12:09:44] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.95, 4.11, 3.07 [13:15:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.09, 2.87, 3.79 [13:25:38] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.86, 2.98, 3.40 [13:49:33] [02miraheze/ImportDump] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.16.1 [+0/-0/±2] 13https://github.com/miraheze/ImportDump/commit/dfcd3430f384 [13:49:35] [02miraheze/ImportDump] 07dependabot[bot] 03dfcd343 - Bump stylelint-config-wikimedia from 0.15.0 to 0.16.1 [13:49:38] [02ImportDump] 07dependabot[bot] opened pull request 03#49: Bump stylelint-config-wikimedia from 0.15.0 to 0.16.1 - 13https://github.com/miraheze/ImportDump/pull/49 [13:49:39] [02ImportDump] 07dependabot[bot] labeled pull request 03#49: Bump stylelint-config-wikimedia from 0.15.0 to 0.16.1 - 13https://github.com/miraheze/ImportDump/pull/49 [13:49:40] [02ImportDump] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.16.1 - 13https://github.com/miraheze/ImportDump [13:49:43] [02ImportDump] 07dependabot[bot] labeled pull request 03#49: Bump stylelint-config-wikimedia from 0.15.0 to 0.16.1 - 13https://github.com/miraheze/ImportDump/pull/49 [13:49:44] [02ImportDump] 07dependabot[bot] commented on pull request 03#47: Bump stylelint-config-wikimedia from 0.15.0 to 0.16.0 - 13https://github.com/miraheze/ImportDump/pull/47#issuecomment-1688227392 [13:49:46] [02ImportDump] 07dependabot[bot] closed pull request 03#47: Bump stylelint-config-wikimedia from 0.15.0 to 0.16.0 - 13https://github.com/miraheze/ImportDump/pull/47 [13:49:49] [02miraheze/ImportDump] 07dependabot[bot] deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.16.0 [13:49:50] [02ImportDump] 07dependabot[bot] deleted branch 03dependabot/npm_and_yarn/stylelint-config-wikimedia-0.16.0 - 13https://github.com/miraheze/ImportDump [13:53:31] PROBLEM - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - uk.religiononfire.mar.in.ua All nameservers failed to answer the query. [13:54:59] miraheze/ImportDump - dependabot[bot] the build has errored. [14:11:14] PROBLEM - cp22 Current Load on cp22 is WARNING: LOAD WARNING - total load average: 3.53, 2.65, 1.80 [14:13:14] RECOVERY - cp22 Current Load on cp22 is OK: LOAD OK - total load average: 1.52, 2.28, 1.78 [14:22:32] RECOVERY - uk.religiononfire.mar.in.ua - reverse DNS on sslhost is OK: SSL OK - uk.religiononfire.mar.in.ua reverse DNS resolves to cp23.miraheze.org - CNAME OK [15:18:33] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.91, 3.35, 2.82 [15:20:29] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.03, 3.59, 2.97 [15:22:26] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.56, 3.64, 3.07 [15:28:14] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.14, 3.82, 3.33 [15:30:10] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.75, 3.82, 3.38 [15:37:55] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.12, 3.91, 3.57 [15:43:44] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.66, 3.98, 3.75 [15:48:42] PROBLEM - db112 Disk Space on db112 is WARNING: DISK WARNING - free space: / 14612 MB (10% inode=99%); [15:49:39] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 1.86, 2.92, 3.38 [16:39:19] RECOVERY - cp33 NTP time on cp33 is OK: NTP OK: Offset 0.01031413674 secs [16:54:29] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.41, 3.37, 3.19 [16:56:26] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.76, 3.14, 3.12 [18:08:13] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 5.41, 3.81, 3.26 [19:10:09] the super dodgy traffic from rhinosf1bugtestingwiki is me [19:15:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 2.87, 3.13, 3.98 [19:25:38] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.92, 2.75, 3.35 [20:11:19] PROBLEM - cp33 NTP time on cp33 is WARNING: NTP WARNING: Offset 0.1873472929 secs [20:25:19] im unable to request a beta account on betaheze because there's a contact form error [20:35:51] PROBLEM - wiki.susqu.org - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.susqu.org All nameservers failed to answer the query. [20:41:34] <.jrs> m [21:10:46] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.76, 3.62, 3.24 [21:12:42] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.24, 3.74, 3.33 [21:14:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.75, 3.71, 3.37 [21:18:31] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.65, 3.36, 3.31 [21:22:25] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.98, 3.66, 3.45 [21:26:18] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.30, 3.71, 3.49 [21:28:14] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 2.94, 3.39, 3.40 [22:17:38] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.08, 3.43, 3.00 [22:19:38] RECOVERY - mwtask141 Current Load on mwtask141 is OK: OK - load average: 3.34, 3.35, 3.02 [23:04:30] PROBLEM - db112 Current Load on db112 is CRITICAL: CRITICAL - load average: 13.41, 8.04, 3.81 [23:08:30] PROBLEM - db112 Current Load on db112 is WARNING: WARNING - load average: 2.19, 6.84, 4.49 [23:10:30] RECOVERY - db112 Current Load on db112 is OK: OK - load average: 0.32, 4.60, 3.95 [23:27:38] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.08, 3.15, 2.67 [23:29:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.86, 3.30, 2.78 [23:39:38] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.39, 3.94, 3.34 [23:41:38] PROBLEM - mwtask141 Current Load on mwtask141 is WARNING: WARNING - load average: 3.90, 3.89, 3.39 [23:59:38] PROBLEM - mwtask141 Current Load on mwtask141 is CRITICAL: CRITICAL - load average: 4.44, 4.10, 3.79