[00:20:18] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [00:57:25] [Grafana] !tech FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [02:02:25] [Grafana] !tech RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [02:40:18] [02dns] 07The-Voidwalker closed pull request 03#524: add osdev.wiki zone - 13https://github.com/miraheze/dns/pull/524 [02:40:21] [02dns] 07The-Voidwalker pushed 031 commit to 03master [+1/-0/±0] 13https://github.com/miraheze/dns/compare/0de1875388a6...680592302fc2 [02:40:23] [02dns] 07MacFan4000 036805923 - add osdev.wiki zone (#524) [02:40:36] MacFan4000: a bit late, but done now [02:41:00] Ty [02:43:10] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp37.wikitide.net - CNAME OK [03:00:10] RECOVERY - db151 Backups SQL on db151 is OK: FILE_AGE OK: /var/log/sql-backup.log is 9 seconds old and 0 bytes [05:44:07] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [07:17:25] [Grafana] !tech FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [08:02:25] [Grafana] !tech RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [09:47:25] [Grafana] !tech FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [10:57:25] [Grafana] !tech RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [11:12:01] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [11:18:19] [02dns] 07redbluegreenhat pushed 031 commit to 03remove-pastport [+0/-1/±0] 13https://github.com/miraheze/dns/commit/f456f8a137a7 [11:18:21] [02dns] 07redbluegreenhat 03f456f8a - Remove pastport.org [11:18:24] [02dns] 07redbluegreenhat created branch 03remove-pastport - 13https://github.com/miraheze/dns [11:18:37] [02dns] 07redbluegreenhat opened pull request 03#525: Remove pastport.org - 13https://github.com/miraheze/dns/pull/525 [11:21:05] [02ssl] 07redbluegreenhat pushed 031 commit to 03remove-pastport [+0/-1/±1] 13https://github.com/miraheze/ssl/commit/131c8a2cf866 [11:21:08] [02ssl] 07redbluegreenhat 03131c8a2 - Remove pastport.org [11:21:11] [02ssl] 07redbluegreenhat created branch 03remove-pastport - 13https://github.com/miraheze/ssl [11:21:20] [02ssl] 07redbluegreenhat opened pull request 03#782: Remove pastport.org - 13https://github.com/miraheze/ssl/pull/782 [11:21:29] [02ssl] 07coderabbitai[bot] commented on pull request 03#782: Remove pastport.org - 13https://github.com/miraheze/ssl/pull/782#issuecomment-2162760253 [11:28:48] [02ssl] 07coderabbitai[bot] edited a comment on pull request 03#782: Remove pastport.org - 13https://github.com/miraheze/ssl/pull/782#issuecomment-2162760253 [12:44:51] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [12:47:20] [Grafana] !tech FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [13:13:25] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query line.pm. IN NS: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [14:03:07] PROBLEM - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is CRITICAL: Temporary failure in name resolutionHTTP CRITICAL - Unable to open TCP socket [14:12:05] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - wiki.mahdiruiz.line.pm All nameservers failed to answer the query. [14:42:07] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [15:02:05] RECOVERY - wiki.mahdiruiz.line.pm - LetsEncrypt on sslhost is OK: OK - Certificate 'wiki.mahdiruiz.line.pm' will expire on Tue 27 Aug 2024 03:54:13 PM GMT +0000. [15:14:14] PROBLEM - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is WARNING: NoNameservers: All nameservers failed to answer the query wiki.mahdiruiz.line.pm. IN CNAME: Server 2606:4700:4700::1111 UDP port 53 answered The DNS operation timed out.; Server 2606:4700:4700::1111 UDP port 53 answered SERVFAIL [16:47:20] [Grafana] !tech FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [17:12:20] [Grafana] !tech RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [17:16:00] [02ssl] 07WikiTideSSLBot pushed 031 commit to 03master [+1/-0/±1] 13https://github.com/miraheze/ssl/compare/5ff937833863...42693466d152 [17:16:02] [02ssl] 07WikiTideSSLBot 034269346 - Bot: Add SSL cert for osdev.wiki [17:47:25] [Grafana] !tech FIRING: The mediawiki job queue has more than 500 unclaimed jobs https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [20:07:56] RECOVERY - wiki.mahdiruiz.line.pm - reverse DNS on sslhost is OK: SSL OK - wiki.mahdiruiz.line.pm reverse DNS resolves to cp36.wikitide.net - CNAME OK [20:17:25] [Grafana] !tech RESOLVED: High Job Queue Backlog https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [22:51:24] [02IncidentReporting] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.28.2 [+0/-0/±2] 13https://github.com/miraheze/IncidentReporting/commit/f662f091e5d5 [22:51:27] [02IncidentReporting] 07dependabot[bot] 03f662f09 - Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 [22:51:28] [02IncidentReporting] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.28.2 - 13https://github.com/miraheze/IncidentReporting [22:51:29] [02IncidentReporting] 07dependabot[bot] labeled pull request 03#88: Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 - 13https://github.com/miraheze/IncidentReporting/pull/88 [22:51:32] [02IncidentReporting] 07dependabot[bot] labeled pull request 03#88: Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 - 13https://github.com/miraheze/IncidentReporting/pull/88 [22:51:35] [02IncidentReporting] 07dependabot[bot] opened pull request 03#88: Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 - 13https://github.com/miraheze/IncidentReporting/pull/88 [22:51:38] [02IncidentReporting] 07dependabot[bot] closed pull request 03#87: Bump eslint-config-wikimedia from 0.27.0 to 0.28.1 - 13https://github.com/miraheze/IncidentReporting/pull/87 [22:51:41] [02IncidentReporting] 07dependabot[bot] commented on pull request 03#87: Bump eslint-config-wikimedia from 0.27.0 to 0.28.1 - 13https://github.com/miraheze/IncidentReporting/pull/87#issuecomment-2164024329 [22:51:44] [02IncidentReporting] 07dependabot[bot] deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.28.1 [22:51:46] [02IncidentReporting] 07dependabot[bot] deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.28.1 - 13https://github.com/miraheze/IncidentReporting [22:51:47] [02IncidentReporting] 07coderabbitai[bot] commented on pull request 03#88: Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 - 13https://github.com/miraheze/IncidentReporting/pull/88#issuecomment-2164024369 [22:52:40] [02CreateWiki] 07dependabot[bot] pushed 031 commit to 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.28.2 [+0/-0/±2] 13https://github.com/miraheze/CreateWiki/commit/1a20c4f76372 [22:52:42] [02CreateWiki] 07dependabot[bot] 031a20c4f - Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 [22:52:43] [02CreateWiki] 07dependabot[bot] created branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.28.2 - 13https://github.com/miraheze/CreateWiki [22:52:46] [02CreateWiki] 07dependabot[bot] labeled pull request 03#539: Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 - 13https://github.com/miraheze/CreateWiki/pull/539 [22:52:49] [02CreateWiki] 07dependabot[bot] opened pull request 03#539: Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 - 13https://github.com/miraheze/CreateWiki/pull/539 [22:52:50] [02CreateWiki] 07dependabot[bot] labeled pull request 03#539: Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 - 13https://github.com/miraheze/CreateWiki/pull/539 [22:52:53] [02CreateWiki] 07dependabot[bot] commented on pull request 03#538: Bump eslint-config-wikimedia from 0.27.0 to 0.28.1 - 13https://github.com/miraheze/CreateWiki/pull/538#issuecomment-2164025278 [22:52:55] [02CreateWiki] 07dependabot[bot] closed pull request 03#538: Bump eslint-config-wikimedia from 0.27.0 to 0.28.1 - 13https://github.com/miraheze/CreateWiki/pull/538 [22:52:56] [02CreateWiki] 07dependabot[bot] deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.28.1 [22:52:58] [02CreateWiki] 07dependabot[bot] deleted branch 03dependabot/npm_and_yarn/eslint-config-wikimedia-0.28.1 - 13https://github.com/miraheze/CreateWiki [22:53:00] [02CreateWiki] 07coderabbitai[bot] commented on pull request 03#539: Bump eslint-config-wikimedia from 0.27.0 to 0.28.2 - 13https://github.com/miraheze/CreateWiki/pull/539#issuecomment-2164025350 [22:55:40] miraheze/IncidentReporting - dependabot[bot] the build passed. [23:01:45] miraheze/CreateWiki - dependabot[bot] the build passed. [23:30:51] PROBLEM - franchise.franchising.org.ua - reverse DNS on sslhost is CRITICAL: rDNS CRITICAL - franchise.franchising.org.ua All nameservers failed to answer the query. [23:59:52] RECOVERY - franchise.franchising.org.ua - reverse DNS on sslhost is OK: SSL OK - franchise.franchising.org.ua reverse DNS resolves to cp36.wikitide.net - CNAME OK