[00:00:53] [02statichelp] 07WikiTideBot pushed 1 new commit to 03main 13https://github.com/miraheze/statichelp/commit/860171e7d991a0b0dd088fac891ae833cb225033 [00:00:55] 02statichelp/03main 07WikiTideBot 03860171e Bot: Auto-update Tech namespace pages 2026-05-25 00:00:51 [00:50:19] PROBLEM - swiftproxy171 Current Load on swiftproxy171 is WARNING: LOAD WARNING - total load average: 7.16, 5.76, 3.41 [00:52:19] RECOVERY - swiftproxy171 Current Load on swiftproxy171 is OK: LOAD OK - total load average: 1.57, 4.11, 3.09 [04:58:23] [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779681470000&orgId=1&to=1779685103349 [05:56:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 45% [05:58:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 61% [06:00:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 54% [06:18:18] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 23% [07:23:23] [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779690110000&orgId=1&to=1779693710000 [07:38:23] [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779691070000&orgId=1&to=1779694703351 [07:40:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 56% [07:46:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 60% [07:48:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 51% [07:56:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is CRITICAL: CRITICAL - NGINX Error Rate is 60% [07:58:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 53% [08:00:18] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 37% [08:03:23] [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779692450000&orgId=1&to=1779696050000 [08:40:23] [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779694790000&orgId=1&to=1779698423349 [09:13:35] ^ is known [09:13:45] It is running fine ish [09:13:51] Well it'll fix itself eventually [09:13:59] It's fine by jobqueue standards [09:15:23] [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779696650000&orgId=1&to=1779700250000 [09:28:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 45% [09:34:18] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 39% [09:38:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 42% [09:42:18] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 34% [09:42:23] [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779698510000&orgId=1&to=1779702143349 [09:47:23] [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779698570000&orgId=1&to=1779702170000 [10:27:23] [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779701210000&orgId=1&to=1779704843350 [10:32:23] [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779701330000&orgId=1&to=1779704930000 [11:36:18] PROBLEM - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is WARNING: WARNING - NGINX Error Rate is 40% [11:38:18] RECOVERY - cp161 HTTP 4xx/5xx ERROR Rate on cp161 is OK: OK - NGINX Error Rate is 32% [12:10:23] [02CreateWiki] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/CreateWiki/commit/cdc5b5847ef99f4ed97762659bc57c2d2470f6d8 [12:10:23] 02CreateWiki/03main 07translatewiki.net 03cdc5b58 Localisation updates from https://translatewiki.net. [12:10:26] [02ImportDump] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/ImportDump/commit/51355c7bf1e6cca0c26144210e03f4877c563009 [12:10:26] 02ImportDump/03main 07translatewiki.net 0351355c7 Localisation updates from https://translatewiki.net. [12:10:27] [02landing] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/landing/commit/9452f5ee75791f9cda926c65b84154980d9138e3 [12:10:28] 02landing/03main 07translatewiki.net 039452f5e Localisation updates from https://translatewiki.net. [12:10:30] [02PDFEmbed] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/PDFEmbed/commit/41e0e695cd0d4b327209deee1fba242490b5c94a [12:10:32] [02RequestCustomDomain] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/RequestCustomDomain/commit/0fe0ead1c1c6f9a37c756ca9cba02a7d40cf996c [12:10:34] [02MirahezeMagic] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/MirahezeMagic/commit/a7a6e5760d71ceffb8121e5c3bfd5a8e73a3651e [12:10:36] 02PDFEmbed/03main 07translatewiki.net 0341e0e69 Localisation updates from https://translatewiki.net. [12:10:38] [02DataDump] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/DataDump/commit/8376dbc6d7c0d381ba17075b3727660a8a566df9 [12:10:40] [02WikiDiscover] 07translatewiki pushed 1 new commit to 03main 13https://github.com/miraheze/WikiDiscover/commit/e02c1d7f1ef93c10c6e777cac06cfd4ca80af7e3 [12:10:42] 02RequestCustomDomain/03main 07translatewiki.net 030fe0ead Localisation updates from https://translatewiki.net. [12:10:43] 02MirahezeMagic/03main 07translatewiki.net 03a7a6e57 Localisation updates from https://translatewiki.net. [12:10:45] 02DataDump/03main 07translatewiki.net 038376dbc Localisation updates from https://translatewiki.net. [12:10:46] 02WikiDiscover/03main 07translatewiki.net 03e02c1d7 Localisation updates from https://translatewiki.net. [12:14:14] miraheze/landing - translatewiki the build passed. [12:14:27] miraheze/PDFEmbed - translatewiki the build passed. [12:14:44] miraheze/DataDump - translatewiki the build passed. [12:15:24] miraheze/RequestCustomDomain - translatewiki the build passed. [12:15:48] miraheze/ImportDump - translatewiki the build passed. [12:17:56] miraheze/WikiDiscover - translatewiki the build passed. [13:06:23] [Grafana] FIRING: The estimated time for the MediaWiki JobQueue to clear is excessively high (8 hours) for an extended time period https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779710750000&orgId=1&to=1779714383349 [13:11:23] [Grafana] RESOLVED: MediaWiki JobQueue is stalled https://grafana.wikitide.net/d/GtxbP1Xnk?from=1779710930000&orgId=1&to=1779714530000