[00:02:57] PROBLEM - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is UNKNOWN: UNKNOWN - NGINX Error Rate is UNKNOWN [00:14:56] RECOVERY - cp37 HTTP 4xx/5xx ERROR Rate on cp37 is OK: OK - NGINX Error Rate is 2% [00:15:15] PROBLEM - cp37 Disk Space on cp37 is WARNING: DISK WARNING - free space: / 44506MiB (9% inode=99%); [03:16:28] PROBLEM - os161 Current Load on os161 is CRITICAL: LOAD CRITICAL - total load average: 4.14, 3.18, 1.86 [03:18:28] RECOVERY - os161 Current Load on os161 is OK: LOAD OK - total load average: 2.53, 2.92, 1.93 [03:22:19] Tf is os agaib [03:35:11] opensearch [04:05:17] PROBLEM - wiki.dragonsmp.pro - Cloudflare on sslhost is CRITICAL: Name or service not knownHTTP CRITICAL - Unable to open TCP socket [09:11:42] [02mw-config] 07Universal-Omega created 03suffix-check (+1 new commit) 13https://github.com/miraheze/mw-config/commit/2ea2a44c0fa5 [09:11:42] 02mw-config/03suffix-check 07CosmicAlpha 032ea2a44 Make sure we have suffixes before checking suffixes [09:11:47] [02mw-config] 07Universal-Omega opened pull request #5788: Make sure we have suffixes before checking suffixes (03master...03suffix-check) 13https://github.com/miraheze/mw-config/pull/5788 [09:12:50] miraheze/mw-config - Universal-Omega the build passed. [11:43:15] PROBLEM - cp37 Disk Space on cp37 is CRITICAL: DISK CRITICAL - free space: / 27173MiB (5% inode=99%); [12:09:25] PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 23.36, 14.81, 7.87 [12:09:49] PROBLEM - mw182 Current Load on mw182 is WARNING: LOAD WARNING - total load average: 23.34, 15.45, 8.31 [12:10:35] PROBLEM - mw181 Current Load on mw181 is WARNING: LOAD WARNING - total load average: 20.91, 15.24, 8.43 [12:11:25] RECOVERY - mw184 Current Load on mw184 is OK: LOAD OK - total load average: 19.03, 15.05, 8.74 [12:15:25] PROBLEM - mw184 Current Load on mw184 is WARNING: LOAD WARNING - total load average: 20.82, 18.21, 11.50 [12:15:36] PROBLEM - mw173 Current Load on mw173 is WARNING: LOAD WARNING - total load average: 20.68, 18.46, 11.60 [12:15:49] RECOVERY - mw182 Current Load on mw182 is OK: LOAD OK - total load average: 19.67, 18.56, 12.03 [12:16:06] PROBLEM - mw162 Current Load on mw162 is WARNING: LOAD WARNING - total load average: 20.66, 18.24, 11.42 [12:17:08] PROBLEM - mw153 Current Load on mw153 is WARNING: LOAD WARNING - total load average: 21.07, 18.64, 11.64 [12:17:36] RECOVERY - mw173 Current Load on mw173 is OK: LOAD OK - total load average: 19.22, 18.90, 12.61 [12:19:08] RECOVERY - mw153 Current Load on mw153 is OK: LOAD OK - total load average: 20.04, 18.46, 12.38 [12:19:54] RECOVERY - mw162 Current Load on mw162 is OK: LOAD OK - total load average: 18.83, 19.16, 13.34 [12:36:00] [Grafana] FIRING: Some MediaWiki Appservers are running out of PHP-FPM workers. https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [12:38:50] PROBLEM - mw161 Current Load on mw161 is WARNING: LOAD WARNING - total load average: 22.56, 20.83, 18.17 [12:40:35] RECOVERY - mw181 Current Load on mw181 is OK: LOAD OK - total load average: 10.03, 17.88, 18.57 [12:40:44] RECOVERY - mw161 Current Load on mw161 is OK: LOAD OK - total load average: 7.94, 16.64, 17.00 [12:41:25] RECOVERY - mw184 Current Load on mw184 is OK: LOAD OK - total load average: 5.05, 15.15, 17.81 [12:46:00] [Grafana] RESOLVED: PHP-FPM Worker Usage High https://grafana.wikitide.net/d/GtxbP1Xnk?orgId=1 [13:06:52] PROBLEM - removededm.com - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'removededm.com' expires in 14 day(s) (Sat 08 Feb 2025 12:51:28 PM GMT +0000). [13:07:05] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/0372edb82fc8a4a2828572593e5694ef33fccc55 [13:07:05] 02ssl/03master 07WikiTideSSLBot 030372edb Bot: Update SSL cert for removededm.com [13:35:44] RECOVERY - removededm.com - LetsEncrypt on sslhost is OK: OK - Certificate 'removededm.com' will expire on Thu 24 Apr 2025 12:08:29 PM GMT +0000. [13:43:35] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 28%, RTA = 141.18 ms [13:45:36] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 141.24 ms [14:01:51] PROBLEM - ping6 on ns2 is CRITICAL: PING CRITICAL - Packet loss = 16%, RTA = 141.22 ms [14:03:51] RECOVERY - ping6 on ns2 is OK: PING OK - Packet loss = 0%, RTA = 141.21 ms [14:53:47] PROBLEM - archivesofhavnor.org - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'archivesofhavnor.org' expires in 14 day(s) (Sat 08 Feb 2025 02:39:28 PM GMT +0000). [14:53:58] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/1aeb880c983831352bbdd9314f1a87a11ba5565a [14:53:59] 02ssl/03master 07WikiTideSSLBot 031aeb880 Bot: Update SSL cert for archivesofhavnor.org [14:55:09] PROBLEM - exmormon.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'exmormon.wiki' expires in 14 day(s) (Sat 08 Feb 2025 02:37:38 PM GMT +0000). [14:55:19] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/378d7d13c9ebc29383f44cb5fc3a8389a44e0a4c [14:55:19] 02ssl/03master 07WikiTideSSLBot 03378d7d1 Bot: Update SSL cert for exmormon.wiki [15:01:08] PROBLEM - jackbox.wiki - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'jackbox.wiki' expires in 14 day(s) (Sat 08 Feb 2025 02:40:00 PM GMT +0000). [15:01:23] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/637f19fc030aac855b09dd857e65abc3a7dbaf99 [15:01:23] 02ssl/03master 07WikiTideSSLBot 03637f19f Bot: Update SSL cert for jackbox.wiki [15:08:59] PROBLEM - yepedia.xyz - LetsEncrypt on sslhost is WARNING: WARNING - Certificate 'yepedia.xyz' expires in 14 day(s) (Sat 08 Feb 2025 02:50:34 PM GMT +0000). [15:09:09] [02ssl] 07WikiTideSSLBot pushed 1 new commit to 03master 13https://github.com/miraheze/ssl/commit/82219e245a9905efb0c2a5360fccf98a07fd828d [15:09:09] 02ssl/03master 07WikiTideSSLBot 0382219e2 Bot: Update SSL cert for yepedia.xyz [15:23:05] RECOVERY - archivesofhavnor.org - LetsEncrypt on sslhost is OK: OK - Certificate 'archivesofhavnor.org' will expire on Thu 24 Apr 2025 01:55:22 PM GMT +0000. [15:24:18] RECOVERY - exmormon.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'exmormon.wiki' will expire on Thu 24 Apr 2025 01:56:43 PM GMT +0000. [15:30:16] RECOVERY - jackbox.wiki - LetsEncrypt on sslhost is OK: OK - Certificate 'jackbox.wiki' will expire on Thu 24 Apr 2025 02:02:43 PM GMT +0000. [16:07:57] RECOVERY - yepedia.xyz - LetsEncrypt on sslhost is OK: OK - Certificate 'yepedia.xyz' will expire on Thu 24 Apr 2025 02:10:34 PM GMT +0000. [18:52:20] PROBLEM - changeprop151 Current Load on changeprop151 is CRITICAL: LOAD CRITICAL - total load average: 9.36, 17.24, 9.90 [18:54:20] RECOVERY - changeprop151 Current Load on changeprop151 is OK: LOAD OK - total load average: 2.64, 11.98, 8.85 [20:15:25] [02mw-config] 07AgentIsai created 03upgrade-sitenotice (+1 new commit) 13https://github.com/miraheze/mw-config/commit/28d69f8b22f4 [20:15:25] 02mw-config/03upgrade-sitenotice 07Agent Isai 0328d69f8 Deploy sitenotice for 1.43 upgrade [20:15:30] [02mw-config] 07AgentIsai opened pull request #5789: Deploy sitenotice for 1.43 upgrade (03master...03upgrade-sitenotice) 13https://github.com/miraheze/mw-config/pull/5789 [20:16:25] miraheze/mw-config - AgentIsai the build passed. [20:16:43] [02mw-config] 07AgentIsai merged pull request #5789: Deploy sitenotice for 1.43 upgrade (03master...03upgrade-sitenotice) 13https://github.com/miraheze/mw-config/pull/5789 [20:16:43] [02mw-config] 07AgentIsai pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/6a7bc21384715d5ba3a97447f6072aaa9e8fcf5e [20:16:43] 02mw-config/03master 07Agent Isai 036a7bc21 Deploy sitenotice for 1.43 upgrade (#5789) [20:16:45] [02mw-config] 07AgentIsai 04deleted 03upgrade-sitenotice at 0328d69f8 13https://github.com/miraheze/mw-config/commit/28d69f8 [20:17:35] miraheze/mw-config - AgentIsai the build passed. [20:17:35] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [20:17:57] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 22s [20:19:29] [02mw-config] 07AgentIsai created 03sitenotice-fix (+1 new commit) 13https://github.com/miraheze/mw-config/commit/57fd115303e3 [20:19:29] 02mw-config/03sitenotice-fix 07Agent Isai 0357fd115 Fix sitenotice [20:19:33] [02mw-config] 07AgentIsai opened pull request #5790: Fix sitenotice (03master...03sitenotice-fix) 13https://github.com/miraheze/mw-config/pull/5790 [20:20:00] [02mw-config] 07github-actions[bot] pushed 1 new commit to 03sitenotice-fix 13https://github.com/miraheze/mw-config/commit/c5458bac35125adf7b0072ec93ef4c73f041d731 [20:20:02] 02mw-config/03sitenotice-fix 07github-actions 03c5458ba CI: lint code to MediaWiki standards… [20:20:30] miraheze/mw-config - AgentIsai the build passed. [20:20:34] [02mw-config] 07AgentIsai pushed 1 new commit to 03master 13https://github.com/miraheze/mw-config/commit/5d13ecb871243eecde549264a9907557fb520402 [20:20:34] 02mw-config/03master 07Agent Isai 035d13ecb Fix sitenotice (#5790) [20:20:34] [02mw-config] 07AgentIsai merged pull request #5790: Fix sitenotice (03master...03sitenotice-fix) 13https://github.com/miraheze/mw-config/pull/5790 [20:20:36] !log [agent@mwtask181] starting deploy of {'pull': 'config', 'config': True} to all [20:20:36] [02mw-config] 07AgentIsai 04deleted 03sitenotice-fix at 03c5458ba 13https://github.com/miraheze/mw-config/commit/c5458ba [20:20:56] !log [agent@mwtask181] finished deploy of {'pull': 'config', 'config': True} to all - SUCCESS in 20s [20:21:29] miraheze/mw-config - AgentIsai the build passed. [21:29:08] [02ManageWiki] 07SomeMWDev opened pull request #526: Fix typo in autopromotion message (07miraheze:03master...07SomeMWDev:03fix-autopromote-typo) 13https://github.com/miraheze/ManageWiki/pull/526 [21:29:17] [02ManageWiki] 07coderabbitai[bot] commented on pull request #526: --- […] 13https://github.com/miraheze/ManageWiki/pull/526#issuecomment-2613409622 [21:35:58] [02ManageWiki] 07paladox merged 07SomeMWDev's pull request #526: Fix typo in autopromotion message (07miraheze:03master...07SomeMWDev:03fix-autopromote-typo) 13https://github.com/miraheze/ManageWiki/pull/526 [21:35:59] [02ManageWiki] 07paladox pushed 1 new commit to 03master 13https://github.com/miraheze/ManageWiki/commit/1b03f5055325da7819bda1699011bbdfbe81cedc [21:36:00] 02ManageWiki/03master 07SomeRandomDeveloper 031b03f50 Fix typo in autopromotion message (#526) [21:40:43] miraheze/ManageWiki - paladox the build passed. [23:13:37] [02python-functions] 07dependabot[bot] created 03dependabot/github_actions/dependabot/fetch-metadata-2.3.0 (+1 new commit) 13https://github.com/miraheze/python-functions/commit/e1b1352a6e1c [23:13:37] 02python-functions/03dependabot/github_actions/dependabot/fetch-metadata-2.3.0 07dependabot[bot] 03e1b1352 Bump dependabot/fetch-metadata from 2.2.0 to 2.3.0… [23:13:38] [02python-functions] 07dependabot[bot] opened pull request #114: Bump dependabot/fetch-metadata from 2.2.0 to 2.3.0 (03master...03dependabot/github_actions/dependabot/fetch-metadata-2.3.0) 13https://github.com/miraheze/python-functions/pull/114 [23:13:39] [02python-functions] 07dependabot[bot] added the label 'github_actions' to pull request #114 (Bump dependabot/fetch-metadata from 2.2.0 to 2.3.0) 13https://github.com/miraheze/python-functions/pull/114 [23:13:41] [02python-functions] 07dependabot[bot] added the label 'dependencies' to pull request #114 (Bump dependabot/fetch-metadata from 2.2.0 to 2.3.0) 13https://github.com/miraheze/python-functions/pull/114 [23:13:43] [02python-functions] 07dependabot[bot] created 03dependabot/github_actions/pypa/gh-action-pypi-publish-1.12.4 (+1 new commit) 13https://github.com/miraheze/python-functions/commit/49b0a1c766ff [23:13:45] 02python-functions/03dependabot/github_actions/pypa/gh-action-pypi-publish-1.12.4 07dependabot[bot] 0349b0a1c Bump pypa/gh-action-pypi-publish from 1.12.3 to 1.12.4… [23:13:47] [02python-functions] 07dependabot[bot] added the label 'github_actions' to pull request #115 (Bump pypa/gh-action-pypi-publish from 1.12.3 to 1.12.4) 13https://github.com/miraheze/python-functions/pull/115 [23:13:49] [02python-functions] 07dependabot[bot] opened pull request #115: Bump pypa/gh-action-pypi-publish from 1.12.3 to 1.12.4 (03master...03dependabot/github_actions/pypa/gh-action-pypi-publish-1.12.4) 13https://github.com/miraheze/python-functions/pull/115 [23:13:51] [02python-functions] 07dependabot[bot] added the label 'dependencies' to pull request #115 (Bump pypa/gh-action-pypi-publish from 1.12.3 to 1.12.4) 13https://github.com/miraheze/python-functions/pull/115 [23:13:53] [02python-functions] 07coderabbitai[bot] commented on pull request #114: --- […] 13https://github.com/miraheze/python-functions/pull/114#issuecomment-2613571449 [23:13:55] [02python-functions] 07coderabbitai[bot] commented on pull request #115: --- […] 13https://github.com/miraheze/python-functions/pull/115#issuecomment-2613571475 [23:16:16] miraheze/python-functions - dependabot[bot] the build has errored. [23:16:20] miraheze/python-functions - dependabot[bot] the build has errored.