[00:14:11] (03update) 10renovatebot: Update pnpm to v12.9.0 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/23 [00:14:18] (03update) 10renovatebot: Update pnpm to v12.9.0 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/34 [00:14:27] (03update) 10renovatebot: Update pnpm to v12.9.0 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/30 [00:15:21] (03update) 10renovatebot: Update pnpm to v12.9.0 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/62 [00:16:04] (03update) 10renovatebot: Update pnpm to v12.9.0 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/48 [00:41:20] PROBLEM - Host cloudcephosd1046 is DOWN: PING CRITICAL - Packet loss = 100% [00:43:50] RECOVERY - Host cloudcephosd1046 is UP: PING OK - Packet loss = 0%, RTA = 0.34 ms [00:45:03] !log andrew@cloudcumin1001 admin START - Cookbook wmcs.ceph.osd.bootstrap_and_add [00:51:09] FIRING: CephClusterInWarning: Ceph cluster in eqiad is in warning status - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning - https://grafana.wikimedia.org/d/P1tFnn3Mk/wmcs-ceph-eqiad-health?orgId=1&search=open&tag=ceph&tag=health&tag=WMCS - https://alerts.wikimedia.org/?q=alertname%3DCephClusterInWarning [01:05:31] !log andrew@cloudcumin1001 admin END (PASS) - Cookbook wmcs.ceph.osd.bootstrap_and_add (exit_code=0) [01:17:39] RESOLVED: CephClusterInWarning: Ceph cluster in eqiad is in warning status - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/CephClusterInWarning - https://grafana.wikimedia.org/d/P1tFnn3Mk/wmcs-ceph-eqiad-health?orgId=1&search=open&tag=ceph&tag=health&tag=WMCS - https://alerts.wikimedia.org/?q=alertname%3DCephClusterInWarning [03:42:51] 10Tool-Pageviews: NaN error on the Page Views page - https://phabricator.wikimedia.org/T439452#12392965 (10MusikAnimal) 05Open→03Resolved a:03MusikAnimal I have made the auto-logarithmic switch less eager, and changed the label for values that can't be plotted to "N/A". [03:43:21] 10Tool-Pageviews: Zoom happens too easily on pageviews Tool on mobile - https://phabricator.wikimedia.org/T440075#12392970 (10MusikAnimal) 05Open→03Resolved a:03MusikAnimal Thanks for reporting. I've disabled the click-and-drag zoom for touch devices. [03:49:56] 10Toolforge, 06tools-platform-team: toolforge jobs logs -f has an Internal server error - https://phabricator.wikimedia.org/T440103 (10Balance3641) 03NEW [05:07:38] RESOLVED: ToolsDBHistoryLengthGrowing: ToolsDB History Length is above the desired threshold - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBHistoryLengthGrowing - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsDBHistoryLengthGrowing [05:08:38] FIRING: ToolsDBHistoryLengthGrowing: ToolsDB History Length is above the desired threshold - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsDBHistoryLengthGrowing - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsDBHistoryLengthGrowing [05:45:34] RESOLVED: ToolsNfsAlmostFull: Toolforge NFS is almost full - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsNfsAlmostFull [10:38:49] 10Tool-wikinewsie: Wikinewsie elements fail to translate upon reload from language selector - https://phabricator.wikimedia.org/T439940#12393259 (10Chimaifeanyi29) Would you say that this is happening because we do not have translations for those elements ready yet ? @Pharos [11:32:09] 10Tool-itwiki, 06Commons: Auto-calculate the bearing (compass) from Wikimedia Commons' photos from two pairs of coordinates (Location + Object location) - https://phabricator.wikimedia.org/T363052#12393354 (10GiovanniPen) Python deg = math.atan((y_a - y_b ) / (x_a - x_b)) * (180 / math.pi) [12:33:19] 10Tool-itwiki, 06Commons: Auto-calculate the bearing (compass) from Wikimedia Commons' photos from two pairs of coordinates (Location + Object location) - https://phabricator.wikimedia.org/T363052#12393549 (10valerio.bozzolan) I was trying to describe the situation using only Free licensed images, but it was d... [12:36:32] 10Tool-itwiki, 06Commons, 03Wikimedia-Hackathon-2026 (Wikimedia Hackathon 2026 - Satellite Event Messina): Auto-calculate the bearing (compass) from Wikimedia Commons' photos from two pairs of coordinates (Location + Object location) - https://phabricator.wikimedia.org/T363052#12393556 (10GiovanniPen) [13:48:33] 10Tool-lexica-tool: Include a link to open Lexeme on Wikidata - https://phabricator.wikimedia.org/T440131 (10satdeep_gill) 03NEW [13:51:05] 10Tool-lexica-tool: Add all Wikidata languages to Lexica - https://phabricator.wikimedia.org/T440132 (10satdeep_gill) 03NEW [14:02:11] 10Tool-inteGraality: Feature discoverability & adoption - https://phabricator.wikimedia.org/T440134 (10JeanFred) 03NEW [14:14:52] 10Tool-refill: reFill introduced errors in reference names - https://phabricator.wikimedia.org/T440135 (10Pigsonthewing) 03NEW [14:25:32] 10Tool-refill: reFill introduced errors in reference names - https://phabricator.wikimedia.org/T440135#12393682 (10Pigsonthewing) The expected result can be seen in this diff: https://en.wikipedia.org/w/index.php?title=Samuel_Galton_Jr.&diff=1378442322&oldid=1378398578 [17:03:47] 10Tool-wikinewsie: Wikinewsie elements fail to translate upon reload from language selector - https://phabricator.wikimedia.org/T439940#12393827 (10Pharos) >>! In T439940#12393259, @Chimaifeanyi29 wrote: > Would you say that this is happening because we do not have translations for those elements ready yet ? @Ph... [17:38:44] FIRING: MaintainDBUsersManyErrors: Maintain-dbusers is having sustained errors - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainDBUsersManyErrors - https://grafana.wikimedia.org/d/ae240a06-c13e-49f3-b12c-58432c551e85/wmcs-maintain-dbusers - https://alerts.wikimedia.org/?q=alertname%3DMaintainDBUsersManyErrors [17:43:44] RESOLVED: MaintainDBUsersManyErrors: Maintain-dbusers is having sustained errors - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/MaintainDBUsersManyErrors - https://grafana.wikimedia.org/d/ae240a06-c13e-49f3-b12c-58432c551e85/wmcs-maintain-dbusers - https://alerts.wikimedia.org/?q=alertname%3DMaintainDBUsersManyErrors [18:49:07] 10Tool-wikinewsie: WikiProject-based portals for Wikinewsie - https://phabricator.wikimedia.org/T440144 (10Pharos) 03NEW [18:57:35] 06Toolforge-standards-committee, 10Tools, 03Wikimedia-Hackathon-2026 (Wikimedia Hackathon 2026 - Satellite Event Messina): WikiMap is closed source - https://phabricator.wikimedia.org/T440145 (10valerio.bozzolan) 03NEW [19:13:20] (03open) 10sweil: Use dir=auto for the OCR output text field [toolforge-repos/ocr] - 10https://gitlab.wikimedia.org/toolforge-repos/ocr/-/merge_requests/19 [19:15:22] 06Toolforge-standards-committee, 10Tools, 03Wikimedia-Hackathon-2026 (Wikimedia Hackathon 2026 - Satellite Event Messina): WikiMap is closed source - https://phabricator.wikimedia.org/T440145#12393949 (10valerio.bozzolan) P.S. I've shared another comment as I believe that maybe the author was not aware of t... [19:17:32] (03open) 10sweil: Update Guzzle to fix security vulnerabilities [toolforge-repos/ocr] - 10https://gitlab.wikimedia.org/toolforge-repos/ocr/-/merge_requests/20 [19:21:38] 10Tool-itwiki, 06Commons, 03Wikimedia-Hackathon-2026 (Wikimedia Hackathon 2026 - Satellite Event Messina): Auto-calculate the bearing (compass) from Wikimedia Commons' photos from two pairs of coordinates (Location + Object location) - https://phabricator.wikimedia.org/T363052#12393950 (10valerio.bozzolan) [19:22:49] 10Tool-itwiki, 06Commons, 03Wikimedia-Hackathon-2026 (Wikimedia Hackathon 2026 - Satellite Event Messina): Auto-calculate the bearing (compass) from Wikimedia Commons' photos from two pairs of coordinates (Location + Object location) - https://phabricator.wikimedia.org/T363052#12393953 (10valerio.bozzolan) [19:34:50] (03open) 10sweil: Add robots.txt [toolforge-repos/ocr] - 10https://gitlab.wikimedia.org/toolforge-repos/ocr/-/merge_requests/21 [22:14:09] (03update) 10renovatebot: Update pnpm to v12.9.0 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/23 [22:14:30] (03update) 10renovatebot: Update pnpm to v12.9.1 [toolforge-repos/namehistory] - 10https://gitlab.wikimedia.org/toolforge-repos/namehistory/-/merge_requests/23 [22:14:45] (03update) 10renovatebot: Update pnpm to v12.9.0 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/34 [22:14:48] (03update) 10renovatebot: Update pnpm to v12.9.1 [toolforge-repos/allblocksever] - 10https://gitlab.wikimedia.org/toolforge-repos/allblocksever/-/merge_requests/34 [22:15:10] (03update) 10renovatebot: Update pnpm to v12.9.1 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/30 [22:15:10] (03update) 10renovatebot: Update pnpm to v12.9.1 [toolforge-repos/checkusertools] - 10https://gitlab.wikimedia.org/toolforge-repos/checkusertools/-/merge_requests/30 [22:16:13] (03update) 10renovatebot: Update pnpm to v12.9.0 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/62 [22:16:16] (03update) 10renovatebot: Update pnpm to v12.9.1 [toolforge-repos/rangetree] - 10https://gitlab.wikimedia.org/toolforge-repos/rangetree/-/merge_requests/62 [22:17:14] (03update) 10renovatebot: Update pnpm to v12.9.0 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/48 [22:17:17] (03update) 10renovatebot: Update pnpm to v12.9.1 [toolforge-repos/wiki-mail-verify] - 10https://gitlab.wikimedia.org/toolforge-repos/wiki-mail-verify/-/merge_requests/48