[05:09:45] <wikibugs>	 (03PS1) 10Kevin Bazira: cope-a-9b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1307897 (https://phabricator.wikimedia.org/T431136)
[05:11:01] <wikibugs>	 (03CR) 10CI reject: [V:04-1] cope-a-9b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1307897 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[05:15:08] <wikibugs>	 (03PS2) 10Kevin Bazira: cope-a-9b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1307897 (https://phabricator.wikimedia.org/T431136)
[05:19:33] <wikibugs>	 (03PS1) 10Kevin Bazira: gpt-oss-safeguard-20b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308001 (https://phabricator.wikimedia.org/T431136)
[05:22:46] <wikibugs>	 (03PS1) 10Kevin Bazira: embeddings: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308002 (https://phabricator.wikimedia.org/T431136)
[05:26:30] <wikibugs>	 (03PS1) 10Kevin Bazira: qwen36: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308003 (https://phabricator.wikimedia.org/T431136)
[05:49:09] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental - https://phabricator.wikimedia.org/T428311#12093049 (10ppelberg)
[06:01:14] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental (en.wiki) - https://phabricator.wikimedia.org/T428311#12093061 (10ppelberg)
[06:01:53] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1) - https://phabricator.wikimedia.org/T428311#12093062 (10ppelberg)
[06:03:50] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1) - https://phabricator.wikimedia.org/T428311#12093067 (10ppelberg)
[06:11:52] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 07OKR-Work: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 2) - https://phabricator.wikimedia.org/T431376 (10ppelberg) 03NEW
[06:13:34] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1) - https://phabricator.wikimedia.org/T428311#12093094 (10ppelberg)
[06:21:52] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1) - https://phabricator.wikimedia.org/T428311#12093106 (10ppelberg)
[06:25:01] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 07OKR-Work: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 2) - https://phabricator.wikimedia.org/T431376#12093111 (10ppelberg)
[06:25:18] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 07OKR-Work: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 2) - https://phabricator.wikimedia.org/T431376#12093116 (10ppelberg)
[06:25:21] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1) - https://phabricator.wikimedia.org/T428311#12093117 (10ppelberg)
[06:25:32] <wikibugs>	 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: Q2 FY2025-26 Goal: Generate a list of edit suggestions using machine learning - https://phabricator.wikimedia.org/T409863#12093121 (10ppelberg)
[06:25:39] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1) - https://phabricator.wikimedia.org/T428311#12093120 (10ppelberg)
[06:25:51] <wikibugs>	 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: Q2 FY2025-26 Goal: Generate a list of edit suggestions using machine learning - https://phabricator.wikimedia.org/T409863#12093125 (10ppelberg)
[06:25:57] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 07OKR-Work: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 2) - https://phabricator.wikimedia.org/T431376#12093124 (10ppelberg)
[06:31:22] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 07OKR-Work: [MILESTONE] Launch controlled experiment of LLM-generated MoS Suggestions - https://phabricator.wikimedia.org/T431377 (10ppelberg) 03NEW
[06:31:55] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 07OKR-Work: [MILESTONE] Launch controlled experiment of LLM-generated MoS Suggestions - https://phabricator.wikimedia.org/T431377#12093153 (10ppelberg)
[06:31:58] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 07OKR-Work: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 2) - https://phabricator.wikimedia.org/T431376#12093154 (10ppelberg)
[06:32:00] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1) - https://phabricator.wikimedia.org/T428311#12093155 (10ppelberg)
[06:32:10] <wikibugs>	 06Machine-Learning-Team (Q1 FY2026-27), 05Goal, 07OKR-Work: Q2 FY2025-26 Goal: Generate a list of edit suggestions using machine learning - https://phabricator.wikimedia.org/T409863#12093157 (10ppelberg)
[06:32:14] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 07OKR-Work: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 2) - https://phabricator.wikimedia.org/T431376#12093156 (10ppelberg)
[06:32:35] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 07OKR-Work: [MILESTONE] Launch controlled experiment of LLM-generated MoS Suggestions - https://phabricator.wikimedia.org/T431377#12093159 (10ppelberg)
[06:32:43] <wikibugs>	 06Machine-Learning-Team, 06Editing-team, 10VisualEditor, 10VisualEditor Suggestion Mode, 13Patch-For-Review: [Milestone] Deploy LLM-generated MoS suggestions as experimental (Phase 1) - https://phabricator.wikimedia.org/T428311#12093158 (10ppelberg)
[08:06:49] <wikibugs>	 (03CR) 10Dpogorzelski: [C:03+1] cope-a-9b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1307897 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:07:03] <wikibugs>	 (03CR) 10Dpogorzelski: [C:03+1] gpt-oss-safeguard-20b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308001 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:07:13] <wikibugs>	 (03CR) 10Dpogorzelski: [C:03+1] embeddings: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308002 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:07:23] <wikibugs>	 (03CR) 10Dpogorzelski: [C:03+1] qwen36: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308003 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:14:06] <wikibugs>	 (03CR) 10Kevin Bazira: [C:03+1] cope-a-9b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1307897 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:14:12] <wikibugs>	 (03CR) 10Kevin Bazira: [C:03+2] cope-a-9b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1307897 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:15:45] <wikibugs>	 (03Merged) 10jenkins-bot: cope-a-9b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1307897 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:17:38] <wikibugs>	 (03CR) 10Kevin Bazira: [C:03+2] gpt-oss-safeguard-20b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308001 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:18:47] <wikibugs>	 (03Merged) 10jenkins-bot: gpt-oss-safeguard-20b: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308001 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:26:00] <wikibugs>	 (03CR) 10Kevin Bazira: [C:03+2] embeddings: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308002 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:26:35] <wikibugs>	 (03Merged) 10jenkins-bot: embeddings: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308002 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:28:27] <wikibugs>	 (03CR) 10Kevin Bazira: [C:03+2] qwen36: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308003 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[08:29:51] <wikibugs>	 (03Merged) 10jenkins-bot: qwen36: Enable vLLM metrics [machinelearning/liftwing/inference-services] - 10https://gerrit.wikimedia.org/r/1308003 (https://phabricator.wikimedia.org/T431136) (owner: 10Kevin Bazira)
[10:10:00] <wikibugs>	 06Machine-Learning-Team (Q1 FY2026-27), 13Patch-For-Review: Enable vLLM Prometheus metrics for LiftWing LLM inference services - https://phabricator.wikimedia.org/T431136#12093652 (10kevinbazira) The cope-a-9b isvc now emits vLLM metrics as shown below: {P94745}
[14:17:44] <wikibugs>	 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE: LLM observability - https://phabricator.wikimedia.org/T429597#12094788 (10kevinbazira) @DPogorzelski-WMF closing the loop on the empty vLLM panels, I put together a demo grafana dashboard confirming that the vLLM service-layer metrics are now live an...
[14:21:28] <wikibugs>	 06Machine-Learning-Team (Q1 FY2026-27): Enable vLLM Prometheus metrics for LiftWing LLM inference services - https://phabricator.wikimedia.org/T431136#12094806 (10kevinbazira) Demo grafana dashboard showing the vLLM metrics we worked on this task: T429597#12094788
[18:56:44] <wikibugs>	 06Machine-Learning-Team (Q1 FY2026-27), 13Patch-For-Review: Add Wikidata RevertRisk predictions to mediawiki.page_revert_risk_prediction_change - https://phabricator.wikimedia.org/T420883#12096632 (10Ottomata) Ah!  Okay, I did not realize that this was a Wikidata specific model.  Interesting!  That makes total...
[19:25:38] <wikibugs>	 06Machine-Learning-Team, 10MediaWiki-extensions-ORES, 10ORES, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team: ORES flagging not working on simplewiki - https://phabricator.wikimedia.org/T431159#12096713 (10Pppery)
[21:30:52] <wikibugs>	 06Machine-Learning-Team (Q1 FY2026-27), 06Data-Platform-SRE, 10decommission-hardware, 13Patch-For-Review: decommission ml-cache* - https://phabricator.wikimedia.org/T430654#12097279 (10RLazarus) admin_ng has some unapplied diffs in wikikube and aux clusters that look related to this, e.g.:  ` root@deploy10...