[00:04:23] <wikibugs>	 10serviceops, 10MediaWiki-Internationalization, 10MediaWiki-extensions-General, 10WMF-General-or-Unknown, and 4 others: Update footer links to direct to proper locations on Foundation Governance Wiki - https://phabricator.wikimedia.org/T331680#9578673 (10Varnent) Running Global Search - these are pages in...
[07:35:17] <wikibugs>	 10serviceops, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 5 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619#9579221 (10MoritzMuehlenhoff)
[07:50:51] <wikibugs>	 10serviceops, 10iPoid-Service (iPoid 1.0): Define service level indicators and service level objectives - https://phabricator.wikimedia.org/T348935#9579258 (10kostajh) a:03kostajh
[07:54:40] <wikibugs>	 10serviceops, 10Trust and Safety Product Sprint (Sprint Piano (Feb 19th - 1st March)), 10iPoid-Service (iPoid 1.0): Define service level indicators and service level objectives - https://phabricator.wikimedia.org/T348935#9579264 (10kostajh)
[09:11:22] <wikibugs>	 10serviceops, 10Infrastructure-Foundations, 10Puppet-Core, 10SRE, and 5 others: Migrate roles to puppet7 - https://phabricator.wikimedia.org/T349619#9579490 (10MoritzMuehlenhoff)
[11:14:34] <wikibugs>	 10serviceops, 10Content-Transform-Team, 10MW-on-K8s, 10SRE, and 3 others: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it - https://phabricator.wikimedia.org/T357392#9579883 (10akosiaris)
[11:16:30] <wikibugs>	 10serviceops, 10Content-Transform-Team, 10MW-on-K8s, 10SRE, and 3 others: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it - https://phabricator.wikimedia.org/T357392#9537132 (10akosiaris) The LVS traffic approach was doomed to fail, since scap utilizes the same dat...
[11:52:19] <wikibugs>	 10serviceops, 10Content-Transform-Team, 10MW-on-K8s, 10SRE, and 3 others: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it - https://phabricator.wikimedia.org/T357392#9580018 (10akosiaris)
[11:52:39] <wikibugs>	 10serviceops, 10Content-Transform-Team, 10MW-on-K8s, 10SRE, and 3 others: Create parsoid mediawiki deployment and migrate parsoid-php.discovery.wmnet traffic to it - https://phabricator.wikimedia.org/T357392#9537132 (10akosiaris) Migration started, we are batch 1 for the next few days.
[12:09:50] <wikibugs>	 10serviceops, 10DC-Ops, 10Data-Persistence, 10Traffic, and 4 others: ☂️ Northward Datacentre Switchover (March 2024) - https://phabricator.wikimedia.org/T357547#9543213 (10LSobanski)
[12:54:02] <wikibugs>	 10serviceops, 10Data Products: Service Ops Review of Metrics Platform Configuration Management UI - https://phabricator.wikimedia.org/T358577#9580139 (10WDoranWMF) p:05Triage→03High
[14:24:17] <wikibugs>	 10serviceops, 10Content-Transform-Team, 10MW-on-K8s, 10SRE, and 2 others: A lot of `[info] Wikitext for this page has duplicate ids:` in logstash for mw-parsoid. Possibly related to PageBundle - https://phabricator.wikimedia.org/T358588#9580452 (10akosiaris)
[14:24:32] <wikibugs>	 10serviceops, 10Content-Transform-Team, 10MW-on-K8s, 10SRE, and 2 others: A lot of `[info] Wikitext for this page has duplicate ids:` in logstash for mw-parsoid. Possibly related to PageBundle - https://phabricator.wikimedia.org/T358588#9580465 (10akosiaris) p:05Triage→03High
[14:34:40] <wikibugs>	 10serviceops, 10Content-Transform-Team, 10MW-on-K8s, 10SRE, and 2 others: A lot of `[info] Wikitext for this page has duplicate ids:` in logstash for mw-parsoid. Possibly related to PageBundle - https://phabricator.wikimedia.org/T358588#9580484 (10ssastry) It doesn't show up in production because the loggi...
[15:43:12] <wikibugs>	 10serviceops: urldownloader1003's network is unresponsive - https://phabricator.wikimedia.org/T358597#9580788 (10jijiki)
[15:43:23] <wikibugs>	 10serviceops: urldownloader1003's network is unresponsive - https://phabricator.wikimedia.org/T358597#9580798 (10jijiki) p:05Triage→03High
[15:46:06] <wikibugs>	 10serviceops, 10MW-on-K8s, 10SRE, 10Traffic, 10Release-Engineering-Team (Seen): Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536#9580810 (10Lucas_Werkmeister_WMDE)
[15:56:35] <wikibugs>	 10serviceops: urldownloader1003's network is unresponsive - https://phabricator.wikimedia.org/T358597#9580843 (10jijiki) 05Open→03Resolved
[15:57:05] <wikibugs>	 10serviceops: urldownloader1003's network is unresponsive - https://phabricator.wikimedia.org/T358597#9580788 (10jijiki) After issuing a restart, the VM came back to life normally.
[16:45:31] <wikibugs>	 10serviceops: urldownloader1003's network is unresponsive - https://phabricator.wikimedia.org/T358597#9581032 (10jijiki) Looking into the issue, we found that around 26th Feb @ ~21:45 UTC, the urldownloader1003 (ganeti VM running on ganeti1027 ie cluster master) lost network connectivity   {F42183489}   I was ab...
[16:51:52] <wikibugs>	 10serviceops: urldownloader1003's network is unresponsive - https://phabricator.wikimedia.org/T358597#9581063 (10jijiki) a:03jijiki
[21:41:05] <wikibugs>	 06serviceops, 06Content-Transform-Team, 10MW-on-K8s, 06SRE, and 2 others: A lot of `[info] Wikitext for this page has duplicate ids:` in logstash for mw-parsoid. Possibly related to PageBundle - https://phabricator.wikimedia.org/T358588#9581849 (10Izno) {T200517} has some work done on it that could maybe c...