[08:21:36] 10netops, 10Infrastructure-Foundations, 10SRE: Create an alert for output discards on network devices - https://phabricator.wikimedia.org/T284593 (10ayounsi) Current values for `ifOutDiscards_delta`: > 'asw2-b-eqiad.mgmt.eqiad.wmnet', 'xe-7/0/41', '509' > 'asw2-b-eqiad.mgmt.eqiad.wmnet', 'xe-2/0/41', '1601'... [08:28:44] 10netops, 10Infrastructure-Foundations: Switch buffer re-partition - cloudsw1-c8-eqiad - https://phabricator.wikimedia.org/T288036 (10cmooney) [08:29:12] 10netops, 10Infrastructure-Foundations: Switch buffer re-partition - cloudsw1-c8-eqiad - https://phabricator.wikimedia.org/T288036 (10cmooney) [08:29:18] 10netops, 10Infrastructure-Foundations, 10SRE: Adjust egress buffer allocations on ToR switches - https://phabricator.wikimedia.org/T284592 (10cmooney) [08:31:58] 10netops, 10Infrastructure-Foundations: Switch buffer re-partition - cloudsw1-d5-eqiad - https://phabricator.wikimedia.org/T288037 (10cmooney) [08:32:22] 10netops, 10Infrastructure-Foundations: Switch buffer re-partition - cloudsw1-d5-eqiad - https://phabricator.wikimedia.org/T288037 (10cmooney) [08:32:25] 10netops, 10Infrastructure-Foundations, 10SRE: Adjust egress buffer allocations on ToR switches - https://phabricator.wikimedia.org/T284592 (10cmooney) [08:41:30] 10netops, 10Infrastructure-Foundations, 10SRE: Adjust egress buffer allocations on ToR switches - https://phabricator.wikimedia.org/T284592 (10cmooney) [09:08:40] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Switch buffer re-partition - cloudsw1-c8-eqiad - https://phabricator.wikimedia.org/T288036 (10dcaro) [09:09:08] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Switch buffer re-partition - cloudsw1-d5-eqiad - https://phabricator.wikimedia.org/T288037 (10dcaro) [09:26:32] 10netops, 10Infrastructure-Foundations, 10SRE, 10Traffic, 10Patch-For-Review: Anycast: consistent routers->servers routing - https://phabricator.wikimedia.org/T253666 (10ayounsi) a:05ayounsi→03None [10:34:10] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 3 others: Failover m2 master (db1107) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T287852 (10Marostegui) All set for tomorrow's failover! [13:47:42] 10netops, 10Infrastructure-Foundations, 10SRE: ripe-atlas-codfw is down - https://phabricator.wikimedia.org/T267714 (10cmooney) a:03cmooney [14:22:20] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Switch buffer re-partition - cloudsw1-d5-eqiad - https://phabricator.wikimedia.org/T288037 (10MoritzMuehlenhoff) p:05Triage→03Medium [14:22:33] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Switch buffer re-partition - cloudsw1-c8-eqiad - https://phabricator.wikimedia.org/T288036 (10MoritzMuehlenhoff) p:05Triage→03Medium [14:31:49] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: (Need By: TBD) rack/setup/install atlas-codfw.wikimedia.org - https://phabricator.wikimedia.org/T273114 (10cmooney) @Papaul do you know what the status is with this device? I can confirm there are some characters visible via serial console / port 47... [15:02:57] 10Mail, 10Infrastructure-Foundations: Upgrade MXes to Bullseye - https://phabricator.wikimedia.org/T286911 (10MoritzMuehlenhoff) Ok, so let's proceed with option two. There's a test instance mx2002.wikimedia.org which I'll setup with the mx role and bullseye next week. To prevent this test server from accide... [15:22:48] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Switch buffer re-partition - cloudsw1-c8-eqiad - https://phabricator.wikimedia.org/T288036 (10dcaro) @cmooney hey, I acknowledge that tomorrow is a good time, ping me whenever you want to get it going :) [15:29:47] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Switch buffer re-partition - cloudsw1-d5-eqiad - https://phabricator.wikimedia.org/T288037 (10dcaro) Ack for tomorrow too (same as T288036) [15:54:32] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: (Need By: TBD) rack/setup/install atlas-codfw.wikimedia.org - https://phabricator.wikimedia.org/T273114 (10Papaul) I as far as i know I removed the old faulty device, replaced it with this on, connected the console, power and network to the device, t... [16:27:26] 10Puppet, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: Unused puppet resources audit, early 2021 - https://phabricator.wikimedia.org/T272559 (10Majavah) [19:37:53] 10CAS-SSO, 10Infrastructure-Foundations, 10Release-Engineering-Team, 10GitLab (Initialization), 10User-brennen: Open gitlab.wikimedia.org to all users with Wikimedia developer accounts - https://phabricator.wikimedia.org/T288162 (10brennen) [19:41:05] 10CAS-SSO, 10Infrastructure-Foundations, 10GitLab (Initialization), 10Patch-For-Review, and 2 others: Open gitlab.wikimedia.org to all users with Wikimedia developer accounts - https://phabricator.wikimedia.org/T288162 (10brennen) [21:42:52] 10Puppet, 10Infrastructure-Foundations, 10Wikidata: Migrate wikibase-dispatch-changes crons to systemd timers - https://phabricator.wikimedia.org/T288175 (10Legoktm)