[07:09:07] 10Traffic, 10Performance-Team, 10SRE, 10Performance Issue: en.wiki slow to respond when editing, and occasionally throws an error with Chrome search shortcuts, or blocked because missing HTTPS - https://phabricator.wikimedia.org/T326496 (10larissagaulia) 05Open→03Resolved a:03larissagaulia [08:04:43] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) On ulsfo: > I had no issues in the lab going from 14.1X53-D54.1 (It was the only available in the lab) to 19.1. (the closest version available on t... [09:00:54] 10Traffic, 10API Platform, 10Discovery-Search: Generic strategy to deal with high volume / expensive traffic from cloud providers - https://phabricator.wikimedia.org/T326782 (10Gehel) [09:31:43] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ops-monitoring-bot) Icinga downtime and Alertmanager silence (ID=43642849-a893-44f6-961e-0bb82f3a9b4e) set by ayounsi@cumin1001 for 2:00:00 on 36 host(s) an... [10:15:28] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) [10:15:53] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) 10min downtime, everything went smooth. [10:16:47] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-OnFire, and 2 others: Upgrade POPs asw to Junos 21 - https://phabricator.wikimedia.org/T316532 (10ayounsi) [10:45:49] hi traffic can i get some input on https://gerrit.wikimedia.org/r/c/operations/puppet/+/879409. we would like to re-use the wikimedia_domains list in the no_proxy config but it would mean droppping wikimediafoundation.org from the list. thanks [10:51:38] jbond: I had a chat with vgutierrez, and the reason to keep it in there is in case we need to start hosting sub-domains internally [10:52:11] jbond: maybe we can still use it with an exclude list for the no_proxy? [10:52:37] XioNoX: ahh ok thanks [10:53:07] jbond: but also maybe it's cleaner to drop it, and re-add it the day it's needed (if ever) [10:53:24] so giving some context, but I don't have the last word there [10:53:35] XioNoX: i was just considering that because if we start hosting subdomains we would also need it in the no_proxy list [12:01:56] (PyBalBGPUnstable) firing: (2) PyBal BGP sessions on instance lvs3005 are failing - TODO - https://alerts.wikimedia.org/?q=alertname%3DPyBalBGPUnstable [12:04:17] 10netops, 10Infrastructure-Foundations, 10SRE: cr2-esams:FPC0 Parity error - https://phabricator.wikimedia.org/T318783 (10ayounsi) 05Open→03Resolved I shutdown the linecard and remote hands re-seat it. Hopefully that solved it for good. [12:06:56] (PyBalBGPUnstable) resolved: (3) PyBal BGP sessions on instance lvs3005 are failing - TODO - https://alerts.wikimedia.org/?q=alertname%3DPyBalBGPUnstable [15:15:30] 10Traffic, 10SRE: Remove IPSec/Strongswan from Puppet repository - https://phabricator.wikimedia.org/T326745 (10BBlack) https://gerrit.wikimedia.org/r/c/operations/puppet/+/875897/ ! (apparently someone was already working on this!) [16:54:16] 10Traffic, 10DC-Ops, 10SRE, 10ops-ulsfo: ulsfo refresh scheduling - https://phabricator.wikimedia.org/T317249 (10RobH) 05Open→03Resolved [16:54:38] 10Traffic, 10DC-Ops, 10SRE, 10ops-ulsfo, 10Patch-For-Review: Q1:rack/setup/install cp40[37-51] - https://phabricator.wikimedia.org/T317244 (10RobH) [16:55:13] 10Traffic, 10SRE, 10decommission-hardware, 10ops-ulsfo: decommission dns4001 - https://phabricator.wikimedia.org/T319215 (10RobH) 05Open→03Resolved this host is now gone [17:42:51] 10Traffic, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: add HBA355i support to installer - https://phabricator.wikimedia.org/T319067 (10RobH) [17:44:25] 10Traffic, 10DC-Ops, 10SRE, 10ops-ulsfo, 10Patch-For-Review: Q1:rack/setup/install cp40[37-51] - https://phabricator.wikimedia.org/T317244 (10ssingh) [17:45:21] 10Traffic, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review: add HBA355i support to installer - https://phabricator.wikimedia.org/T319067 (10ssingh) 05Open→03Resolved I think we can close this task and mark it as resolved. The original purpose for which this was required has now been met and fut... [19:03:06] 10Traffic, 10SRE, 10Patch-For-Review: haproxy: work on systemd unit hardening (cp hosts) - https://phabricator.wikimedia.org/T323944 (10ssingh) The hardened haproxy unit has been running for a while on traffic-cache-bullseye.traffic.eqiad1.wikimedia.cloud without any issues. Pending any further comments or i... [20:11:53] 10Traffic, 10SRE: Remove IPSec/Strongswan from Puppet repository - https://phabricator.wikimedia.org/T326745 (10BCornwall) 05Open→03Resolved It's merged, so I guess this can be closed. :)