[07:02:51] <wikibugs>	 10Traffic, 10DBA, 10Data-Engineering, 10Data-Persistence, and 9 others: eqiad row A switches upgrade - https://phabricator.wikimedia.org/T329073 (10Marostegui)
[09:42:37] <wikibugs>	 10Traffic, 10Data-Engineering-Planning, 10Observability-Alerting, 10SRE, 10Shared-Data-Infrastructure (Shared-Data-Infra Sprint 08): Reduce/eliminate false positives for VarnishKafkaNoMessages alert - https://phabricator.wikimedia.org/T324522 (10nfraison) False alert has still been reported today in (Var...
[11:04:18] <wikibugs>	 10Traffic, 10Performance-Team (Radar): unwind the Puppetized /etc/hosts override of statsd.eqiad.wmnet - https://phabricator.wikimedia.org/T239862 (10Clement_Goubert) Removing this entry broke Page Previews metrics, and possibly others. Reverted in https://gerrit.wikimedia.org/r/c/operations/puppet/+/887762 A...
[11:05:01] <wikibugs>	 10Traffic, 10Data-Engineering-Planning, 10Observability-Alerting, 10SRE, and 2 others: Reduce/eliminate false positives for VarnishKafkaNoMessages alert - https://phabricator.wikimedia.org/T324522 (10nfraison) From those graph we can see that no requests have been received on the varnish which leads to no...
[11:09:55] <wikibugs>	 10Traffic, 10Data-Engineering-Planning, 10Observability-Alerting, 10SRE, and 2 others: Reduce/eliminate false positives for VarnishKafkaNoMessages alert - https://phabricator.wikimedia.org/T324522 (10nfraison) The drop is indeed due to a depool  ` 09:09  <vgutierrez>  pool cp4044 with ESI testing enabled...
[11:45:58] <wikibugs>	 10Wikimedia-Apache-configuration, 10Patch-For-Review: remove pk.wikimedia.org -> wikimediapakistan.org redirect - https://phabricator.wikimedia.org/T328596 (10Aklapper) p:05Triage→03Low a:03Aklapper This would revert {T56780} (mentioning only for cross-linking)
[12:22:35] <wikibugs>	 10Traffic, 10Data-Engineering-Planning, 10Observability-Alerting, 10SRE, and 2 others: Reduce/eliminate false positives for VarnishKafkaNoMessages alert - https://phabricator.wikimedia.org/T324522 (10nfraison) I've looked back at the alerts we have faced on the 7th morning and those ones where due to a rol...
[15:15:10] <wikibugs>	 10Traffic, 10Performance-Team (Radar): unwind the Puppetized /etc/hosts override of statsd.eqiad.wmnet - https://phabricator.wikimedia.org/T239862 (10Clement_Goubert) `stasd-proxy` udp6 support added by @herron in https://gerrit.wikimedia.org/r/c/operations/puppet/+/887804
[16:44:16] <wikibugs>	 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10cmooney) @Jclark-ctr can I get an update on the situation here / estimate of when we might be able to add the 4 links detailed above?  Ping...
[19:18:12] <wikibugs>	 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Q2:(Need By: TBD) Rows E/F network racking task - https://phabricator.wikimedia.org/T292095 (10Jclark-ctr)  @cmooney sorry for delay finished connecting links and updated cableid's
[21:17:38] <wikibugs>	 10Traffic: create a puppetized abstraction for haproxy blocklist hysteresis - https://phabricator.wikimedia.org/T329331 (10CDanis)
[21:17:51] <wikibugs>	 10Traffic: create a puppetized abstraction for haproxy blocklist hysteresis - https://phabricator.wikimedia.org/T329331 (10CDanis)
[21:18:22] <wikibugs>	 10Traffic: create a puppetized abstraction for haproxy blocklist hysteresis - https://phabricator.wikimedia.org/T329331 (10CDanis)
[21:19:59] <wikibugs>	 10Traffic: create a puppetized abstraction for haproxy blocklist hysteresis - https://phabricator.wikimedia.org/T329331 (10CDanis)
[21:29:32] <wikibugs>	 10Traffic, 10SRE: create a puppetized abstraction for haproxy blocklist hysteresis - https://phabricator.wikimedia.org/T329331 (10CDanis)
[21:47:24] <wikibugs>	 10Traffic, 10SRE, 10Data Pipelines (Sprint 08): Document Impact of Jan 8&9 Traffic Data Loss - https://phabricator.wikimedia.org/T326658 (10Snwachukwu) Here is a google [[ https://docs.google.com/document/d/1rz7L24EVECOKYGhn-GTUIGo3NmbCIGCQW9XXLNrxCEM/edit# | doc ]] containing a draft
[23:14:35] <wikibugs>	 10Traffic, 10SRE: Test ESI feasibility with current Varnish installation - https://phabricator.wikimedia.org/T308799 (10tstarling) Regarding the concern that malicious user input could lead to injection of ESI tags:  * In the old parser:   * HTML comments in user input are completely removed   * Angle brackets...