[07:50:20] 10HTTPS, 10Traffic, 10Research, 10SRE, and 4 others: Set an explicit "Origin When Cross-Origin" referer policy via the meta referrer tag - https://phabricator.wikimedia.org/T87276 (10Xover) >>! In T87276#8784283, @Xover wrote: > This is still spewing errors in the console for every page load in Safari due... [08:05:17] 10HTTPS, 10Traffic, 10Research, 10SRE, and 4 others: Set an explicit "Origin When Cross-Origin" referer policy via the meta referrer tag - https://phabricator.wikimedia.org/T87276 (10TheDJ) Removal is already in progress via T338183 [09:37:29] 10netops, 10Infrastructure-Foundations: xe-3/2/1: down -> Transport: cr1-esams:xe-0/0/7 (Lumen, BDFS2448 80ms 10Gbps wave) {#2013} - https://phabricator.wikimedia.org/T345138 (10Clement_Goubert) [09:39:26] 10netops, 10Infrastructure-Foundations: xe-3/2/1: down -> Transport: cr1-esams:xe-0/0/7 (Lumen, BDFS2448 80ms 10Gbps wave) {#2013} - https://phabricator.wikimedia.org/T345138 (10ops-monitoring-bot) ===== Automated diagnostic for Netbox interface ID cr1-esams:xe-0/0/7 --- **Interface cr1-esams:xe-0/0/7** - adm... [09:47:03] 10Traffic, 10Observability-Metrics, 10Patch-For-Review: Add prometheus-https load balancer - https://phabricator.wikimedia.org/T326657 (10Clement_Goubert) Hi, Just FYI, JS and CSS are currently broken on `prometheus-{eqiad,codfw}.wikipedia.org` due to 401 and 403 errors, with some CORS sprinkled in {P51863} [10:59:23] XioNoX: I'm kinda puzzled with some wireshark capture here [10:59:49] I'm fetching a big blob from upload@esams. First capture showed up some 30k bytes TCP packets [11:00:21] vgutierrez: probably NIC offload [11:00:33] after getting rid of TSO in my machine, it went down to ~2900 bytes packets [11:00:49] still some NIC offloading? [11:01:21] vgutierrez: where are you doing the capture? [11:01:44] fixed :) I needed to turn GRO off as well [11:02:17] cool :) [12:24:02] 10netops, 10Infrastructure-Foundations, 10SRE: xe-3/2/1: down -> Transport: cr1-esams:xe-0/0/7 (Lumen, BDFS2448 80ms 10Gbps wave) {#2013} - https://phabricator.wikimedia.org/T345138 (10ayounsi) > Currently your circuit is being affected by a higher level outage. I will continue to provide updates as I recei... [12:40:13] 10netops, 10Cloud-VPS, 10Infrastructure-Foundations, 10SRE, and 2 others: Move cloud vps ns-recursor IPs to host/row-independent addressing - https://phabricator.wikimedia.org/T307357 (10aborrero) [13:43:56] 10Traffic, 10Observability-Metrics, 10Patch-For-Review: Add prometheus-https load balancer - https://phabricator.wikimedia.org/T326657 (10herron) >>! In T326657#9126098, @Clement_Goubert wrote: > Hi, > > Just FYI, JS and CSS are currently broken on `prometheus-{eqiad,codfw}.wikipedia.org` due to 401 and 403...