[05:22:10] 10Traffic, 10MW-on-K8s, 10serviceops: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10jijiki) [06:44:08] 10Traffic, 10SRE, 10vm-requests: Please create a Ganeti VM for durum in eqiad - https://phabricator.wikimedia.org/T290599 (10Dzahn) @ssingh Does it matter if durum1001 and durum1002 are in separate rows? [06:47:51] 10Traffic, 10SRE, 10vm-requests: Please create a Ganeti VM for durum in eqiad - https://phabricator.wikimedia.org/T290599 (10Dzahn) Ready to create Ganeti VM durum1002.eqiad.wmnet in the ganeti01.svc.eqiad.wmnet cluster on row B with 2 vCPUs, 4GB of RAM, 15GB of disk in the private network. [07:16:50] hi folks, FYI later today I'll be moving swift traffic fully back to codfw to rebalance eqiad, context is https://phabricator.wikimedia.org/T287539 [07:25:18] 10Traffic, 10SRE, 10vm-requests, 10Patch-For-Review: Please create a Ganeti VM for durum in eqiad - https://phabricator.wikimedia.org/T290599 (10Dzahn) @ssingh durum1002 has been created and OS is already installed. It sits at login and "insetup" now. [07:25:31] 10Traffic, 10SRE, 10vm-requests, 10Patch-For-Review: Please create a Ganeti VM for durum in eqiad - https://phabricator.wikimedia.org/T290599 (10Dzahn) 05Openβ†’03Resolved a:03Dzahn [07:40:13] thanks godog [07:41:10] sure! [07:41:10] go ema [07:41:15] lolno.mkv [07:44:48] I do enjoy some cheering in the morning [07:45:45] haha you're welcome [08:18:56] (VarnishTrafficDrop) firing: 45% GET drop in text@ during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [08:23:56] (VarnishTrafficDrop) resolved: 60% GET drop in text@ during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [08:24:56] (VarnishTrafficDrop) firing: 59% GET drop in text@ during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [08:29:11] (VarnishTrafficDrop) resolved: 59% GET drop in text@ during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [08:52:57] (VarnishTrafficDrop) firing: 67% GET drop in text@ during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [08:58:10] ok moving swift traffic now [09:27:57] (VarnishTrafficDrop) resolved: 65% GET drop in text@ during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [10:40:48] 10Traffic, 10SRE, 10Patch-For-Review, 10Performance-Team (Radar): Test haproxy as a WMF's CDN TLS terminator with real traffic - https://phabricator.wikimedia.org/T290005 (10Vgutierrez) [12:56:11] 10Traffic, 10MW-on-K8s, 10SRE, 10serviceops: Serve production traffic via Kubernetes - https://phabricator.wikimedia.org/T290536 (10akosiaris) p:05Triageβ†’03Medium [14:00:04] 10Traffic, 10SRE, 10Patch-For-Review, 10Performance-Team (Radar): Test haproxy as a WMF's CDN TLS terminator with real traffic - https://phabricator.wikimedia.org/T290005 (10Vgutierrez) [15:42:08] 10Traffic, 10SRE, 10vm-requests: Please create Ganeti VMs for durum - https://phabricator.wikimedia.org/T290672 (10ssingh) [16:43:31] 10netops, 10Infrastructure-Foundations, 10SRE, 10ops-eqiad: Switch failure: asw2-a8-eqiad Aug 13th 2021 - https://phabricator.wikimedia.org/T288834 (10Cmjohnson) 05Openβ†’03Resolved I am resolving this taks, if the issue persists please re-open [20:05:14] 10Traffic, 10SRE: Let's Encrypt issuance chains update - https://phabricator.wikimedia.org/T283164 (10TheDJ) Note, it’s September ! [21:16:34] 10Traffic, 10DC-Ops, 10ops-ulsfo: Q1:(Need By: TBD) rack/setup/install cp403[3-6].ulsfo.wmnet - https://phabricator.wikimedia.org/T290694 (10RobH) [21:16:43] 10Traffic, 10DC-Ops, 10ops-ulsfo: Q1:(Need By: TBD) rack/setup/install cp403[3-6].ulsfo.wmnet - https://phabricator.wikimedia.org/T290694 (10RobH)