[00:40:56] (VarnishTrafficDrop) firing: 44% GET drop in text@ during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [00:45:56] (VarnishTrafficDrop) resolved: 46% GET drop in text@ during the past 30 minutes - https://grafana.wikimedia.org/d/000000180/varnish-http-requests?viewPanel=6 - https://alerts.wikimedia.org [05:29:05] 10Traffic, 10InternetArchiveBot, 10SRE, 10Platform Team Workboards (Clinic Duty Team): IAbot sending a huge volume of action=raw requests (HTTP 415 errors) - https://phabricator.wikimedia.org/T269914 (10jijiki) @Cyberpower678 please respond to the above comment [10:23:45] hello folks, any news for the feasibility of LVS + Analytics vlans? :) [10:23:49] (forgot to ask the other week) [10:45:03] 10Traffic, 10SRE: (adjust cert monitoring on planet and phabricator) Certificate *.wikipedia.org valid until 2021-08-14 08:01:46 - https://phabricator.wikimedia.org/T286713 (10Dzahn) 05Open→03Resolved Thinking about this again I think we are good here now. One of the 2 checks was removed, the other stayed.... [12:07:19] 10Traffic, 10Maps, 10Product-Infrastructure-Team-Backlog, 10SRE, and 2 others: Support maps serving for affiliate sites via an allow list - https://phabricator.wikimedia.org/T261694 (10MSantos) Thanks, @Elitre! [14:09:51] 10Traffic, 10SRE, 10serviceops: Unexpected upload speed to commons - https://phabricator.wikimedia.org/T288481 (10aborrero) I also tried using the pywikibot upload script, with similar result. This time, however, the script mentions ` action 'upload', server said: ('internal_api_error_DBQueryError', '[d8e17... [16:18:21] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Join ARIN waiting list to request additional IPv4 resources. - https://phabricator.wikimedia.org/T288342 (10nskaggs) @aborrero can you ensure our future needs are expressed here? [16:20:15] 10netops, 10DC-Ops, 10SRE, 10ops-codfw, 10Wikimedia-Incident: asw-a2-codfw unresponsive - https://phabricator.wikimedia.org/T286787 (10Papaul) 05Open→03Resolved Received the replacement switch. Rack in C1 U43. setup the mgmt password same as the server mgmt password. Update Netbox with new serial num... [16:24:46] 10netops, 10Infrastructure-Foundations, 10SRE, 10cloud-services-team (Kanban): Join ARIN waiting list to request additional IPv4 resources. - https://phabricator.wikimedia.org/T288342 (10cmooney) @nskaggs @aborrero might be better to add that to the parent task thanks. [17:02:23] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: (Need By: TBD) rack/setup/install atlas-codfw.wikimedia.org - https://phabricator.wikimedia.org/T273114 (10RobH) Can the setup of this device please be noted on https://wikitech.wikimedia.org/wiki/SRE/Dc-operations/Platform-specific_documentation/Atl... [17:03:24] 10Acme-chief, 10cloud-services-team (Kanban): acme-chief sometimes doesn't refresh certificates because it ignores SIGHUP - https://phabricator.wikimedia.org/T273956 (10dcaro) a:05dcaro→03None [18:54:15] 10Traffic, 10SRE, 10serviceops, 10Datacenter-Switchover, 10Patch-For-Review: Services without a service IP cannot automatically be switched by the switchdc cookbook - https://phabricator.wikimedia.org/T285707 (10Legoktm) p:05High→03Medium [20:42:38] 10Traffic, 10decommission-hardware: decommission bast4002.wikimedia.org - https://phabricator.wikimedia.org/T288579 (10ssingh) [21:45:37] 10netops, 10Infrastructure-Foundations, 10SRE, 10decommission-hardware, 10ops-eqiad: Decommission asw-c-eqiad - https://phabricator.wikimedia.org/T208734 (10Jclark-ctr) [21:46:11] 10netops, 10Infrastructure-Foundations, 10SRE, 10decommission-hardware, 10ops-eqiad: Decommission asw-c-eqiad - https://phabricator.wikimedia.org/T208734 (10Jclark-ctr) Preformed factory reset removed from rack, updated netbox [21:46:28] 10netops, 10Infrastructure-Foundations, 10SRE, 10decommission-hardware, 10ops-eqiad: Decommission asw-c-eqiad - https://phabricator.wikimedia.org/T208734 (10Jclark-ctr) 05Open→03Resolved