[06:17:40] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: Access port speed <= 100Mbps False positives - https://phabricator.wikimedia.org/T336511 (10ayounsi) [06:18:26] 10netops, 10DC-Ops, 10Infrastructure-Foundations, 10SRE: Access port speed <= 100Mbps False positives - https://phabricator.wikimedia.org/T336511 (10ayounsi) I muted the alert for now until we can get to the bottom of it as it was spamming too much. [06:57:03] hello folks! [06:57:44] I had a chat with su*khe on Friday and IIUC the codfw lvs work is done, so in theory I am ok to proceed with my patch to create a new low traffic VIP [06:58:32] I checked modules/profile/manifests/lvs/configuration.pp and lvs2010 is in high-traffic2 and low-traffic, is it ok to proceed or something is still left to do? [06:59:07] no of course morning pebcak, I didn't git pull [06:59:20] all right all looks good, lemme know if it is ok to proceed later on :) [06:59:34] (targets: pybals on lvs2010 then 2009) [07:00:58] (https://gerrit.wikimedia.org/r/c/operations/puppet/+/918409) [08:11:32] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-tools, 10Patch-For-Review: Setup zero touch provisioning (ZTP) for network devices - https://phabricator.wikimedia.org/T336485 (10Volans) [08:25:56] proceeding with the restarts :) [08:32:46] all done! [08:43:41] all looking good afaics, I filed https://gerrit.wikimedia.org/r/c/operations/puppet/+/919795 to complete the rollout and get the DNS discovery setup [08:43:55] (the service is only active in codfw for the moment) [08:44:31] IIUC the above is a pre-requisite for https://gerrit.wikimedia.org/r/c/operations/dns/+/919785 [08:44:42] (after those I'll disappear I promise :D) [09:37:22] 10Traffic, 10SRE, 10Wikidata, 10wdwb-tech, 10wmde-wikidata-tech: Wikidata seems to still be utilizing insecure HTTP URIs - https://phabricator.wikimedia.org/T331356 (10Ladsgroup) Until it gets changed to HTTPS, basically we have two options: - Remove the link from sidebar and add it as text field in act... [09:40:38] 10Traffic, 10netops, 10DBA, 10Data-Platform-SRE, and 9 others: codfw row D switches upgrade - https://phabricator.wikimedia.org/T335042 (10MatthewVernon) [09:51:58] 10Traffic, 10SRE, 10serviceops, 10Platform Team Initiatives (API Gateway): Create Benthos image - https://phabricator.wikimedia.org/T336658 (10kamila) [09:52:21] 10Traffic, 10SRE, 10serviceops, 10Platform Team Initiatives (API Gateway): Create Benthos image - https://phabricator.wikimedia.org/T336658 (10kamila) 05Open→03In progress [09:52:25] 10Traffic, 10SRE, 10serviceops, 10Platform Team Initiatives (API Gateway): Handle edge cache invalidation for the api gateway - https://phabricator.wikimedia.org/T324200 (10kamila) [09:53:38] 10Traffic, 10SRE, 10serviceops, 10Platform Team Initiatives (API Gateway): Create Benthos docker image - https://phabricator.wikimedia.org/T336658 (10kamila) [12:35:21] 10Traffic, 10netops, 10DBA, 10Data-Platform-SRE, and 9 others: codfw row D switches upgrade - https://phabricator.wikimedia.org/T335042 (10MatthewVernon) [12:41:51] 10Traffic, 10netops, 10DBA, 10Data-Platform-SRE, and 9 others: codfw row D switches upgrade - https://phabricator.wikimedia.org/T335042 (10Jelto) [12:51:15] 10Traffic, 10SRE, 10serviceops, 10Platform Team Initiatives (API Gateway): Handle edge cache invalidation for the api gateway - https://phabricator.wikimedia.org/T324200 (10Ottomata) > Basically add a configuration that allows to figure out article_url => derived urls as a mapping, and eliminate all the n... [13:24:41] 10Traffic, 10Infrastructure-Foundations, 10SRE: Reimaging cookbook not forcing a Puppet agent run on lvs2011, lvs2012 - https://phabricator.wikimedia.org/T336593 (10Volans) @ssingh I'm not sure I agree with your renaming. What do you mean exactly? :) The only race I can think of is that the removal from pup... [13:38:58] 10Traffic, 10Infrastructure-Foundations, 10SRE: Reimaging cookbook not forcing a Puppet agent run on lvs2011, lvs2012 - https://phabricator.wikimedia.org/T336593 (10ssingh) >>! In T336593#8850410, @Volans wrote: > @ssingh I'm not sure I agree with your renaming. What do you mean exactly? :) "Reimaging cookb... [13:39:08] elukey: lovely [13:40:07] elukey: <3 [13:43:54] sorry for not getting back at that moment... I was driving to my medical check :) [13:49:25] 10Traffic, 10netops, 10DBA, 10Data-Platform-SRE, and 9 others: codfw row D switches upgrade - https://phabricator.wikimedia.org/T335042 (10ssingh) [13:51:11] vgutierrez: nono please no problem, I decided to proceed since it was relatively harmless, all works now! [13:53:19] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-tools, 10Patch-For-Review: Setup zero touch provisioning (ZTP) for network devices - https://phabricator.wikimedia.org/T336485 (10Volans) I've tested a reimage of a physical host and worked fine, we still have a bit of duplication of requests, do you s... [13:53:52] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-tools, 10Patch-For-Review: Setup zero touch provisioning (ZTP) for network devices - https://phabricator.wikimedia.org/T336485 (10Volans) [13:57:41] 10Traffic, 10SRE, 10serviceops, 10Platform Team Initiatives (API Gateway): Handle edge cache invalidation for the api gateway - https://phabricator.wikimedia.org/T324200 (10daniel) >>! In T324200#8850266, @Ottomata wrote: >> Basically add a configuration that allows to figure out article_url => derived ur... [14:45:34] 10Traffic, 10SRE, 10serviceops, 10Platform Team Initiatives (API Gateway): Handle edge cache invalidation for the api gateway - https://phabricator.wikimedia.org/T324200 (10Joe) >>! In T324200#8850266, @Ottomata wrote: >> Basically add a configuration that allows to figure out article_url => derived urls... [15:03:01] 10netops, 10Infrastructure-Foundations, 10SRE, 10SRE-tools: Setup zero touch provisioning (ZTP) for network devices - https://phabricator.wikimedia.org/T336485 (10ayounsi) @Volans is it possible to have a full pcap of those `unknown network segment` ?