[04:25:40] Time to raid the forums! [04:25:41] Ready [04:25:54] unless InceptionTime is in this channel ready to ban me [04:26:10] InceptionTime is not in this channel [04:26:14] starting the raid [04:26:15] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:15] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:15] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:16] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:16] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:16] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:16] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:17] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:17] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:18] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:18] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:19] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:19] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:20] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:48] This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:48] This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:48] This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:49] This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:50] This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:50] This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:51] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:52] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:52] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:52] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:53] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:53] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:54] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:54] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:54] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [04:26:55] * quackityishot_ This channel is disgusting (https://www.youtube.com/channel/UCbHTHyob9OIQaVAw6nFmq4Q) PLEASE RAID THAT CHANNEL AND SUB TO MY CHANNEL (https://www.youtube.com/Quackity) [08:53:40] 10Traffic, 10Data Pipelines, 10Data-Engineering-Planning, 10Foundational Technology Requests, 10User-fgiunchedi: Add a webrequest sampled topic and ingest into druid/turnilo - https://phabricator.wikimedia.org/T314981 (10elukey) Cross posting: T310997#8378791 Me and Filippo are working on a prototype wi... [12:14:04] 10Traffic, 10SRE, 10Patch-For-Review: Upgrade Traffic hosts to bullseye - https://phabricator.wikimedia.org/T321309 (10ssingh) The install of the updated trafficserver package for bullseye fails on a bullseye host with the message: ` The following packages have unmet dependencies: trafficserver : Depends:... [12:42:07] 10Traffic, 10SRE, 10Patch-For-Review: Upgrade Traffic hosts to bullseye - https://phabricator.wikimedia.org/T321309 (10MoritzMuehlenhoff) >>! In T321309#8382745, @ssingh wrote: > I am not aware of the reasons why we build with `BACKPORT=yes` but just to confirm that there are no other differences: Probably... [12:49:40] 10Traffic, 10SRE, 10Patch-For-Review: Upgrade Traffic hosts to bullseye - https://phabricator.wikimedia.org/T321309 (10ssingh) >>! In T321309#8382869, @MoritzMuehlenhoff wrote: >>>! In T321309#8382745, @ssingh wrote: >> I am not aware of the reasons why we build with `BACKPORT=yes` but just to confirm that t... [17:10:39] 10Traffic, 10SRE, 10Patch-For-Review: Enterprise redirect for wikimediaenterprise.com to enterprise.wikimedia.com - https://phabricator.wikimedia.org/T321804 (10Vgutierrez) 05Stalled→03Resolved a:03Vgutierrez `vgutierrez@ncredir6001:~$ curl -L -I http://wikimediaenterprise.com HTTP/1.1 301 Moved Perma... [17:20:43] kwakuofori: can you suggest an alternate time for the team API interview? I know our timezones don't overlap very much :( [17:33:59] andrewbogott: will do. looking more like early next week. hope that works? [17:47:41] 10netops, 10Infrastructure-Foundations, 10SRE, 10Patch-For-Review, 10cloud-services-team (Kanban): Move WMCS servers to 1 NIC - https://phabricator.wikimedia.org/T319184 (10aborrero) [17:56:24] kwakuofori: yep, that's fine! I will try to get my calendar up to date so you can tell when I'm free [17:56:29] thx [18:27:07] looks like puppet is failing to run on all cache-upload nodes [18:27:59] Could not retrieve catalog from remote server: Error 500 on SERVER: Server Error: Evaluation Error: Error while evaluating a Resource Statement, Evaluation Error: Error while evaluating a Resource Statement, Unknown resource type: 'prometheus::node_trafficserver_config' (file: /etc/puppet/modules/profile/manifests/trafficserver/monitoring.pp, line: 66, column: 5) (file: [18:28:01] /etc/puppet/modules/profile/manifests/trafficserver/backend.pp, line: 156) on node cp3063.esams.wmnet [18:30:21] brett: ^ ? [18:31:17] ack [18:31:37] probably need to revert out the recent related patches and then fix, or something [18:32:20] https://gerrit.wikimedia.org/r/c/operations/puppet/+/854605 [18:36:05] I suspect it's because prometheus::node_trafficserver_config is a class instead of a define? I missed that :/ [18:36:29] either way if those two patches are interdependent you'll have to unwind in reverse order [18:37:12] They're not [18:37:24] Looks like a new linting rule is in effect? [18:38:08] oh, no, it doesn't like my commit message [18:39:32] I should have used pcc, my bad [18:43:54] Should I just +2 it myself and revert in this instance? [18:44:05] * brett patiently waits otherwise [18:45:30] brett: yeah, self-+2 to fix breakages is good [18:46:00] cdanis: Thanks for bringing it to my attention and sorry for the bother ._. [18:47:54] np! [18:48:09] cdanis: How did you learn about these failures? [18:48:30] there was an alert about excessive puppet failures in #-operations while I was looking [18:48:37] and then I peeked puppetboard.wikimedia.org for details [18:48:47] not to harp on it, but, I always PCC even for trivial puppet patches -- for the vast majority of the code, "CI passed" tells you almost nothing [18:49:50] Ah, I didn't do pcc because valentin had done it on a previous PS. Still, my bad [18:50:14] if you want to get the ~90 hosts with failed puppet recovery soon~ish you can use: [18:50:17] https://wikitech.wikimedia.org/wiki/Cumin#Run_Puppet_only_if_last_run_failed [18:50:44] with something like A:cp-upload for example in this case [18:51:01] instead of '*' [18:54:25] Hm, pcc still passes even on the last PS: https://integration.wikimedia.org/ci/job/operations-puppet-catalog-compiler/38053/console [19:06:57] Funny [19:07:04] Sorry about that brett [19:19:49] no reason to be sorry