[00:02:31] 10CAS-SSO, 10Infrastructure-Foundations: High DPI favicon for CAS - https://phabricator.wikimedia.org/T258379 (10Krinkle) p:05Triage→03Lowest [05:42:16] 10netbox, 10Infrastructure-Foundations: Agree how to document intra-DC patch panels in Netbox - https://phabricator.wikimedia.org/T293221 (10Aklapper) [08:00:48] 10netbox, 10netops, 10Infrastructure-Foundations: ImportPuppetDB virtual chassis detection bug - https://phabricator.wikimedia.org/T293330 (10ayounsi) [08:19:18] 10netbox, 10netops, 10Infrastructure-Foundations: ImportPuppetDB virtual chassis detection bug - https://phabricator.wikimedia.org/T293330 (10cmooney) Suggestion makes sense, using the rack names in the devices also keeps a consistent standard across sites. So yeah +1 from me, if this simple fix sorts the p... [08:22:33] FYI I'm rolling out debmonitor-client [08:23:38] 10netbox, 10netops, 10Infrastructure-Foundations: ImportPuppetDB virtual chassis detection bug - https://phabricator.wikimedia.org/T293330 (10ayounsi) 05Open→03Resolved a:03ayounsi Done and confirmed that it solves the issue. [08:26:52] ack [08:32:42] {done} only unreachable were testvm2001-2 [08:40:13] that's expected those are down due to some issues with the Ganeti test setup [08:45:40] ack, and then we have mw2280 that I think is down and our of puppetdb so ignored [10:33:57] 10netops, 10DNS, 10Infrastructure-Foundations, 10SRE, and 2 others: setup drmrs mgmt & private prefixs - question on switch status - https://phabricator.wikimedia.org/T293294 (10cmooney) > I'm thinking 10.136.0.0/16 for the site seems logical, with 10.136.128.0/17 for mgmt. Keep Vlan 900 for that also I as... [12:17:58] 10netops, 10DNS, 10Infrastructure-Foundations, 10SRE, and 2 others: setup drmrs mgmt & private prefixs - question on switch status - https://phabricator.wikimedia.org/T293294 (10MMandere) Thank you @cmooney for the inclusion. The assignments are fine by me. I will, however, need to further consult with... [12:30:26] 10netops, 10DNS, 10Infrastructure-Foundations, 10SRE, and 2 others: setup drmrs mgmt & private prefixs - question on switch status - https://phabricator.wikimedia.org/T293294 (10BBlack) >>! In T293294#7427708, @cmooney wrote: > We've two private subnets assigned, one for each rack/switch: > > https://netb... [14:19:09] 10netops, 10DNS, 10Infrastructure-Foundations, 10SRE, and 2 others: setup drmrs mgmt & private prefixs - question on switch status - https://phabricator.wikimedia.org/T293294 (10ayounsi) I created a bunch of mgmt related cables: https://netbox.wikimedia.org/dcim/cables/?q=&site=drmrs&type=&status=&color= A... [14:52:16] moritzm: fyi there was a small plip withthe apt switch; in that i had nothing pooled and as such got a response for failoid. however it is in place now [14:52:27] s/plip/blip/ [14:53:30] ack, if there's any issue we should see it quickly when the cronned apt-get update calls fail [14:54:11] yes also any blips should have cleared by now as it only had a 300s TTL just a heads up if anything trickls in [15:12:38] 10netops, 10DNS, 10Infrastructure-Foundations, 10SRE, and 2 others: setup drmrs mgmt & private prefixs - question on switch status - https://phabricator.wikimedia.org/T293294 (10ayounsi) 05Open→03Resolved v6 assigned as well, server's network provisioning tested with both public/private vlan as dry-run... [20:12:10] 10CAS-SSO, 10Infrastructure-Foundations, 10Observability-Metrics, 10SRE, 10User-jbond: thanos u/i gives errors if left idle for a few hours - https://phabricator.wikimedia.org/T268233 (10Krinkle) Some partial notes from a partial investigation: While using Thanos (and presumably Grafana as well) each lo... [20:12:43] 10CAS-SSO, 10Infrastructure-Foundations, 10Observability-Metrics, 10SRE, 10User-jbond: Thanos, Grafana, etc. break session after an hour - https://phabricator.wikimedia.org/T268233 (10Krinkle) [20:12:59] 10CAS-SSO, 10Infrastructure-Foundations, 10Observability-Metrics, 10SRE, 10User-jbond: Thanos and Grafana lose the session after an hour - https://phabricator.wikimedia.org/T268233 (10Krinkle)