[10:07:26] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Netbox DB is growing out of control - https://phabricator.wikimedia.org/T311048 (10ayounsi) 05Open→03Resolved a:03ayounsi Deployed and tested (twice) on Netbox-next: ` ayounsi@netbox-dev2002:/srv/deployment/netbox-extras$ journalctl -u netbox_... [10:12:17] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Upgrade pynetbox - https://phabricator.wikimedia.org/T310745 (10ayounsi) [10:45:47] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Netbox add hourly postgres backups - https://phabricator.wikimedia.org/T262677 (10ayounsi) 05Open→03Resolved a:03ayounsi This is done, hourly on the secondary DB and daily on the primary (as suggested on T310615) Impact on the DB seems to be f... [10:45:50] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Netbox: replace CSV dump with more frequent DB dumps - https://phabricator.wikimedia.org/T310615 (10ayounsi) [10:46:00] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Netbox add hourly postgres backups - https://phabricator.wikimedia.org/T262677 (10ayounsi) And doc updated. [11:06:36] 10netbox, 10Infrastructure-Foundations: Netbox: Investigate and Assess ways of easing backups and restores - https://phabricator.wikimedia.org/T253139 (10ayounsi) [11:06:38] 10netbox, 10Infrastructure-Foundations: Netbox CSV dumps can't be compared - https://phabricator.wikimedia.org/T262671 (10ayounsi) [11:07:09] 10netbox, 10Infrastructure-Foundations: Netbox CSV dumps can't be compared - https://phabricator.wikimedia.org/T262671 (10ayounsi) 05Open→03Declined CSV dumps decommissioned. [11:07:16] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Netbox: replace CSV dump with more frequent DB dumps - https://phabricator.wikimedia.org/T310615 (10ayounsi) 05Open→03Resolved a:03ayounsi CSV dumps removed and doc updated. [11:09:16] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Upgrade pynetbox - https://phabricator.wikimedia.org/T310745 (10ayounsi) [13:02:05] 10netops, 10Infrastructure-Foundations, 10SRE: Complete testing of SONiC NOS / Dell network gear and write up - https://phabricator.wikimedia.org/T310901 (10cmooney) @ayounsi @Papaul I've done the first draft of the summary here: https://wikitech.wikimedia.org/wiki/Dell_Enterprise_Sonic_Evaluation Feel fre... [13:16:00] 10netops, 10Infrastructure-Foundations, 10SRE: Complete testing of SONiC NOS / Dell network gear and write up - https://phabricator.wikimedia.org/T310901 (10Papaul) @cmooney thanks for putting this together. [14:00:53] Hello. I'm trying to add a component (thirdparty/bigtop15) to a distribution (bullseye-wikimedia) [14:01:17] I just can't see why my PCC here is a noop, when I thought it was a simple file update: https://gerrit.wikimedia.org/r/c/operations/puppet/+/821223 [14:01:33] Can anyone see what I might be doing wrong? Thanks. [14:01:46] Ref: https://phabricator.wikimedia.org/T310643 [14:05:56] btullis: I suspect that's because no puppet resource is actually being changed, the file resource just has source => 'puppet:///modules/...' but that part says unchanged [14:13:22] taavi: Thanks. That's the resource I'm trying to change though. `modules/aptrepo/files/distributions-wikimedia` [14:14:02] no, you're changing that file, not the manifest that copies that file to the instance [14:19:28] Yes, sorry for incorrect terminology. I think I'm changing the source file, but it doesn't seem to be updated on the apt*.wikimedia.org hosts [14:19:49] Any, no hurry. I can come back to look at it with fresh eyes another time. [14:25:08] btullis: tl;dr this is expected behaviour, the source file is not included uit the compiled catalogue its is fetched by the agent as it applies the catalogue. As such pcc has no knowlage of the source file content [14:26:00] cr lgtm will merge [14:26:03] Ah, thanks jbond. I remember now. [14:26:17] np :) [14:27:33] btullis: thats deployed now [14:28:29] Thank you jbond and taavi. <3 [14:37:18] 10netbox, 10Infrastructure-Foundations, 10Security: Add CSP headers to Netbox - https://phabricator.wikimedia.org/T296356 (10sbassett) p:05Triage→03Low [14:58:42] I see someone bolded one of my items from the meeting, any questions I can answer? jbond jhathaway [14:59:38] not me, though now I am reading the linked task [15:00:09] could have been topranks as well [15:00:23] or XioNoX [15:00:50] ah i was just reading the attendees line from the etherpad [15:01:05] Wasn’t me - does look interesting though! [15:01:08] cdanis: yeah it was me to get a refresher, nothing urgnent [15:01:12] ah ok! [15:01:36] it turns out I made an error and now I have to re-do a bunch of the analysis but also I expect most of it to hold up, just the thresholds/absolute numbers being different [15:18:17] 10netbox, 10Infrastructure-Foundations: ganeti-netbox-sync.py fails in dry-mode - https://phabricator.wikimedia.org/T314794 (10ayounsi) p:05Triage→03Low [15:19:36] 10netbox, 10Infrastructure-Foundations: ganeti-netbox-sync.py fails in dry-mode - https://phabricator.wikimedia.org/T314794 (10ayounsi) [15:20:22] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Upgrade pynetbox - https://phabricator.wikimedia.org/T310745 (10ayounsi) [15:20:46] sukhe: your pynetbox 6.6.0 package works perfectly [15:34:40] XioNoX: nice! let's import it into main then? I will prepare the patches but let me know when and if we should import it [15:35:39] sukhe: anytime works [15:38:20] ok we will just import it into main then, not the component. no patch required then. I will import the deb [15:38:31] thanks! [15:49:12] XioNoX: import in main for bullseye [15:49:15] *ed [15:49:35] sukhe: awesome! thanks again! [15:52:43] np :) it's good practise [15:52:44] https://debmonitor.wikimedia.org/packages/python3-pynetbox [15:53:05] (not running any upgrades but was just checking if it is reflected) [16:34:57] 10netbox, 10Infrastructure-Foundations: Netbox: Investigate and Assess ways of easing backups and restores - https://phabricator.wikimedia.org/T253139 (10ayounsi) 05Open→03Resolved a:03ayounsi Hourly Postgres dumps + doc updated: https://wikitech.wikimedia.org/wiki/Netbox#PostgresSQL [16:35:09] 10netbox, 10Infrastructure-Foundations: Netbox missing hourly dumps - https://phabricator.wikimedia.org/T262674 (10ayounsi) 05Open→03Invalid CSV dumps discontinued. [17:15:54] jobo: based on staggered arrivals spreadsheet, have you decided yet on what dates people should book travel? [17:21:23] or do I go based on the dates in the "SRE Summit/Research Offsite - Travel Booking Open" email? [19:23:21] 10netbox, 10Infrastructure-Foundations, 10Patch-For-Review: Upgrade pynetbox - https://phabricator.wikimedia.org/T310745 (10ayounsi) [20:01:06] 10Puppet, 10netbox, 10Infrastructure-Foundations, 10PostgreSQL: Puppet change at each run on postgres replicas - https://phabricator.wikimedia.org/T311156 (10ayounsi) 05Open→03Resolved This seems to be fixed based on puppetboard.