[09:20:30] 10CAS-SSO, 10Infrastructure-Foundations, 10observability, 10Patch-For-Review: alerts.w.o / idp.w.o interaction and CORS - https://phabricator.wikimedia.org/T267186 (10fgiunchedi) 05Open→03Resolved a:03fgiunchedi I just got the session expired on alerts.w.o and the application correctly detected the s... [09:27:31] 10puppet-compiler, 10Infrastructure-Foundations, 10SRE, 10User-herron, 10User-jbond: Prevent puppet catalog compiler workers from running out of disk space - https://phabricator.wikimedia.org/T222075 (10fgiunchedi) [13:02:05] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Collect netflow data for internal traffic - https://phabricator.wikimedia.org/T263277 (10ayounsi) >>! In T263277#7570288, @JAllemandou wrote: > Am I right in assuming that this data has the same schema as the original `n... [13:11:48] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Collect netflow data for internal traffic - https://phabricator.wikimedia.org/T263277 (10JAllemandou) No need to detail the fields and schema :) About data augmentation, [[ https://github.com/wikimedia/analytics-refiner... [13:27:55] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Collect netflow data for internal traffic - https://phabricator.wikimedia.org/T263277 (10ayounsi) Cool, only `ip_version` and `region` are useful here. [14:24:10] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Collect netflow data for internal traffic - https://phabricator.wikimedia.org/T263277 (10Ottomata) Would it hurt to keep the same augmentations? If the schema is the sameish (it sounds like it is), we can just apply the... [14:30:52] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Collect netflow data for internal traffic - https://phabricator.wikimedia.org/T263277 (10JAllemandou) >>! In T263277#7572471, @Ottomata wrote: > Would it hurt to keep the same augmentations? If the schema is the sameish... [14:34:45] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Collect netflow data for internal traffic - https://phabricator.wikimedia.org/T263277 (10Ottomata) I'd prefer to avoid scheduling another special job for this if we can. Can we make the NetflowTransform functions smart... [14:37:33] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Collect netflow data for internal traffic - https://phabricator.wikimedia.org/T263277 (10JAllemandou) I have the opposite view: I'd rather have another job instead of custom logic to prevent doing something :) [14:43:38] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Collect netflow data for internal traffic - https://phabricator.wikimedia.org/T263277 (10Ottomata) Yeahh...but then we have to manage and maintain another custom ingestion job. We're trying to reduce the number of those... [15:41:30] 10netbox, 10Infrastructure-Foundations: Improve Netbox PuppetDB import script to set switch trunk port Vlans as needed - https://phabricator.wikimedia.org/T297784 (10Volans) [18:05:22] 10netops, 10Data-Engineering, 10Infrastructure-Foundations, 10SRE, 10Traffic-Icebox: Collect netflow data for internal traffic - https://phabricator.wikimedia.org/T263277 (10JAllemandou) >>! In T263277#7572522, @Ottomata wrote: > The custom logic could even just be varied on the hardcoded stream / tablen... [23:11:24] 10Mail, 10Infrastructure-Foundations, 10SRE: Forwards from VRT not making it to donate@ - https://phabricator.wikimedia.org/T297307 (10Dzahn) Since T128647 back in 2016, all fundraising related aliases should have been moved over to OIT (now ITS). See details from T128647#2087211 ff how Google groups were cr... [23:15:16] 10Mail, 10Infrastructure-Foundations, 10SRE: Forwards from VRT not making it to donate@ - https://phabricator.wikimedia.org/T297307 (10Dzahn) > However, the donor was sent to donations@ (rather than donate@ or fundraising@), This and the part that they are identical on our side makes me think it could be in... [23:16:03] 10Mail, 10Infrastructure-Foundations, 10SRE, 10Znuny: Forwards from VRT not making it to donate@ - https://phabricator.wikimedia.org/T297307 (10Dzahn)