[08:19:03] jbond: thanks for digging into puppetdb and postgres in the last few days! Let me know if I can help with anything. [08:19:25] oh wait, he's on vacation starting today... [08:19:40] moritzm: do you know if there is anything very rurge [08:19:48] *urgent there that I should pick up? [08:22:46] nothing urgent, no. the reconciliation timer is working fine, this didn't trigger any impact over the weekend [08:23:13] the underlying root cause with the vacuuming setting still needs to be figured out/fixed [08:23:19] ack [08:23:35] but this isn't urgent in the sense that things break without it by now [09:40:45] volans: looks like it's just the two of us for the IF meeting (Irish bank holiday and John/Arzhel/Chris out), let's do async? [09:44:00] +1 for me I was out most of last week [09:44:03] not too much to report [09:45:13] ack, sounds good [11:16:06] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, and 2 others: Switch buffer re-partition - Eqiad Row A - https://phabricator.wikimedia.org/T286032 (10Marostegui) [11:21:55] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, and 2 others: Switch buffer re-partition - Eqiad Row A - https://phabricator.wikimedia.org/T286032 (10Majavah) [11:22:13] 10netops, 10DBA, 10Infrastructure-Foundations, 10SRE, and 2 others: Switch buffer re-partition - Eqiad Row A - https://phabricator.wikimedia.org/T286032 (10Majavah) [11:23:36] 10netops, 10Analytics, 10DBA, 10Infrastructure-Foundations, and 2 others: Switch buffer re-partition - Eqiad Row C - https://phabricator.wikimedia.org/T286065 (10Majavah) [13:20:37] 10SRE-tools, 10Infrastructure-Foundations, 10Recommendation-API, 10SRE, 10Znuny: Failover m2 master (db1107) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T287852 (10Marostegui) @MoritzMuehlenhoff @dpifke @Krinkle @bd808 @hnowlan @kostajh I am planning to failover this hos... [13:21:38] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Failover m2 master (db1107) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T287852 (10Marostegui) [13:25:39] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Failover m2 master (db1107) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T287852 (10MoritzMuehlenhoff) >>! In T287852#7251796, @Marostegui wrote: > @MoritzMuehlenhoff @dpifke @Krinkle @bd8... [13:29:52] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Failover m2 master (db1107) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T287852 (10Marostegui) [13:30:29] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Failover m2 master (db1107) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T287852 (10Marostegui) [13:31:00] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Failover m2 master (db1107) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T287852 (10Marostegui) [14:17:02] 10Puppet, 10Infrastructure-Foundations: sslcert::x509_to_pkcs12 fails to overwrite a valid output file when its contents should change - https://phabricator.wikimedia.org/T287869 (10BTullis) [14:34:15] 10Puppet, 10Infrastructure-Foundations, 10Patch-For-Review: sslcert::x509_to_pkcs12 fails to overwrite a valid output file when its contents should change - https://phabricator.wikimedia.org/T287869 (10BTullis) I have attempted a patch for this bug, based on using `openssl` commands to extract the private ke... [14:58:45] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Failover m2 master (db1107) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T287852 (10dpifke) No objection for xhgui. [15:13:41] 10SRE-tools, 10DBA, 10Infrastructure-Foundations, 10Recommendation-API, and 2 others: Failover m2 master (db1107) to a different host to upgrade its kernel - https://phabricator.wikimedia.org/T287852 (10bd808) iegreview and scholarships should handle the maintenance without major issue. [16:11:02] 10Mail, 10Infrastructure-Foundations, 10SRE: mx1001 alerting for 2043 mails in exim queue - https://phabricator.wikimedia.org/T287793 (10herron) 05Open→03Resolved a:03herron This alert has cleared and the queue is now ~50% below the icinga threshold. I did notice last week before this task was created...