[04:43:19] I'm just glad I didn't break the windows with the cork, eileen. [12:40:44] (03Abandoned) 10Jforrester: build: Updating braces to 3.0.3 [extensions/DonationInterface] (REL1_40) - 10https://gerrit.wikimedia.org/r/1043454 (owner: 10Libraryupgrader) [15:08:38] 03Fundraising Sprint: LeeroyJenkinsssss(), 06Fundraising-Backlog, 10FR-donorservices, 10Recurring-Donations: Enable drop-down menu for DR to indicate recurring cancel reason - https://phabricator.wikimedia.org/T341247#9934812 (10AMJohnson) Thank you for building this for us! I've been using it this past we... [17:15:23] 06Fundraising-Backlog, 10fundraising-tech-ops: Fundraising access request for Yamini Lavappa - https://phabricator.wikimedia.org/T368579#9935411 (10Dwisehaupt) 05Open→03Resolved Worked with Yamini to get the certificate installed on their machine yesterday at the offsite. Verified that access to civi w... [17:28:27] PROBLEM - Host pay-lvs2002 is DOWN: PING CRITICAL - Packet loss = 100% [17:31:11] RECOVERY - Host pay-lvs2002 is UP: PING OK - Packet loss = 0%, RTA = 30.34 ms [18:13:05] 06Fundraising-Backlog, 07Mobile, 13Patch-For-Review, 07SEO: Google search results pointing to nonexistent https://donate.m.wikimedia.org/ - https://phabricator.wikimedia.org/T368645#9935511 (10BCornwall) p:05Triage→03High [18:29:09] 06Fundraising-Backlog, 07Mobile, 13Patch-For-Review, 07SEO: Google search results pointing to nonexistent https://donate.m.wikimedia.org/ - https://phabricator.wikimedia.org/T368645#9935586 (10Dzahn) [19:11:21] PROBLEM - check_puppetrun on frauth1002 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ssh] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frauth1002&service=check_puppetrun [19:12:13] PROBLEM - check_puppetrun on frpm2001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 5 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ssh] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frpm2001&service=check_puppetrun [19:12:15] PROBLEM - check_puppetrun on frbast1002 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 4 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ssh] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frbast1002&service=check_puppetrun [19:12:17] PROBLEM - check_puppetrun on frban2001 is CRITICAL: CRITICAL: Puppet has 1 failures. Last run 6 minutes ago with 1 failures. Failed resources (up to 3 shown): Service[ssh] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2001&service=check_puppetrun [19:27:11] RECOVERY - check_puppetrun on frpm2001 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frpm2001&service=check_puppetrun [19:27:11] RECOVERY - check_puppetrun on frbast1002 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frbast1002&service=check_puppetrun [19:32:17] RECOVERY - check_puppetrun on frban2001 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban2001&service=check_puppetrun [19:36:15] RECOVERY - check_puppetrun on frauth1002 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frauth1002&service=check_puppetrun [19:44:59] 06Fundraising-Backlog, 07Mobile, 07SEO: Google search results pointing to nonexistent https://donate.m.wikimedia.org/ - https://phabricator.wikimedia.org/T368645#9935901 (10ssingh) We decided to redirect all `donate.m` to `donate` in VCL since before adding the DNS change for `donate.m`, it wasn't really poi... [20:53:26] 10fundraising-tech-ops: Update all frack ssh keys to use ed25519 instead of rsa - https://phabricator.wikimedia.org/T368793 (10Dwisehaupt) 03NEW [21:24:30] 10fundraising-tech-ops: Fundraising access request for icano - https://phabricator.wikimedia.org/T368473#9936244 (10Dwisehaupt) 05Open→03Declined a:03Dwisehaupt Per conversations at the offsite. icano will not currently need ssh and db access. This task can be reopened in the future if that changes. [21:28:28] 10fundraising-tech-ops: Deactivate fundraising accounts for lhowland - https://phabricator.wikimedia.org/T368797 (10Dwisehaupt) 03NEW [21:28:37] 10fundraising-tech-ops: Deactivate fundraising accounts for jroberson - https://phabricator.wikimedia.org/T368798 (10Dwisehaupt) 03NEW [21:28:48] 10fundraising-tech-ops: Deactivate fundraising accounts for gkashtock - https://phabricator.wikimedia.org/T368799 (10Dwisehaupt) 03NEW [21:46:13] 10fundraising-tech-ops: Deactivate fundraising accounts for gkashtock - https://phabricator.wikimedia.org/T368799#9936314 (10Dwisehaupt) [21:46:15] 10fundraising-tech-ops: Deactivate fundraising accounts for jroberson - https://phabricator.wikimedia.org/T368798#9936315 (10Dwisehaupt) [21:46:18] 10fundraising-tech-ops: Deactivate fundraising accounts for lhowland - https://phabricator.wikimedia.org/T368797#9936316 (10Dwisehaupt) [21:46:52] 10fundraising-tech-ops: Deactivate fundraising accounts for lhowland - https://phabricator.wikimedia.org/T368797#9936318 (10Dwisehaupt) 05Open→03Resolved a:03Dwisehaupt [21:47:05] 10fundraising-tech-ops: Deactivate fundraising accounts for jroberson - https://phabricator.wikimedia.org/T368798#9936323 (10Dwisehaupt) 05Open→03Resolved a:03Dwisehaupt [21:47:19] 10fundraising-tech-ops: Deactivate fundraising accounts for gkashtock - https://phabricator.wikimedia.org/T368799#9936326 (10Dwisehaupt) 05Open→03Resolved a:03Dwisehaupt [21:58:27] 10fundraising-tech-ops, 10DNS, 06SRE, 06Traffic, 13Patch-For-Review: Cleanup unused DNS subdomains - https://phabricator.wikimedia.org/T367012#9936334 (10Dwisehaupt) Adding @AKanji-WMF on this to coordinate with Major Gifts for the benefactors site. Anil: The previous tasks associated with this are: T10... [22:09:03] 10fundraising-tech-ops: Migrate frack setup to use new anycast ntp servers - https://phabricator.wikimedia.org/T368110#9936344 (10Dwisehaupt) 05Open→03Resolved Old servers removed in following commit: ` [frack::puppet] 5b22b90dd Remove ntp servers that are going to be deprecated (Dallas Wisehaupt:Dallas... [23:42:34] 10fundraising-tech-ops: Fundraising access request for ccogdill - https://phabricator.wikimedia.org/T368474#9936492 (10Dwisehaupt) [23:43:04] 10fundraising-tech-ops: Fundraising access request for ccogdill - https://phabricator.wikimedia.org/T368474#9936493 (10Dwisehaupt) a:03Dwisehaupt