[00:08:23] 10Fundraising-Backlog, 10fundraising-tech-ops: Fundraising access request for Jazmin Tanner - https://phabricator.wikimedia.org/T339383 (10Dwisehaupt) [01:12:01] (03CR) 10Ejegg: [C: 04-1] "That's a clever check, but I think the date math might not ever get a hit. Maybe slightly simpler would be enough?" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/987846 (https://phabricator.wikimedia.org/T354357) (owner: 10Damilare Adedoyin) [04:03:42] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: FR-ops - review google update - https://phabricator.wikimedia.org/T354584 (10Eileenmcnaughton) [04:05:10] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Tidy up our subscribe-links code on the civi side to make change easy - https://phabricator.wikimedia.org/T354585 (10Eileenmcnaughton) [04:09:16] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Determine if we need to have 1-click unsubscribes on our thank you etc emails - https://phabricator.wikimedia.org/T354586 (10Eileenmcnaughton) [04:14:51] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add/ fix page to support 1-click-ubsubscribe - https://phabricator.wikimedia.org/T354587 (10Eileenmcnaughton) [04:15:19] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: FR-ops - review google update - https://phabricator.wikimedia.org/T354584 (10Eileenmcnaughton) [04:40:15] (03PS1) 10Eileen: Add api to get unsubscribe links [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988749 (https://phabricator.wikimedia.org/T354585) [04:40:17] (03PS1) 10Eileen: Switch ThankYou workflow template to use the new unsubscribe api [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988750 (https://phabricator.wikimedia.org/T354585) [04:40:19] (03PS1) 10Eileen: Move unsubscribe link generation to a trait [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988751 (https://phabricator.wikimedia.org/T354585) [04:40:21] (03PS1) 10Eileen: Switch WMFTokens to use the api [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988752 (https://phabricator.wikimedia.org/T354585) [05:05:08] (03PS1) 10Eileen: Move the ThankYou::send functionality out of drupal modules [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988753 (https://phabricator.wikimedia.org/T354585) [05:21:24] (03CR) 10CI reject: [V: 04-1] Move the ThankYou::send functionality out of drupal modules [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988753 (https://phabricator.wikimedia.org/T354585) (owner: 10Eileen) [05:27:53] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Patch-For-Review: Tidy up our subscribe-links code on the civi side to make change easy - https://phabricator.wikimedia.org/T354585 (10Eileenmcnaughton) [05:33:17] (03PS2) 10Eileen: Move the ThankYou::send functionality out of drupal modules [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988753 (https://phabricator.wikimedia.org/T354585) [05:36:33] (03PS1) 10Eileen: Calculate unsubscribe in Send class, in just the one place [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988756 [05:36:35] (03PS1) 10Eileen: Do not calculate unsubscribe_link in RecurringQueueConsumer [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988757 (https://phabricator.wikimedia.org/T354585) [05:36:37] (03PS1) 10Eileen: Stop passing unsubscribe_link through from test form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988758 (https://phabricator.wikimedia.org/T354585) [05:36:39] (03PS1) 10Eileen: Remove last remnants of the old unsubscribe_link code [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988759 (https://phabricator.wikimedia.org/T354585) [05:52:23] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Determine if we need to have 1-click unsubscribes on our thank you etc emails - https://phabricator.wikimedia.org/T354586 (10Eileenmcnaughton) [05:54:20] (03CR) 10CI reject: [V: 04-1] Stop passing unsubscribe_link through from test form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988758 (https://phabricator.wikimedia.org/T354585) (owner: 10Eileen) [05:54:58] (03CR) 10CI reject: [V: 04-1] Do not calculate unsubscribe_link in RecurringQueueConsumer [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988757 (https://phabricator.wikimedia.org/T354585) (owner: 10Eileen) [05:57:21] (03PS2) 10Eileen: Do not calculate unsubscribe_link in RecurringQueueConsumer [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988757 (https://phabricator.wikimedia.org/T354585) [05:57:42] (03PS2) 10Eileen: Stop passing unsubscribe_link through from test form [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988758 (https://phabricator.wikimedia.org/T354585) [05:57:44] (03PS2) 10Eileen: Remove last remnants of the old unsubscribe_link code [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/988759 (https://phabricator.wikimedia.org/T354585) [06:48:21] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [06:53:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [06:58:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:03:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:08:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:13:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:18:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:23:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:28:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:33:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:38:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:43:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:48:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:53:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [07:58:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:03:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:07:43] 10Fundraising-Backlog: Change URL in WMF Recurring Failure template - https://phabricator.wikimedia.org/T354185 (10MSuijkerbuijk_WMF) @Eileenmcnaughton Thanks for this. I see the new URL in the template but when I test the email with my record (English US) I still get the Old URL. Do you know why this might be... [08:08:27] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:13:27] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:18:27] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:23:27] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:28:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:33:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:38:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:43:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:48:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:53:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [08:58:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:03:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:08:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:13:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:18:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:23:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:28:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:33:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:38:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:43:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:8) 8 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:48:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:53:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [09:58:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:03:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:08:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:13:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:18:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:23:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:28:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:33:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:38:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:43:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:48:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:53:13] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [10:58:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:03:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:08:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:13:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:15:15] hmm [11:15:24] well this one is noisy [11:17:37] fr-tech nothing scary in the amazon logs so I'm not sure why this job is upset [11:18:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:20:51] the only amazon endpoints I can see in our config across all apps is mws.amazonservices.com and https://static-na.payments-amazon.com/OffAmazonPayments/us/js/Widgets.js and they both seem to be up [11:21:38] I just tried to ack the alert but I'm getting frav1003 check_log_messages [11:21:40] Not Authorized [11:21:47] i guess we can ignore it for now [11:21:55] back later [11:23:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:8) 8 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:28:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:33:16] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:38:16] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:43:18] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:8) 8 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:48:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [11:53:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [12:18:16] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [12:23:20] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [12:28:16] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1], check_endpoints_warning (Paypal:1) 1 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [12:32:14] (03CR) 10Nikerabbit: "I find it unlikely that we are able to deploy both the Translate change and this change in the same train. It would be better for either p" [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/980983 (https://phabricator.wikimedia.org/T348496) (owner: 10Wangombe) [12:33:15] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [12:38:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [12:43:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [12:48:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [12:53:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [12:58:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:03:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:06:43] (03PS5) 10Damilare Adedoyin: Ensure no new rows are created for UPI transaction when a payment message is received after DR had cancelled the recurring. [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/987846 (https://phabricator.wikimedia.org/T354357) [13:08:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:13:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:18:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:23:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:8) 8 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:25:51] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add/ fix page to support 1-click-ubsubscribe - https://phabricator.wikimedia.org/T354587 (10jgleeson) a:03jgleeson [13:28:17] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:33:19] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:38:18] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:43:20] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:48:18] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:53:18] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [13:58:18] PROBLEM - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [14:03:22] ACKNOWLEDGEMENT - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] Jeff_Green known https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [14:03:22] ACKNOWLEDGEMENT - check_log_messages on frav1003 is CRITICAL: CRITICAL: check_endpoints_critical (Amazon:10) 10 [=1] Jeff_Green known https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1003&service=check_log_messages [14:07:46] (03PS7) 10Damilare Adedoyin: Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) [14:09:28] (03CR) 10CI reject: [V: 04-1] Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [14:11:06] (03PS8) 10Damilare Adedoyin: Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) [14:12:48] (03CR) 10CI reject: [V: 04-1] Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [14:14:26] (03PS9) 10Damilare Adedoyin: Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) [14:16:07] (03CR) 10CI reject: [V: 04-1] Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [14:33:00] (03PS10) 10Damilare Adedoyin: Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) [14:34:32] (03CR) 10CI reject: [V: 04-1] Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [14:37:27] (03PS11) 10Damilare Adedoyin: Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) [14:51:35] (03CR) 10Damilare Adedoyin: "Thanks jgleeson, I've made the proposed changes." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [14:51:44] (03PS8) 10Damilare Adedoyin: Add integration tests to cover the new IP Velocity behavior [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962594 (https://phabricator.wikimedia.org/T323544) [14:54:53] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add/ fix page to support 1-click-ubsubscribe - https://phabricator.wikimedia.org/T354587 (10jgleeson) I'm leaning towards putting this in the Email Preference Centre extension. It moves us closer to having one pla... [15:05:52] (03PS9) 10Damilare Adedoyin: Add integration tests to cover the new IP Velocity behavior [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962594 (https://phabricator.wikimedia.org/T323544) [15:07:44] (03CR) 10CI reject: [V: 04-1] Add integration tests to cover the new IP Velocity behavior [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962594 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [15:09:09] (03PS10) 10Damilare Adedoyin: Add integration tests to cover the new IP Velocity behavior [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962594 (https://phabricator.wikimedia.org/T323544) [15:23:44] (03PS11) 10Damilare Adedoyin: Add integration tests to cover the new IP Velocity behavior [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962594 (https://phabricator.wikimedia.org/T323544) [15:42:28] (03CR) 10Damilare Adedoyin: "Thanks jgleeson for the CR, made the recommended changes." [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962594 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [15:57:00] I'll check those out now damilare [15:57:10] thanks! [15:57:25] np [16:10:35] (03CR) 10Damilare Adedoyin: "Thanks ejegg for the CR, done!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/987846 (https://phabricator.wikimedia.org/T354357) (owner: 10Damilare Adedoyin) [16:29:23] (03CR) 10Jgleeson: [C: 03+2] "Tested with Adyen, Paypal & dLocal and everything looks good. Thanks all the work on this!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [16:31:34] (03Merged) 10jenkins-bot: Modify IP Velocity filter to increase count after first run. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962592 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [17:40:35] I forgot how good the Bat Out Of Hell album was [17:40:46] 1977 [17:44:34] Life is a lemon and want. my. money. BACK [17:45:21] I listened to that album (my dad's CD) on repeat while building our model airplane we never really flew [17:48:24] nice lol. that reminded me of when I was a kid and used to listen to my dads Thin Lizzy Live and Dangerous CD. I used to listen to the The Cowboy Song on repeat thinking Thin Lizzy were an American rock band and then later found out they were actually Irish [17:49:35] https://www.youtube.com/watch?v=Wil_kDsqeq8 [17:49:50] 10Fundraising-Backlog, 10fundraising-tech-ops, 10Wikipedia-iOS-App-Backlog: Strange API traffic pattern from WikipediaApp on payments.wikipedia.org - https://phabricator.wikimedia.org/T354575 (10Tsevener) @Jgreen Probably a bug. Is this for the payment methods [[ https://payments.wikimedia.org/api.php?action... [17:50:41] I think I was like 12 [17:50:43] wow [18:14:03] 10Fundraising-Backlog, 10fundraising-tech-ops, 10Wikipedia-iOS-App-Backlog: Strange API traffic pattern from WikipediaApp on payments.wikipedia.org - https://phabricator.wikimedia.org/T354575 (10Jgreen) >>! In T354575#9447346, @Tsevener wrote: > @Jgreen Probably a bug. Is this for the payment methods [[ http... [18:24:23] I've progressed from that to Pink Floyd - Wish You Were Here [18:25:49] what a time [18:26:08] yep [18:30:41] i used to go out to the desert hills in vegas in the car and put floyd on the stereo to just sit out at night and watch the lights. helps that it was still 85F+ until midnight. [18:31:14] very nice [18:37:38] (03CR) 10Jgleeson: [C: 03+2] "Thanks for these!!!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962594 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [18:38:33] damilare: I just moved https://phabricator.wikimedia.org/T323544 to pending deployment :) [18:39:14] :) ahh finally making it way out... [18:39:22] (03Merged) 10jenkins-bot: Add integration tests to cover the new IP Velocity behavior [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/962594 (https://phabricator.wikimedia.org/T323544) (owner: 10Damilare Adedoyin) [19:14:53] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog: India Recurring - Figure out when to actually cancel donations - https://phabricator.wikimedia.org/T339181 (10EMartin) Discussed at FRTech standup on 9 Jan and we determined that we will bill three consecutive WEEKS vs days or months. @RKumar_WMF... [19:17:19] 10Fundraising-Backlog, 10fundraising-tech-ops, 10Wikipedia-iOS-App-Backlog: Strange API traffic pattern from WikipediaApp on payments.wikipedia.org - https://phabricator.wikimedia.org/T354575 (10JTannerWMF) p:05Triage→03Low [20:07:49] (03PS1) 10Jgleeson: WIP: Add support for one-click-ubsubscribe [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/989243 (https://phabricator.wikimedia.org/T354587) [20:08:41] eileen: I've made a start on the one-click-unsubscribe landing page https://gerrit.wikimedia.org/r/c/mediawiki/extensions/DonationInterface/+/989243 [20:08:53] just trying to tidy up a test for it [20:09:03] jgleeson: yay! [20:09:45] (03CR) 10CI reject: [V: 04-1] WIP: Add support for one-click-ubsubscribe [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/989243 (https://phabricator.wikimedia.org/T354587) (owner: 10Jgleeson) [20:10:31] The tricky part is probably sentence two on this reply https://phabricator.wikimedia.org/T354587#9446137 [20:10:37] jgleeson: so what url would that sit on? [20:11:20] something like https://donorpreferences.wikimedia.org/index.php?title=Special:EmailPreferences/unsubscribe [20:12:15] ah cool - so trying to understand the bit you say is trickier [20:13:17] so the URL params including the checksum are generated in the code linked. To use that elsewhere, e.g. in email templates, we've need to extract it out and call it for multiple places [20:13:39] we'd need the URL in that magic email header [20:13:41] (03CR) 10Damilare Adedoyin: [C: 03+2] "Thanks for all the work on this wfan. LGTM!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/981431 (https://phabricator.wikimedia.org/T353032) (owner: 10Wfan) [20:13:42] so the side I worked on was having an api that does `WMFLine::getUnsubscribeURL()` - which returns an array of 3 urls - we would update the urls returned from there [20:14:01] (3 urls being to allow for one-click & post to be the same or different) [20:14:52] - not that in that pageRun context I don't think we would offer up the one-click url just cos it would be easy to accidentally unsubscribe people [20:16:16] (03Merged) 10jenkins-bot: Do not check submetod metadata for gpay applepay venmo paypal amazon [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/981431 (https://phabricator.wikimedia.org/T353032) (owner: 10Wfan) [20:17:44] https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/988749/1/drupal/sites/default/civicrm/extensions/wmf-thankyou/tests/phpunit/Civi/Api4/WMFLinkTest.php#25 [20:29:46] hmm eileen do you mean your helper method would build the URL or call it from somewhere else [20:29:58] it builds it [20:30:16] it replaces all the places we generate an unsubscribe acl [20:30:38] it might be worth putting something like that in smashpig if we need to call it across the stack [20:30:56] as long as he algorithm for the hash isn't tied civ [20:30:58] i [20:36:07] 10Fundraising-Backlog: Sprint X: Priorities - WIP - https://phabricator.wikimedia.org/T352901 (10AKanji-WMF) 05Open→03Resolved a:03AKanji-WMF [20:37:54] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog, 10FR-donorservices: Civi: Endowment ty email - include CNTCT - https://phabricator.wikimedia.org/T353842 (10AKanji-WMF) [20:38:00] 10Fundraising Sprint - Yesterday (UTC), 10Fundraising-Backlog: Investigation: Reduce number of clicks in donation flow through DonateWiki - https://phabricator.wikimedia.org/T351168 (10AKanji-WMF) [20:49:00] 10Fundraising Sprint 🐲 Phab the Magic Dragon, 10Fundraising-Backlog, 10FR-tech-data-integrity: Changing some of the imports on the back end - https://phabricator.wikimedia.org/T343758 (10AKanji-WMF) 05Open→03Declined HI @NNichols - can we please chat about this when we speak? We think this would be best... [20:53:14] 10Fundraising-Backlog: Empty table when looking at import results - https://phabricator.wikimedia.org/T354457 (10AKanji-WMF) @MDemosWMF Eileen will have a look though may be out of our control [20:56:39] 10Fundraising-Backlog: Civi Merges do not retain needed date fields - https://phabricator.wikimedia.org/T354379 (10AKanji-WMF) Hi @KHaggard let's connect after you speak with Danny to figure out next steps. [20:57:50] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-CiviCRM-Searchkit: Migrate extended report to search kit - https://phabricator.wikimedia.org/T354308 (10AKanji-WMF) Flagging for your interest @Cstone ! [21:02:42] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Docker: Docker wishlist - git config - https://phabricator.wikimedia.org/T354062 (10AKanji-WMF) [21:05:23] I forgot to say XenoRyet Anilk - I'm going to be away next week - I'll shuffle things around + work another day this week & do some work days next week but re meetings - I might be skipping some / all [21:07:42] Got it [21:08:08] 10Fundraising-Backlog: Civi Merges do not retain needed date fields - https://phabricator.wikimedia.org/T354379 (10KHaggard) Thanks @AKanji-WMF for your patience. Danny is back in office today and I spoke with him in a 1:1. He wants to chat with Brian about timeline if we approached this in the more streamlined... [21:22:22] So working on 'accept that which you cannot change' - I cannot change the fact that I will not be able to concentrate for the next 9 minutes until Jack leaves for work [21:27:36] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Docker: Docker updates - wishlist - https://phabricator.wikimedia.org/T354705 (10Eileenmcnaughton) [21:28:45] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising-tech-ops: Upgrade CiviCRM to 5.70-rc - https://phabricator.wikimedia.org/T354706 (10Eileenmcnaughton) [21:32:20] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising-tech-ops: Switch to Smarty3 - https://phabricator.wikimedia.org/T354707 (10Eileenmcnaughton) [21:40:10] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Disable/delete old contribution_tracking module - https://phabricator.wikimedia.org/T354708 (10Eileenmcnaughton) [21:40:24] lol [22:25:48] (03PS1) 10Eileen: Fix broken preview on recurring failed message [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/989254 [22:26:49] the can't change just got worse - Jack left for work & came back, saying he actually not working for another FOUR HOURS [22:33:56] lol [22:44:55] 10Fundraising-Backlog, 10fundraising-tech-ops: FR-Tech FY2324Q3 maintenance window - https://phabricator.wikimedia.org/T337581 (10Dwisehaupt) [22:52:47] 10Fundraising-Backlog: Empty table when looking at import results - https://phabricator.wikimedia.org/T354457 (10MDemosWMF) Thanks for the update! Please let me know what you find. [23:00:47] Nooooo :(