[00:00:25] 10fundraising-tech-ops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install frdb200[45] - https://phabricator.wikimedia.org/T369920#10065688 (10Dwisehaupt) frdb2004 OS install complete. Will clone the DB across tomorrow. [00:01:26] (03PS1) 10Eileen: Upgrade references to 'special' org_contact_name to the actual apiv4 field [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062770 (https://phabricator.wikimedia.org/T370469) [01:03:35] (03PS2) 10Eileen: PHP 8.x test fix [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062766 [01:03:39] (03CR) 10Ejegg: [C:03+2] PHP 8.x test fix [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062766 (owner: 10Eileen) [01:23:17] (03Merged) 10jenkins-bot: PHP 8.x test fix [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062766 (owner: 10Eileen) [03:24:24] 10fundraising-tech-ops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install frdb200[45] - https://phabricator.wikimedia.org/T369920#10065781 (10Papaul) @Dwisehaupt you had the DNS information under Description and not under DNS Name see below ` IP Address Family IPv4 VRF Global Tenant Fundraising Tech S... [04:03:59] (03PS1) 10Eileen: Fix custom field to be wrangled consistently on message class [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062777 (https://phabricator.wikimedia.org/T370469) [04:16:58] (03PS2) 10Eileen: Upgrade references to 'special' org_contact_name to the actual apiv4 field [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062770 (https://phabricator.wikimedia.org/T370469) [04:16:58] (03PS2) 10Eileen: Fix custom field to be wrangled consistently on message class [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062777 (https://phabricator.wikimedia.org/T370469) [04:16:58] (03PS1) 10Eileen: Move a couple of tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062778 [04:16:58] (03PS1) 10Eileen: Fix WMFSave to use apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062779 (https://phabricator.wikimedia.org/T370469) [04:26:42] (03PS2) 10Eileen: Move a couple of tests [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062778 [04:26:42] (03PS3) 10Eileen: Upgrade references to 'special' org_contact_name to the actual apiv4 field [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062770 (https://phabricator.wikimedia.org/T370469) [04:26:42] (03PS3) 10Eileen: Fix custom field to be wrangled consistently on message class [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062777 (https://phabricator.wikimedia.org/T370469) [04:26:42] (03PS2) 10Eileen: Fix WMFSave to use apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062779 (https://phabricator.wikimedia.org/T370469) [04:48:33] (03CR) 10CI reject: [V:04-1] Fix WMFSave to use apiv4 [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062779 (https://phabricator.wikimedia.org/T370469) (owner: 10Eileen) [12:51:43] howdy jgleeson, please can you help reset my gravy sandbox login [12:51:45] thank [12:51:49] thanks* [12:52:03] sure thing will do it now [12:52:48] thank you [12:55:23] 03Fundraising Sprint: powerfulFunctionPleaseOnlyCallIfAbsolutelyNecessary(), 06Fundraising-Backlog, 07payments-orchestration: Gravy ACH (Trustly) - https://phabricator.wikimedia.org/T371810#10066744 (10Damilare) a:03Damilare [13:01:41] 06Fundraising-Backlog, 07Epic, 07payments-orchestration: Gravy Integration - https://phabricator.wikimedia.org/T364501#10066760 (10Damilare) [13:02:02] 06Fundraising-Backlog, 07payments-orchestration: Ensure Gravy recurring card payments can be charged via Civi SmashPig recurring charge job - https://phabricator.wikimedia.org/T372559#10066761 (10Damilare) [15:00:02] 10fundraising-tech-ops, 06DC-Ops, 10ops-codfw, 06SRE: Q1:rack/setup/install frdb200[45] - https://phabricator.wikimedia.org/T369920#10067165 (10Dwisehaupt) @Papaul Oh, thanks for finding that. I didn't spot the wrong field when updating the typo. DNS looks good now. Thanks! [15:28:28] (03PS1) 10Damilare Adedoyin: Add 1 second delay to allow time for Gravy session update [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1063013 [15:28:53] @_@ [15:29:10] damilare: are we sleep()ing? [15:29:44] oh it's in JS [15:29:47] (03PS2) 10Damilare Adedoyin: Add 1 second delay to allow time for Gravy session update [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1063013 [15:29:53] JS sleeping [15:30:25] yepp jgleeson https://wikimedia.slack.com/archives/C070F1DVBRN/p1723733153670809?thread_ts=1723721565.306409&cid=C070F1DVBRN [15:30:37] we need to snooze for a bit [15:31:02] they said we might be moving too fast [15:31:52] (03CR) 10CI reject: [V:04-1] Add 1 second delay to allow time for Gravy session update [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1063013 (owner: 10Damilare Adedoyin) [15:34:38] (03PS3) 10Damilare Adedoyin: Add 1 second delay to allow time for Gravy session update [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1063013 [15:38:45] 06Fundraising-Backlog: Uptick in Dutch donors experiencing issues donating - https://phabricator.wikimedia.org/T372571 (10krobinson) 03NEW [15:55:38] (03CR) 10Wfan: "LGTM, hope 1 sec is good enough~" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1063013 (owner: 10Damilare Adedoyin) [15:56:42] thanks wfan, looks like you missed the +2 button :) [15:56:59] lol [15:57:07] (03CR) 10Wfan: [C:03+2] Add 1 second delay to allow time for Gravy session update [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1063013 (owner: 10Damilare Adedoyin) [15:59:08] (03Merged) 10jenkins-bot: Add 1 second delay to allow time for Gravy session update [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1063013 (owner: 10Damilare Adedoyin) [16:05:40] (03PS1) 10Damilare Adedoyin: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1063019 [16:12:48] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Uptick in Dutch donors experiencing issues donating - https://phabricator.wikimedia.org/T372571#10067336 (10jgleeson) [16:15:21] (03CR) 10Damilare Adedoyin: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1063019 (owner: 10Damilare Adedoyin) [16:16:56] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1063019 (owner: 10Damilare Adedoyin) [16:17:08] PROBLEM - check_mysql on frdb2001 is CRITICAL: Cant connect to local MySQL server through socket /var/run/mysqld/mysqld.sock (2) https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2001&service=check_mysql [16:18:14] ^^^ that was me. put the downtime on the wrong host somehow. [16:20:04] (03PS2) 10Eileen: Update Geocoder for php8.x test passes [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062768 [16:20:08] (03CR) 10Ejegg: [C:03+2] Update Geocoder for php8.x test passes [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062768 (owner: 10Eileen) [16:20:10] XenoRyet: Hi Dylan, could we move our meeting to 1:00pm PST, since Alyssa has a doctor appointment around that time, thanks :) [16:37:30] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1063024 [16:44:33] (03Merged) 10jenkins-bot: Update Geocoder for php8.x test passes [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1062768 (owner: 10Eileen) [16:50:14] 03Fundraising Sprint: powerfulFunctionPleaseOnlyCallIfAbsolutelyNecessary(), 06Fundraising-Backlog, 10fundraising-tech-ops: FR-Tech FY2425Q1 maintenance window - https://phabricator.wikimedia.org/T337582#10067460 (10Ejegg) I'll try to get a patch ready to add more fields to contribution_extra (see {T372468}) [16:51:33] 06Fundraising-Backlog, 07payments-orchestration: Gravy Audit/Settlement Processing (Adyen) - https://phabricator.wikimedia.org/T371813#10067462 (10XenoRyet) 05Open→03Declined [17:10:45] 06Fundraising-Backlog: Citibank international import mapping - issue with default fields + contribution source currency/amount - https://phabricator.wikimedia.org/T370483#10067505 (10AKanji-WMF) @Eileenmcnaughton this is an import that is currently blocking Melanie - viz our convo about an imports focused sprint... [17:13:51] 03Fundraising Sprint: powerfulFunctionPleaseOnlyCallIfAbsolutelyNecessary(), 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Import migration - add support for currency conversion - https://phabricator.wikimedia.org/T368998#10067509 (10AKanji-WMF) lifting this one up too @Eileenmcnaughton based on Me... [17:26:29] 03Fundraising Sprint: powerfulFunctionPleaseOnlyCallIfAbsolutelyNecessary(), 06Fundraising-Backlog, 10fundraising-tech-ops: FR-Tech FY2425Q1 maintenance window - https://phabricator.wikimedia.org/T337582#10067521 (10Dwisehaupt) [19:08:24] 06Fundraising-Backlog, 07payments-orchestration: Add new 'backend_processor' field to CiviCRM - https://phabricator.wikimedia.org/T372589 (10jgleeson) 03NEW [19:12:53] 06Fundraising-Backlog, 07payments-orchestration: Add new 'backend_processor' field to CiviCRM - https://phabricator.wikimedia.org/T372589#10067762 (10jgleeson) [19:37:53] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: CentralNotice selenium tests failing - https://phabricator.wikimedia.org/T360899#10067816 (10XenoRyet) p:05High→03Medium [19:54:17] (03Abandoned) 10Umherirrender: build: Updating dependencies [extensions/FundraisingTranslateWorkflow] - 10https://gerrit.wikimedia.org/r/1024918 (owner: 10Libraryupgrader) [19:57:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Uptick in Dutch donors experiencing issues donating - https://phabricator.wikimedia.org/T372571#10067863 (10Cstone) There was also a slack thread on this on August 1 what was happening then: - test donations were going through but the redirect to the ban... [20:22:18] cstone: I'm also looking into it now [20:22:31] I just messaged amber to get some cids [20:23:06] she's gonna add a new colum to the doc with civicrm contact ids for the affected donors [20:23:14] that should make our lives easier [20:25:23] also fr-tech, I noticed today that we don't log any of the API requests in the gravy happy path scenario [20:25:31] I only see juicy data when it fails [20:26:02] so I think we should add some request dumps regardless just to make the early days easier [20:26:23] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Uptick in Dutch donors experiencing issues donating - https://phabricator.wikimedia.org/T372571#10067973 (10AMJohnson) Just flagging that I've added 23 more of these today so far to [[ https://docs.google.com/spreadsheets/d/1h3lchQMRAVmZL8pnTaSXipS7kdN6po... [20:31:02] gotta give amber props, she just said "the iDeal situation is not ideal" [20:32:15] haha [20:32:22] yeah, confusing name~ [20:33:45] I just realised there is a "chuck norris" slackmoji [20:35:30] +1 to more data [20:35:56] also jgleeson for that filter you had on have you ever seen supertroopers... [20:36:54] no but I see it now LOL [20:46:38] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1063024 (owner: 10Ejegg) [20:47:28] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1063024 (owner: 10Ejegg) [20:47:30] (03PS1) 10Ejegg: Add field for backend_processor [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1063058 (https://phabricator.wikimedia.org/T372589) [20:52:08] RECOVERY - check_mysql on frdb2001 is OK: Uptime: 256 Threads: 3 Questions: 353161 Slow queries: 0 Opens: 949 Open tables: 942 Queries per second avg: 1379.535 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb2001&service=check_mysql [20:52:41] (03CR) 10Wfan: "recheck" [extensions/FundraisingTranslateWorkflow] - 10https://gerrit.wikimedia.org/r/1024918 (owner: 10Libraryupgrader) [20:54:11] !log fundraising civicrm upgraded from eecbba5d to 56521963 [20:54:13] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [20:56:46] (03CR) 10Jgleeson: [C:03+2] "LGTM!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1063058 (https://phabricator.wikimedia.org/T372589) (owner: 10Ejegg) [20:56:57] Sorry ejegg I didn't realise it was that simple [20:57:14] I just tested it with ./scripts/civicrm-drush.sh @wmff cvapi WMFConfig.syncCustomFields version=4 [20:57:32] that's awesome [20:57:43] :) no, it's great to have the paper trail :) [20:57:46] thank you [20:58:22] nora will be happy! [20:59:22] :) [21:00:02] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-donorservices, and 2 others: Job that sets PayPal recurs as cancelled after 90 days w/no donation should also cancel at PayPal - https://phabricator.wikimedia.org/T341346#10068083 (10Ejegg) This is deployed - now... [21:00:34] hmm, should I do a SmashPig version bump just for the Adyen code 703 mapping? [21:01:12] nah, I think that can wait for something more substantial [21:12:44] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-Translate, 10ci-test-error (WMF-deployed Build Failure): phpunit test failure for extension FundraisingTranslateWorkflow - https://phabricator.wikimedia.org/T357804#10068126 (10AnnWF) just recheck a [[ https://gerrit.wikimedia.o... [21:19:16] (03Merged) 10jenkins-bot: Add field for backend_processor [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1063058 (https://phabricator.wikimedia.org/T372589) (owner: 10Ejegg) [21:58:17] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Uptick in Dutch donors experiencing issues donating - https://phabricator.wikimedia.org/T372571#10068210 (10EMartin) I have raised this with Adyen as well to look into things on their end. {F57275832} [22:36:06] (03PS1) 10Ejegg: Add backend_processor to allowed message fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1063079 (https://phabricator.wikimedia.org/T372589) [22:39:46] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Uptick in Dutch donors experiencing issues donating - https://phabricator.wikimedia.org/T372571#10068262 (10EMartin) Adyen had this to say re the declines of. "Transaction FAilure" seen in this screenshot which seem to be the reason code I'm seeing in the... [22:52:43] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Uptick in Dutch donors experiencing issues donating - https://phabricator.wikimedia.org/T372571#10068283 (10Cstone) @EMartin did Adyen say anything about the redirect being slow? A lot of these donors aren't even getting to the point where it would show u... [23:12:20] (03PS2) 10Ejegg: Handle annual donations in PayPal audit [wikimedia/fundraising/tools] - 10https://gerrit.wikimedia.org/r/1028875 (https://phabricator.wikimedia.org/T358914)