[01:40:40] (03PS1) 10Ejegg: Never map Gravy recon ID as backend ID [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1344121 (https://phabricator.wikimedia.org/T436050) [01:41:13] eileen: that one should stop us getting the recon ID in the backend processor ID field ^^^ [01:41:37] oh lemme fix a typo in a comment [01:41:48] (03PS2) 10Ejegg: Never map Gravy recon ID as backend ID [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1344121 (https://phabricator.wikimedia.org/T436050) [01:46:20] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-WMF-Audit, 13Patch-For-Review: Trustly not clearing because backend_processor_trxn_id has gravy ID in it not trustly... - https://phabricator.wikimedia.org/T436050#12353201 (10Ejegg) Well, if we need the capture ID in the backend processor ID we... [01:55:50] ok, looks like most of them do get the right ID from the initial response [01:59:19] ah, those would be the recurring installments [01:59:34] so the first-time ones are mostly all broken [01:59:42] Well, better blank than wrong [02:02:08] (03PS1) 10Eileen: Add code comment on transaction_id/original_transaction_id [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1344122 [02:02:41] (03PS2) 10Eileen: Add code comment on transaction_id/original_transaction_id [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1344122 [02:02:43] (03CR) 10Ejegg: [C:03+2] Add code comment on transaction_id/original_transaction_id [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1344122 (owner: 10Eileen) [02:03:19] (03Merged) 10jenkins-bot: Add code comment on transaction_id/original_transaction_id [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1344122 (owner: 10Eileen) [02:10:26] so i want to multiplex another type of message via the donations queue, i guess [02:33:46] (03PS1) 10Ejegg: WIP Another type of DonationModifyMessage [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344125 [02:34:14] eileen: ^^^ is my first stab at being able to send additional IDs to the donations queue from the capture IPN [02:34:52] as before, it feels ugly to handle wildly different message types in the same queue but there are timing problems if they go to a different one [02:34:57] gotta head out for now [02:36:09] (03PS3) 10Eileen: Add gateway account to stock entry, icons [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344088 (https://phabricator.wikimedia.org/T434041) [02:52:06] (03CR) 10CI reject: [V:04-1] WIP Another type of DonationModifyMessage [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344125 (owner: 10Ejegg) [03:07:40] (03CR) 10Cstone: [C:03+2] Add gateway account to stock entry, icons [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344088 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [03:27:14] (03Merged) 10jenkins-bot: Add gateway account to stock entry, icons [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344088 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [03:27:47] (03PS1) 10Eileen: Make batch entity importable - add importable fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344126 [03:33:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-WMF-Audit, 13Patch-For-Review: Trustly not clearing because backend_processor_trxn_id has gravy ID in it not trustly... - https://phabricator.wikimedia.org/T436050#12353307 (10Eileenmcnaughton) @Ejegg we can maybe populate auth_id when that comes... [03:39:37] (03CR) 10Eileen: WIP Another type of DonationModifyMessage (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344125 (owner: 10Ejegg) [04:00:15] 06Fundraising-Backlog, 07fr-combowiki: Combowiki: Better error handling UI - https://phabricator.wikimedia.org/T438927 (10Cstone) 03NEW [04:14:49] (03PS1) 10Eileen: Add Manual Batches search screen with Confirm task [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344128 (https://phabricator.wikimedia.org/T434041) [04:17:17] (03CR) 10Cstone: "should we do any of this in the listener itself? With the moto style payments we are doing some more things in there now" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344125 (owner: 10Ejegg) [04:18:03] (03CR) 10Cstone: [C:03+2] Add Manual Batches search screen with Confirm task [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344128 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [04:18:18] (03CR) 10Cstone: [C:03+2] Make batch entity importable - add importable fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344126 (owner: 10Eileen) [04:30:54] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-WMF-Audit, 13Patch-For-Review: Trustly not clearing because backend_processor_trxn_id has gravy ID in it not trustly... - https://phabricator.wikimedia.org/T436050#12353334 (10Eileenmcnaughton) Note I fixed up the 4 we had causing problems so the... [04:39:40] (03Merged) 10jenkins-bot: Add Manual Batches search screen with Confirm task [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344128 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [04:39:42] (03Merged) 10jenkins-bot: Make batch entity importable - add importable fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344126 (owner: 10Eileen) [04:41:27] (03Abandoned) 10Eileen: Add Manual Batches search screen with Confirm task [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1343926 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [04:41:42] (03Abandoned) 10Eileen: Add Manual Batches search screen with Confirm task and net-amount validation [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1343859 (https://phabricator.wikimedia.org/T434041) (owner: 10Eileen) [04:57:29] 06Fundraising-Analysis, 06Fundraising-Backlog, 10WMDE Requirements on WMF needing prioritization, 06WMDE-FUN-Team, 10WMDE-Fundraising-Tech: Prevent gaps when providing banner impression data of WMDE fundraising banners - https://phabricator.wikimedia.org/T298777#12353345 (10AbbanWMDE) 05Open→03Inv... [05:01:59] (03CR) 10Eileen: [C:03+2] Extend pre hook getters to post / postCommit hooks [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1343341 (https://phabricator.wikimedia.org/T434201) (owner: 10Lars SG) [05:06:58] (03CR) 10Eileen: [C:03+2] Reset permissions class after every test in relevant test classes to prevent leakage [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1343125 (https://phabricator.wikimedia.org/T437759) (owner: 10Lars SG) [05:08:01] (03CR) 10Eileen: [C:03+2] Add standalone logout event [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1341395 (https://phabricator.wikimedia.org/T433866) (owner: 10Lars SG) [05:20:32] (03CR) 10Eileen: [C:03+2] Add more defined fields Also add logging for ones that aren't defined [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1307275 (owner: 10Cstone) [05:21:40] (03CR) 10Eileen: Do not let case mismatches block NamePair resolution (035 comments) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1334162 (https://phabricator.wikimedia.org/T436878) (owner: 10Eileen) [05:21:46] (03PS5) 10Eileen: Do not let case mismatches block NamePair resolution [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1334162 (https://phabricator.wikimedia.org/T436878) [05:23:01] (03PS2) 10Eileen: Isolate row and file processing errors instead of aborting the run [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1342543 [05:30:35] 06Fundraising-Backlog, 07fr-combowiki: Combowiki: Pre payment monthly convert doesn't redirect when you select No Thanks - https://phabricator.wikimedia.org/T438929 (10Cstone) 03NEW [05:31:34] 06Fundraising-Backlog, 07fr-combowiki: Combowiki: Pre payment monthly convert doesn't redirect when you select No Thanks - https://phabricator.wikimedia.org/T438929#12353414 (10Cstone) p:05Triage→03High [05:32:38] 06Fundraising-Backlog, 07fr-combowiki: Standardize how we send ComboWiki Client debug logs to the server - https://phabricator.wikimedia.org/T438241#12353441 (10Cstone) p:05Triage→03Medium [05:39:03] 06Fundraising-Backlog, 06Sprint R, 07fr-combowiki: Combowiki: Pre payment monthly convert doesn't redirect when you select No Thanks - https://phabricator.wikimedia.org/T438929#12353461 (10Cstone) [05:45:03] (03PS1) 10Eileen: Add batch_data fields for reference, adjustment, and to-main journals [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344132 [05:46:16] FIRING: ContextSwitchingSpike: Host context switching high (instance frdb1007.frack.eqiad.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DContextSwitchingSpike [05:48:20] (03Merged) 10jenkins-bot: Add more defined fields Also add logging for ones that aren't defined [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1307275 (owner: 10Cstone) [05:51:16] RESOLVED: ContextSwitchingSpike: Host context switching high (instance frdb1007.frack.eqiad.wmnet:9100) - https://alerts.wikimedia.org/?q=alertname%3DContextSwitchingSpike [06:34:16] 06Fundraising-Backlog, 10FR-WMF-Audit: Deprecation of PTP and Upgrade to SDP - Adyen - https://phabricator.wikimedia.org/T435114#12353540 (10RKumar_WMF) The roll of this has been postponed to Oct. Basically there would be more types of JEs once the feature is rolled out. Please let me know what clarity is need... [07:15:32] (03CR) 10Laurabarluzzi: [C:04-1] "The test data is incorrect. By updating the RECONCILIATION_ID the tests will pass." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1329407 (owner: 10Eileen) [07:30:37] (03CR) 10Eileen: "I took a first pass - pondering ...." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1339216 (https://phabricator.wikimedia.org/T386031) (owner: 10Lars SG) [07:32:18] (03CR) 10Laurabarluzzi: [C:03+2] Delete old getScoreUtm* fraud filters [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1343613 (https://phabricator.wikimedia.org/T318618) (owner: 10Ejegg) [07:34:33] (03Merged) 10jenkins-bot: Delete old getScoreUtm* fraud filters [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1343613 (https://phabricator.wikimedia.org/T318618) (owner: 10Ejegg) [07:57:11] (03CR) 10Laurabarluzzi: Add count badge for ZD tickets tab in Civi (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1343652 (https://phabricator.wikimedia.org/T438742) (owner: 10Lars SG) [10:48:20] 03Fundraising Sprint: R, 06Fundraising-Backlog: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12354190 (10jgleeson) a:03jgleeson [12:14:59] 03Fundraising Sprint: R, 06Fundraising-Backlog: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12354695 (10jgleeson) I looked into this using last night's run as a sample batch, and it looks like we processed 1,420 annual recurring charges last night, but 338 fai... [12:16:59] 03Fundraising Sprint: R, 06Fundraising-Backlog: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12354700 (10jgleeson) I'm gonna dig into some of the contact records and charges related to the 224 invalid_payment_method failures [12:43:11] 03Fundraising Sprint: R, 06Fundraising-Backlog: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12354767 (10Laurabarluzzi) @jgleeson The title seems somewhat related to a phab in the chaos board; we had a recurring error from failmail that turned out being an "exp... [13:05:39] (03PS1) 10Laurabarluzzi: Restyle the footer in EmailPreference as it appears in other successful email confirmation pages [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344270 (https://phabricator.wikimedia.org/T435963) [13:07:31] 03Fundraising Sprint: R, 06Fundraising-Backlog: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12354886 (10jgleeson) Thanks @Laurabarluzzi. I read over the ticket, and I can see you drilled into one of the affected transactions from an earlier batch. My understa... [13:07:50] (03CR) 10CI reject: [V:04-1] Restyle the footer in EmailPreference as it appears in other successful email confirmation pages [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344270 (https://phabricator.wikimedia.org/T435963) (owner: 10Laurabarluzzi) [13:21:22] 03Fundraising Sprint: R, 06Fundraising-Backlog: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12354918 (10jgleeson) Also, we had 338 recurring failures last night alone, 228 of them `invalid_payment_method` responses. If we tried to quiet these with the recurrin... [13:32:08] (03PS1) 10Ejegg: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1344275 [13:32:12] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1344275 (owner: 10Ejegg) [13:32:48] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1344277 [13:32:52] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1344277 (owner: 10Ejegg) [13:33:14] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1344275 (owner: 10Ejegg) [13:33:59] (03CR) 10Jgleeson: "One issue with a single recurring_threshold is that the buckets are per error code (generateRedisErrorKey), but every recurring bucket wou" [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1343989 (owner: 10Ejegg) [13:34:14] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1344277 (owner: 10Ejegg) [13:58:43] 06Fundraising-Backlog, 10FR-WMF-Audit: Deprecation of PTP and Upgrade to SDP - Adyen - https://phabricator.wikimedia.org/T435114#12355140 (10SBurnett-WMF) @RKumar_WMF- thank you for the additional information. We will review this again. [14:23:16] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Remove old audience framework segment & status - https://phabricator.wikimedia.org/T432597#12355222 (10NNgu-WMF) @Lars that doesn't fully work, if we want to target people based on how long they have lapsed. Also, before removing the old framework, coul... [14:25:55] 06Fundraising-Backlog, 06Sprint Random Posture Generators: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12355232 (10Ejegg) Do those failures all happen within a half hour window? Maybe the per-time-window threshold would be lower than 200. Or we could just supp... [15:02:59] 06Fundraising-Backlog, 06Sprint Random Posture Generators: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12355440 (10Ejegg) I'm leaning more toward fully suppressing these email for recurring charges. A dedicated job checking overall rates would also be able to... [15:04:12] (03PS2) 10Laurabarluzzi: Restyle the footer in EmailPreference as it appears in other successful email confirmation pages [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344270 (https://phabricator.wikimedia.org/T435963) [15:06:47] (03CR) 10CI reject: [V:04-1] Restyle the footer in EmailPreference as it appears in other successful email confirmation pages [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344270 (https://phabricator.wikimedia.org/T435963) (owner: 10Laurabarluzzi) [15:08:57] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-Banners, 10MediaWiki-extensions-CentralNotice, 13Patch-For-Review: Did TK / banner suppression code worsen our 'banner bump'? - https://phabricator.wikimedia.org/T438401#12355515 (10SBurnett-WMF) p:05Triage→03Medium [15:14:14] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-WMF-Audit, 13Patch-For-Review: Trustly not clearing because backend_processor_trxn_id has gravy ID in it not trustly... - https://phabricator.wikimedia.org/T436050#12355523 (10Ejegg) a:03Ejegg [15:19:00] !log fundraising civicrm upgraded from d575ad3e to 4fc5d217 [15:19:02] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [15:21:54] !log payments-wiki upgraded from 48ac74d9 to 375adf37 [15:21:55] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL [15:23:29] ooh, lots of new logging for 'unsupported field xxx' [15:24:39] (03PS3) 10Laurabarluzzi: Restyle the footer in EmailPreference as it appears in other successful email confirmation pages [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344270 (https://phabricator.wikimedia.org/T435963) [15:26:58] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Remove old audience framework segment & status - https://phabricator.wikimedia.org/T432597#12355628 (10Lars) @NNgu I would use donor_status_recur_overall plus AF_recurring_latest_donation_date (or the equivalent month and year fields), then you can dial i... [15:30:15] (03PS1) 10Damilare Adedoyin: Create API for submit ApplePay and GooglePay on through the Gravy adapter [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344317 (https://phabricator.wikimedia.org/T438879) [15:31:58] (03CR) 10CI reject: [V:04-1] Create API for submit ApplePay and GooglePay on through the Gravy adapter [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344317 (https://phabricator.wikimedia.org/T438879) (owner: 10Damilare Adedoyin) [15:32:30] (03PS5) 10Damilare Adedoyin: WIP: Add Gravy get payment methods API to enable Apple and Google pay app payments through Gravy [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1342794 (https://phabricator.wikimedia.org/T438879) [15:33:43] (03PS12) 10Damilare Adedoyin: Remove duplicated lines between adapters Apple pay api classes [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1337640 [15:33:54] (03PS6) 10Damilare Adedoyin: WIP: Add Gravy get payment methods API to enable Apple and Google pay app payments through Gravy [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1342794 (https://phabricator.wikimedia.org/T438879) [15:33:55] (03PS2) 10Damilare Adedoyin: Create API for submit ApplePay and GooglePay on through the Gravy adapter [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344317 (https://phabricator.wikimedia.org/T438879) [15:34:01] (03CR) 10CI reject: [V:04-1] WIP: Add Gravy get payment methods API to enable Apple and Google pay app payments through Gravy [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1342794 (https://phabricator.wikimedia.org/T438879) (owner: 10Damilare Adedoyin) [15:34:41] (03PS4) 10Laurabarluzzi: Restyle the footer in EmailPreference as it appears in other successful email confirmation pages [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344270 (https://phabricator.wikimedia.org/T435963) [15:35:39] (03CR) 10CI reject: [V:04-1] WIP: Add Gravy get payment methods API to enable Apple and Google pay app payments through Gravy [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1342794 (https://phabricator.wikimedia.org/T438879) (owner: 10Damilare Adedoyin) [15:35:56] (03CR) 10CI reject: [V:04-1] Create API for submit ApplePay and GooglePay on through the Gravy adapter [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344317 (https://phabricator.wikimedia.org/T438879) (owner: 10Damilare Adedoyin) [15:36:20] (03PS5) 10Laurabarluzzi: Restyle the footer in EmailPreference as it appears in other successful email confirmation pages [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344270 (https://phabricator.wikimedia.org/T435963) [15:38:03] (03PS4) 10Lars SG: Add count badge for ZD tickets tab in Civi [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1343652 (https://phabricator.wikimedia.org/T438742) [15:38:34] (03CR) 10Lars SG: "Thanks Laura" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1343652 (https://phabricator.wikimedia.org/T438742) (owner: 10Lars SG) [15:40:45] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review, 06Sprint Random Posture Generators: Make double opt in success page a little nicer - https://phabricator.wikimedia.org/T435963#12355741 (10Laurabarluzzi) @Lars I pushed a patch only for updating the footer component and I'm working... [15:46:17] (03CR) 10Laurabarluzzi: [C:03+2] "LGTM" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1343652 (https://phabricator.wikimedia.org/T438742) (owner: 10Lars SG) [15:48:07] 03Fundraising Sprint: Quiz Show Podium, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-WMF-Audit: OfflineGifts - overflow - https://phabricator.wikimedia.org/T436895#12355822 (10MDemosWMF) @Eileenmcnaughton Contribution moved to 'paid out' in Overflow but I'm not seeing it on CID 6061257. [15:52:48] (03CR) 10Damilare Adedoyin: "Thanks @lbarluzzi@wikimedia.org, lgtm!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1342255 (https://phabricator.wikimedia.org/T438440) (owner: 10Laurabarluzzi) [15:52:55] (03CR) 10Damilare Adedoyin: [C:03+2] Lazy load applePayHelper module and dns-prefetch the third-party script [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1342255 (https://phabricator.wikimedia.org/T438440) (owner: 10Laurabarluzzi) [15:56:41] 06Fundraising-Backlog: Track backend_processor in payment attempts table - https://phabricator.wikimedia.org/T438075#12355901 (10Ejegg) Let's also add an affirmative flag for auth success, to differentiate between abandoned redirect payments and actual success. It will also let us know when an attempt is blocked... [15:57:10] (03Merged) 10jenkins-bot: Lazy load applePayHelper module and dns-prefetch the third-party script [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1342255 (https://phabricator.wikimedia.org/T438440) (owner: 10Laurabarluzzi) [16:02:37] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Venmo recurrings failing with Multi-use payment method ID is invalid or could not be found - https://phabricator.wikimedia.org/T424392#12355959 (10AnnWF) a:03AnnWF [16:02:39] 06Fundraising-Backlog: Track backend_processor in payment attempts table - https://phabricator.wikimedia.org/T438075#12355960 (10Ejegg) Another couple of fields to add: normalized and raw error codes in case of declines. [16:08:42] (03Merged) 10jenkins-bot: Add count badge for ZD tickets tab in Civi [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1343652 (https://phabricator.wikimedia.org/T438742) (owner: 10Lars SG) [16:18:28] 03Fundraising Sprint: Random Posture Generators, 06Fundraising-Backlog, 07fr-combowiki: Combowiki: Add more pay the fee functionality - https://phabricator.wikimedia.org/T438805#12356033 (10dmiranda) a:03dmiranda [16:27:31] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Venmo recurrings failing with Multi-use payment method ID is invalid or could not be found - https://phabricator.wikimedia.org/T424392#12356071 (10AnnWF) Looked for the latest error [[ https://civicrm.wikimedia.org/civicrm/activity?reset=1&action=view&id=... [16:35:15] (03CR) 10Ejegg: [C:04-1] "Thanks for the CR cstone! I'll -1 this for now while I explore an alternative." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344125 (owner: 10Ejegg) [16:42:00] 06Fundraising-Backlog, 10FR-Smashpig: Do we still need the pending table? - https://phabricator.wikimedia.org/T438991#12356238 (10Ejegg) [16:46:16] 06Fundraising-Backlog, 10FR-Smashpig: Do we still need the pending table? - https://phabricator.wikimedia.org/T438991#12356302 (10SBurnett-WMF) p:05Triage→03Low [16:49:48] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Cannot create batch import (intermittent) - https://phabricator.wikimedia.org/T412329#12356356 (10Lars) @MDemosWMF Have you run into any of these lately? If not, I think we can close this up as us threatening to log it m... [17:08:53] (03PS1) 10Majavah: Batch campaign mixin lookup [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1344334 [17:09:35] FIRING: NetworkDeviceAlarmActive: Alarm active on pfw1-codfw - https://wikitech.wikimedia.org/wiki/Network_monitoring#Juniper_alarm - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DNetworkDeviceAlarmActive [17:09:51] FIRING: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:fxp0 () - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [17:10:52] (03CR) 10CI reject: [V:04-1] Batch campaign mixin lookup [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1344334 (owner: 10Majavah) [17:12:22] FIRING: [4x] CertAlmostExpired: gNMI TLS certificate for fasw1-f5a-codfw.mgmt.codfw.wmnet is going to expire in 0s - https://wikitech.wikimedia.org/wiki/Network_monitoring#CertAlmostExpired - https://grafana.wikimedia.org/d/eab73c60-a402-4f9b-a4a7-ea489b374458/gnmic?var-site=codfw - https://alerts.wikimedia.org/?q=alertname%3DCertAlmostExpired [17:15:05] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10FR-payments-general: Set up and test Gr4vy's 3DS - https://phabricator.wikimedia.org/T435380#12356518 (10Cstone) Gravy still needs to do some setup work still on their end, looking at having it ready in November. But it won't be the same exact product that... [17:16:10] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10FR-payments-general: Set up and test Gr4vy's 3DS - https://phabricator.wikimedia.org/T435380#12356524 (10AnnWF) https://wikimedia.gr4vy.app/merchants/default/connections/payment-services/2a12608b-e9cc-483c-afc6-a9c214b101ed/3-d-secure fyi as the config to... [17:21:17] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10FR-payments-general: Set up and test Gr4vy's 3DS - https://phabricator.wikimedia.org/T435380#12356547 (10SBurnett-WMF) Thank you - moving to later on the backlog board. [17:23:08] 06Fundraising-Backlog, 10FR-payments-general: Set up and test Gr4vy's 3DS - https://phabricator.wikimedia.org/T435380#12356551 (10SBurnett-WMF) [17:25:07] 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice, 10Test Kitchen, 13Patch-For-Review: Record a hide reason to beacon/impression when banner hidden by TestKitchen - https://phabricator.wikimedia.org/T438077#12356570 (10SBurnett-WMF) 05Open→03In progress [17:26:43] RESOLVED: NetworkDeviceAlarmActive: Alarm active on pfw1-codfw - https://wikitech.wikimedia.org/wiki/Network_monitoring#Juniper_alarm - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DNetworkDeviceAlarmActive [17:27:16] RESOLVED: [2x] CoreRouterInterfaceDown: Core router interface down - pfw1-codfw:fxp0 () - https://wikitech.wikimedia.org/wiki/Network_monitoring#Router_interface_down - https://grafana.wikimedia.org/d/fb403d62-5f03-434a-9dff-bd02b9fff504/network-device-overview?var-instance=pfw1-codfw:9804 - https://alerts.wikimedia.org/?q=alertname%3DCoreRouterInterfaceDown [17:29:40] RESOLVED: [4x] CertAlmostExpired: gNMI TLS certificate for fasw1-f5a-codfw.mgmt.codfw.wmnet is going to expire in 0s - https://wikitech.wikimedia.org/wiki/Network_monitoring#CertAlmostExpired - https://grafana.wikimedia.org/d/eab73c60-a402-4f9b-a4a7-ea489b374458/gnmic?var-site=codfw - https://alerts.wikimedia.org/?q=alertname%3DCertAlmostExpired [18:10:56] FIRING: [6x] NodeDown: Node fransw2001 is down. - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [18:12:31] FIRING: [5x] HAProxyExporterDown: HAProxy on fransc2001.frack.codfw.wmnet is down - https://alerts.wikimedia.org/?q=alertname%3DHAProxyExporterDown [18:16:57] FIRING: PfwCoreBGPDown: Fundraising Firewall core BGP session down between pfw1-eqiad and (null) (10.195.0.249) - group VPN - https://wikitech.wikimedia.org/wiki/Network_monitoring#BGP_status - https://grafana.wikimedia.org/d/ed8da087-4bcb-407d-9596-d158b8145d45/bgp-neighbors-detail?orgId=1&var-site=eqiad&var-device=pfw1-eqiad:9804&var-bgp_group=VPN&var-bgp_neighbor=(null) - https://alerts.wikimedia.org/?q=alertname%3DPfwCoreBGPDown [18:18:01] FIRING: [6x] NodeDown: Node fransw2001 has been down for long. - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [18:18:04] FIRING: [24x] NodeDown: Node civi2002 is down. - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [18:18:27] FIRING: [5x] HAProxyExporterDown: HAProxy on fransc2001.frack.codfw.wmnet is down - https://alerts.wikimedia.org/?q=alertname%3DHAProxyExporterDown [18:19:15] FIRING: MariadbNoReplicas: No MariaDB replicas connected to : frdb1007.frack.eqiad.wmnet:9004 - https://alerts.wikimedia.org/?q=alertname%3DMariadbNoReplicas [18:20:56] FIRING: [30x] NodeDown: Node civi2002 has been down for long. - https://alerts.wikimedia.org/?q=alertname%3DNodeDown [18:21:38] FIRING: [6x] HAProxyExporterDown: HAProxy on fransc2001.frack.codfw.wmnet is down - https://alerts.wikimedia.org/?q=alertname%3DHAProxyExporterDown [18:31:35] 03Fundraising Sprint: Random Posture Generators, 06Fundraising-Backlog: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12356831 (10jgleeson) Some info on the "Contract not found" errors https://help.adyen.com/knowledge/ecommerce-integrations/error-codes/why-do-i-... [18:49:39] 03Fundraising Sprint: Random Posture Generators, 06Fundraising-Backlog: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12356875 (10jgleeson) @Ejegg I think I have a compromise between a single recurring threshold (which would also hide spikes in other codes) and... [18:58:58] FIRING: WidespreadPuppetFailure: Puppet has failed on over 5% of hosts - https://frmon.wikimedia.org/d/dwcgqww/puppet - https://alerts.wikimedia.org/?q=alertname%3DWidespreadPuppetFailure [19:02:06] RESOLVED: MariadbNoReplicas: No MariaDB replicas connected to : frdb1007.frack.eqiad.wmnet:9004 - https://alerts.wikimedia.org/?q=alertname%3DMariadbNoReplicas [19:07:35] RESOLVED: PfwCoreBGPDown: Fundraising Firewall core BGP session down between pfw1-eqiad and (null) (10.195.0.249) - group VPN - https://wikitech.wikimedia.org/wiki/Network_monitoring#BGP_status - https://grafana.wikimedia.org/d/ed8da087-4bcb-407d-9596-d158b8145d45/bgp-neighbors-detail?orgId=1&var-site=eqiad&var-device=pfw1-eqiad:9804&var-bgp_group=VPN&var-bgp_neighbor=(null) - https://alerts.wikimedia.org/?q=alertname%3DPfwCoreBGPDown [19:25:01] 03Fundraising Sprint: Random Posture Generators, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-MGFE: In Civi can we show if a donor has a ZD ticket open on the Zendesk tab on a donor record - https://phabricator.wikimedia.org/T438742#12356965 (10AFowler-WMF) Thank you for actioning this so q... [19:36:04] RESOLVED: WidespreadPuppetFailure: Puppet has failed on over 5% of hosts - https://frmon.wikimedia.org/d/dwcgqww/puppet - https://alerts.wikimedia.org/?q=alertname%3DWidespreadPuppetFailure [19:42:03] (03PS9) 10Ejegg: Wait till banner fetched to consult TK enrollment [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1342797 (https://phabricator.wikimedia.org/T438057) [20:04:57] (03PS1) 10Damilare Adedoyin: WIP: For paybybank connection [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1344370 [20:05:17] (03PS2) 10Damilare Adedoyin: WIP: For paybybank connection [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1344370 [20:08:05] 03Fundraising Sprint: Random Posture Generators, 06Fundraising-Backlog: Supress failmails from expected recurring failures - https://phabricator.wikimedia.org/T438905#12357088 (10Ejegg) Oh nice @jgleeson, I hadn't noticed those bits on the response. Sounds good! [20:21:34] 03Fundraising Sprint: Random Posture Generators, 06Fundraising-Backlog, 07fr-combowiki: Combowiki: Use uselang= for language in the URL - https://phabricator.wikimedia.org/T437483#12357126 (10Laurabarluzzi) > sub-ticket could copy over the translations from donate wiki Did we change our mind on how to lever... [20:22:59] 03Fundraising Sprint: Random Posture Generators, 06Fundraising-Backlog, 07fr-combowiki: Combowiki: Use uselang= for language in the URL - https://phabricator.wikimedia.org/T437483#12357134 (10Laurabarluzzi) a:03Laurabarluzzi [20:23:21] 03Fundraising Sprint: Random Posture Generators, 06Fundraising-Backlog, 07fr-combowiki: Consider improving the wiring of the logger in ComboWiki.php and its classes - https://phabricator.wikimedia.org/T434831#12357135 (10Laurabarluzzi) a:03Laurabarluzzi [20:24:37] (03PS6) 10Laurabarluzzi: Remove applePayHelper.js legacy dependencies in ComboWiki [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1342784 (https://phabricator.wikimedia.org/T438143) [20:31:14] (03CR) 10Laurabarluzzi: Remove applePayHelper.js legacy dependencies in ComboWiki (033 comments) [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1342784 (https://phabricator.wikimedia.org/T438143) (owner: 10Laurabarluzzi) [21:00:44] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Pass language from banner to leadgen endpoint, so we can set a preferred language on new contact - https://phabricator.wikimedia.org/T439042 (10Lars) 03NEW [21:09:33] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1344393 [21:12:20] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Cannot create batch import (intermittent) - https://phabricator.wikimedia.org/T412329#12357266 (10MDemosWMF) @Elbar53 has not, waiting to hear back from @BJordan-WMF. [21:39:47] (03PS1) 10Eileen: Quash stock thank you & trigger manual intevention [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344397 [21:42:31] 06Fundraising-Backlog, 07fr-combowiki: Combowiki: filter payment method by supported country - https://phabricator.wikimedia.org/T437508#12357333 (10dmiranda) a:05dmiranda→03None [22:28:13] (03CR) 10Dmiranda: [C:03+2] "Thanks @emcnaughton@wikimedia.org! Looks good to me" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344397 (owner: 10Eileen) [22:32:56] (03PS1) 10Ejegg: Wire up a service to get gateway configurations [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344403 [22:34:20] (03PS3) 10Eileen: Chariot: add limited queueing support [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1311308 (https://phabricator.wikimedia.org/T419044) [22:34:49] (03CR) 10CI reject: [V:04-1] Wire up a service to get gateway configurations [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1344403 (owner: 10Ejegg) [22:38:09] (03CR) 10Dmiranda: [C:03+2] "Thanks @emcnaughton@wikimedia.org! Everything looks good to me. I do have one random question for whenever you have time though just as a " [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344132 (owner: 10Eileen) [22:39:30] (03CR) 10Eileen: "Ohh - I had not even thought about the weight so ... no - Claude did it & I never gave it a second thought... but it's a UI experience thi" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344132 (owner: 10Eileen) [22:48:30] (03Merged) 10jenkins-bot: Quash stock thank you & trigger manual intevention [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344397 (owner: 10Eileen) [22:52:50] (03CR) 10CI reject: [V:04-1] Chariot: add limited queueing support [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1311308 (https://phabricator.wikimedia.org/T419044) (owner: 10Eileen) [22:57:39] (03Merged) 10jenkins-bot: Add batch_data fields for reference, adjustment, and to-main journals [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344132 (owner: 10Eileen) [23:06:35] (03PS16) 10Lars SG: Add iframe for donor details to be shown in ZD [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1331825 (https://phabricator.wikimedia.org/T433866) [23:16:47] (03CR) 10Dmiranda: [C:03+2] "TY!" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1344132 (owner: 10Eileen) [23:16:48] 03Fundraising Sprint: Random Posture Generators, 06Fundraising-Backlog, 07payments-orchestration: Get our ID in the checkout.com console - https://phabricator.wikimedia.org/T431628#12357651 (10Cstone) it's there!! [23:29:00] (03PS4) 10Eileen: Chariot: add limited queueing support [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1311308 (https://phabricator.wikimedia.org/T419044) [23:48:57] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1344393 (owner: 10Eileen) [23:50:38] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1344408 [23:51:29] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1344408 (owner: 10Eileen) [23:52:25] (03Merged) 10jenkins-bot: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1344408 (owner: 10Eileen) [23:52:47] (03CR) 10Wfan: Chariot: add limited queueing support (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1311308 (https://phabricator.wikimedia.org/T419044) (owner: 10Eileen) [23:58:18] !log civicrm upgraded from 4fc5d217 to 11d9e123 [23:58:19] Logged the message at https://wikitech.wikimedia.org/wiki/Fundraising/SAL