[00:57:25] (03PS2) 10Eileen: Replace a call to fail mail [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1121126 (https://phabricator.wikimedia.org/T386283) [01:07:55] (03PS1) 10Eileen: Start outputting fail mail to alert [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126202 (https://phabricator.wikimedia.org/T386283) [01:08:32] 03Fundraising Sprint: Dodos, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 13Patch-For-Review: Replace drupal failmail.php with monolog logger - https://phabricator.wikimedia.org/T386283#10621772 (10Eileenmcnaughton) Some patches review-ready - full swap over pending [01:11:35] 06Fundraising-Backlog, 10Recurring-Donations: Automatic recurring failure/cancel email from Civi - https://phabricator.wikimedia.org/T214599#10621777 (10Cstone) 05Open→03Resolved a:03Cstone Found when not searching for this, we have done this. [01:14:08] 06Fundraising Tech Chaos Holding Pen, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: failed recurring preview doesn't work in civi email templating UI - https://phabricator.wikimedia.org/T302447#10621781 (10Cstone) 05Open→03Resolved a:03Cstone Another old fine, this has been fixed. [01:17:14] 06Fundraising-Backlog, 10Recurring-Donations: Automated generic email for failed recurring sent in error - https://phabricator.wikimedia.org/T258778#10621784 (10Cstone) 05Open→03Resolved a:03Cstone Resolving as this is an old bug [01:18:09] 06Fundraising-Backlog, 10FR-AutoTY-Email, 10FR-donorservices, 10FR-Email: Auto Recurring Failure Email - Afrikaans - https://phabricator.wikimedia.org/T296871#10621788 (10Cstone) 05Open→03Resolved a:03Cstone Looks like this was done in 2022 [01:18:55] 06Fundraising-Backlog, 10FR-AutoTY-Email: Copy request for recurring receipt and standard TY email - https://phabricator.wikimedia.org/T251428#10621792 (10Cstone) 05Open→03Resolved a:03Cstone Now in message templates [01:19:41] 06Fundraising-Backlog, 10FR-AutoTY-Email, 07Epic: EPIC: Q4 FY 19/20 TY recurring email polish pass - https://phabricator.wikimedia.org/T250921#10621796 (10Cstone) 05Open→03Resolved a:03Cstone From 2020 [01:21:05] (03PS1) 10Eileen: Stock CiviCRM 6.1rc [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126204 (https://phabricator.wikimedia.org/T376337) [01:23:25] hah actually found the phab i was looking for [01:27:59] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10FR-donorservices: Civi recur failure message emails not consistently deploying - https://phabricator.wikimedia.org/T386733#10621806 (10Cstone) We have a phab to move the email send out of the big smashpig job, we'd need to do this to get them sending... [01:29:34] 14Fundraising Sprint A Wrinkle in Timezones, 14Fundraising Sprint Visual Basic Instinct, 06Fundraising-Backlog: Get paypal to prevent older paypal recurring from sending inaccurate cancel email - https://phabricator.wikimedia.org/T236506#10621809 (10Cstone) 05Open→03Resolved a:03Cstone Looks like p... [01:31:53] 06Fundraising-Backlog, 10FR-Paypal, 10FR-Smashpig, 10Recurring-Donations: When PayPal recurring donor changes their PP profile contact, update the email address in CRM - https://phabricator.wikimedia.org/T146309#10621814 (10Cstone) 05Open→03Resolved a:03Cstone Oldie but goodie as we just talked a... [01:33:13] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Store reasons for recurring donation failure - https://phabricator.wikimedia.org/T132409#10621820 (10Cstone) 05Open→03Resolved a:03Cstone Oh hey we do this now [01:34:32] 06Fundraising-Backlog, 10FR-failmail: SmashPig::recurring failmail from 12/14/2019 - https://phabricator.wikimedia.org/T240765#10621824 (10Cstone) 05Open→03Resolved a:03Cstone Closing for old bug [01:34:42] (03CR) 10Jdlrobson: mediawiki.Uri is deprecated, use URL instead (031 comment) [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1125253 (https://phabricator.wikimedia.org/T380079) (owner: 10Jdlrobson) [01:35:34] 06Fundraising-Backlog, 10Recurring-Donations: Recurring: Apply retry logic by decline reason. - https://phabricator.wikimedia.org/T237654#10621828 (10Cstone) 05Open→03Resolved a:03Cstone Autorescue is the fancy solution to this, we also added some checking on our own before that [01:36:22] 06Fundraising-Backlog, 10FR-donorservices, 10FR-PayPal-ExpressCheckout, 10Recurring-Donations: PayPal recurring donation question - https://phabricator.wikimedia.org/T255691#10621832 (10Cstone) 05Open→03Resolved a:03Cstone Resolving for old bug cleanup [01:37:02] (03CR) 10Jdlrobson: mediawiki.Uri is deprecated, use URL instead (031 comment) [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1125253 (https://phabricator.wikimedia.org/T380079) (owner: 10Jdlrobson) [01:37:05] 06Fundraising-Backlog: Recurring Charge Processor throwing Failed to write to socket: unknown error - https://phabricator.wikimedia.org/T281439#10621836 (10Cstone) 05Open→03Resolved a:03Cstone Hasn't happened in two years [01:38:29] 14Fundraising Sprint Heaven is a page on Wikipedia, 14Fundraising Sprint Ice cream cures everything, 06Fundraising-Backlog, 10FR-donorservices, 10Recurring-Donations: PayPal recurring: cycle of authorization reversals? - https://phabricator.wikimedia.org/T249951#10621841 (10Cstone) 05Open→03Resolv... [01:38:43] ice cream cures everything [01:45:56] 14Fundraising Sprint Pseudopretzels, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add utm_medium to failed recur email - https://phabricator.wikimedia.org/T256184#10621845 (10Cstone) 05Open→03Resolved a:03Cstone In message templates now and with a utm_medium [01:46:15] pseudopretzels is pretty good [01:47:12] (03CR) 10CI reject: [V:04-1] Stock CiviCRM 6.1rc [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126204 (https://phabricator.wikimedia.org/T376337) (owner: 10Eileen) [01:47:25] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM, 10Recurring-Donations: Move the recurring failure send out of in the charge job and check for other active recurrings by email - https://phabricator.wikimedia.org/T356073#10621848 (10Cstone) [01:49:25] 06Fundraising Tech Chaos Holding Pen, 06Fundraising-Backlog, 10FR-donorservices, 10FR-Japan: Japanese language form & TY page, but English TY email: recent tests - https://phabricator.wikimedia.org/T284608#10621850 (10Cstone) 05Open→03Resolved a:03Cstone We update the language now [01:51:33] 06Fundraising-Backlog, 10FR-Paypal, 10Recurring-Donations: Recurring PayPal donations not reaching Civi if subscription is older than a few years - https://phabricator.wikimedia.org/T120692#10621854 (10Cstone) 05Open→03Resolved a:03Cstone Looks like this got fixed in 2017 [01:53:00] 06Fundraising-Backlog: 'Invalid ffname' daily digest for banner and email crofters - https://phabricator.wikimedia.org/T107169#10621858 (10Cstone) 05Open→03Resolved a:03Cstone Rip ffname [02:16:08] (03PS2) 10Eileen: Start outputting fail mail to alert [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126202 (https://phabricator.wikimedia.org/T386283) [02:16:24] cstone: should we push this out - https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1126202 per our tech talk [02:16:59] sure why not eileen [02:18:19] although it looks like we dont get that many what [02:18:20] er [02:18:26] whats that somethings wrong one [02:18:28] s [02:19:51] hmm actually they are from us posting the logs [02:20:08] (03CR) 10Cstone: [C:03+2] "Let's do it" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126202 (https://phabricator.wikimedia.org/T386283) (owner: 10Eileen) [02:43:52] (03Merged) 10jenkins-bot: Start outputting fail mail to alert [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126202 (https://phabricator.wikimedia.org/T386283) (owner: 10Eileen) [02:52:23] cstone: argh - it LOOKS LIKE this has been merged??? https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/1126204 [02:52:39] I'm so confused! [02:53:54] hmm [02:54:00] it does say merged [02:54:21] at the top but the bottom says pushed [02:54:27] does it usually say that on force merges? [02:54:29] yeah & I got it when I pulled down - but ... how? greg-g ever seen that before? [02:54:38] I'ccccccevjlhirrrebeunuhc gruiugjttchtjnjfrgnkl [02:54:47] I've never heard of a force merge to gerrit cccccbcejlehvihhjfiegbfrllkbuvfbhbrjknhgvejklnj [02:54:49] before [02:55:02] you can see even my yubikey is losing it over that [02:55:05] ooh, major version bump [02:55:14] Change has been successfully merged usually says this instead of pushed [02:56:40] yeah - I just pinged on releng - that is sooo odd [02:57:24] I guess I'd better just push a revert cos we don't want that going out - esp since I was gonna check test fails [02:57:33] well only one test did fail? [02:57:40] no - 4 [02:57:43] ahh hah [02:57:51] didnt scroll enough [02:57:59] ejegg: the major version is mostly cos Josh wants to make a hoopla on standalone/ riverlea [02:59:31] eileen: yeah, that's what a forced merge looks like [02:59:44] greg-g: but I shouldn't have permission? [02:59:50] ah word eileen . Yeah, reading the release notes I didn't see much of a breaking change [03:00:04] it can be set per repo [03:00:06] eileen: we've had force-merge for a while on CRM, haven't we? [03:00:23] but usually it has different words, at least on dev when we force merge it says "Change has been successfully merged" still [03:00:24] since we often have needed to re-apply local patches to make our tests pass [03:00:53] but I've always done that in the gerrit UI before - I force v+2 & C+2 [03:01:08] - this is like I've done a direct push - I've never been able to do that before [03:01:12] ah yeah what im talking about is through the UI [03:02:02] no - this is def not through the UI [03:02:39] I can see I did a generic `git push` in my command line history - but in the past that has always been rejected [03:03:54] https://gerrit.wikimedia.org/r/admin/repos/wikimedia/fundraising/crm,access [03:03:59] this time it pushed in that commit & one I hadn't even put up for review (presumably I meant to do `git review` and typed `git push` [03:04:15] shows that our whole group now has 'Owner' permissions [03:04:30] not sure how long it's been like that, but I haven't touched those permissions in years [03:04:52] no - but I'm 100% sure this is NOT the first time I have accidentally typed `git push` [03:05:09] & this is the first time it has just acted like gerrit doesn't exist [03:07:21] so this patch 237c2ea7a Remove 'left behind' file - also went in [03:09:22] - I've just pushed up the revert - I'll leave that second patch - it's a no brainer [03:09:41] hmm, almost all the crm repo config is inherited from wikimedia/fundraising config [03:09:48] let's see what that says about allowing push [03:10:28] https://gerrit.wikimedia.org/r/admin/repos/wikimedia/fundraising,access [03:10:35] I'm just so sure this is not the first time I've done that because I am flipping between github & gerrit all day long so I'm always making mistakes like that [03:10:46] says 'Push': Allow pushing but not force-pushing [03:11:21] - I thought that master & deployment had branch protection tho? [03:11:24] so I guess when you've done it before it was maybe not on a patch that could be strictly fast-forwarded from the master branch? [03:12:05] I just don't think so [03:12:50] I type in `git review` 50 times a day so the idea today is the first time I accidentally did it on master - (which I often work directly on) .... [03:12:58] sorry `git push` [03:13:32] (03PS1) 10Eileen: Revert "Stock CiviCRM 6.1rc" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126210 [03:14:06] anyway - there is the revert [03:23:20] (03CR) 10Eileen: [C:03+2] "self +2 as the commit should never have been merged" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126210 (owner: 10Eileen) [03:50:03] (03Merged) 10jenkins-bot: Revert "Stock CiviCRM 6.1rc" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126210 (owner: 10Eileen) [03:51:58] (03PS1) 10Eileen: Merge branch 'master' of ssh://gerrit.wikimedia.org:29418/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1126211 [03:52:13] (03CR) 10Eileen: [C:03+2] Merge branch 'master' of ssh://gerrit.wikimedia.org:29418/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1126211 (owner: 10Eileen) [03:52:59] (03Merged) 10jenkins-bot: Merge branch 'master' of ssh://gerrit.wikimedia.org:29418/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/1126211 (owner: 10Eileen) [03:54:52] !log civicrm upgraded from f2222fcd to ec20a105 [03:54:52] 4:54 PM [03:54:52] * config revision changed from 44fc7885 to de33fff3 [03:54:54] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [04:27:06] ice cream cure++ [05:52:10] (03CR) 10Abijeet Patro: [V:03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_39) - 10https://gerrit.wikimedia.org/r/1125723 (owner: 10L10n-bot) [06:23:05] (03CR) 10CI reject: [V:04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_43) - 10https://gerrit.wikimedia.org/r/1126294 (owner: 10L10n-bot) [08:24:08] 06Fundraising-Backlog, 10fundraising-tech-ops, 10LDAP-Access-Requests, 06SRE: Grant Access to astein for fr-tech icinga acknowledgements - https://phabricator.wikimedia.org/T388186#10622422 (10MoritzMuehlenhoff) @AStein-WMF Turns out we don't actually need your SSH key for this access request. Instead, ple... [14:09:09] 06Fundraising-Backlog, 10Fr-CentralNotice-Translation-Bugs, 10MediaWiki-extensions-CentralNotice, 10MediaWiki-extensions-Translate: BUG: CentralNotice banner translations sometimes go missing from Translate interface - https://phabricator.wikimedia.org/T90863#10623811 (10Nikerabbit) This might be duplicate... [14:12:18] 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: Some CentralNotice translatable banner messages do not return message definition - https://phabricator.wikimedia.org/T286699#10623820 (10Nikerabbit) This task indirectly caused another production issue: {T388467} due to error `Did not find message de... [14:13:46] 06Fundraising-Backlog, 06Language and Product Localization, 10MediaWiki-extensions-CentralNotice: Some CentralNotice translatable banner messages do not return message definition - https://phabricator.wikimedia.org/T286699#10623828 (10Nikerabbit) [14:33:16] PROBLEM - check_mysql on frdb1004 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 12593 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1004&service=check_mysql [14:43:16] RECOVERY - check_mysql on frdb1004 is OK: Uptime: 324066 Threads: 5 Questions: 7227109 Slow queries: 168 Opens: 1276 Open tables: 1243 Queries per second avg: 22.301 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1004&service=check_mysql [14:44:51] XenoRyet: I just booked a flight that was $7 over the policy so I could get home same-day without missing the end of the event. I' [14:45:05] m happy to pay those extra $7 if it'll get the flight approved [14:55:52] I don't think it should be a problem to get it approved, and you shouldn't need to pay anything. [14:58:10] Looks like you just need to send an email to travelmanager@ to make sure they see it and can approve it. They should get automatically notified, but the officewiki page says they like an email ping too, just in case. [15:05:47] 06Fundraising-Backlog, 10Fr-CentralNotice-Translation-Bugs, 10MediaWiki-extensions-CentralNotice, 10MediaWiki-extensions-Translate: BUG: CentralNotice banner translations sometimes go missing from Translate interface - https://phabricator.wikimedia.org/T90863#10624169 (10Pcoombe) >>! In T90863#10623811, @N... [15:10:14] 06Fundraising-Backlog, 10Fr-CentralNotice-Translation-Bugs, 10MediaWiki-extensions-CentralNotice, 10MediaWiki-extensions-Translate: BUG: CentralNotice banner translations sometimes go missing from Translate interface - https://phabricator.wikimedia.org/T90863#10624209 (10Nikerabbit) Thanks for the info. I... [15:16:20] (03PS11) 10Ejegg: Sort gravy reference data methods [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1117563 (owner: 10Damilare Adedoyin) [15:16:37] (03CR) 10CI reject: [V:04-1] Sort gravy reference data methods [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1117563 (owner: 10Damilare Adedoyin) [15:18:41] (03PS12) 10Ejegg: Sort gravy reference data methods [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1117563 (owner: 10Damilare Adedoyin) [15:19:06] (03CR) 10CI reject: [V:04-1] Sort gravy reference data methods [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1117563 (owner: 10Damilare Adedoyin) [15:30:02] (03PS13) 10Ejegg: Sort gravy reference data methods [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1117563 (owner: 10Damilare Adedoyin) [15:39:09] (03CR) 10Ejegg: [C:03+2] Sort gravy reference data methods [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1117563 (owner: 10Damilare Adedoyin) [15:39:39] (03Merged) 10jenkins-bot: Sort gravy reference data methods [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1117563 (owner: 10Damilare Adedoyin) [15:43:53] (03PS1) 10Ejegg: Normalize quotes in Gravy code [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1126588 [15:44:10] fr-tech anyone want to give that a quick review? ^^^ [15:44:19] just afraid that it'll go stale really quickly [15:46:10] hmm, those payment method constants in gravy referenceData could go in a non-provider-specific class [15:56:20] (03PS1) 10Ejegg: Move payment method constants to generic class [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1126591 [16:09:38] (03PS3) 10Thiemo Kreuz (WMDE): Drop unused code related to sanitizeText methods [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1118471 [16:09:41] (03CR) 10Ejegg: [C:03+2] Drop unused code related to sanitizeText methods [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1118471 (owner: 10Thiemo Kreuz (WMDE)) [16:15:05] (03PS2) 10Damilare Adedoyin: Fix amount formatting for locales with hyphens [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1122984 (https://phabricator.wikimedia.org/T387137) [16:15:14] (03CR) 10Ejegg: [C:03+2] Fix amount formatting for locales with hyphens [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1122984 (https://phabricator.wikimedia.org/T387137) (owner: 10Damilare Adedoyin) [16:18:55] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap: Search kit fields for pledges - https://phabricator.wikimedia.org/T361635#10624728 (10AKanji-WMF) While @MDemosWMF was able to create a dashlet using Civi reports, which has all the fields required, the preference would still be to get the fields into Searchki... [16:24:14] (03PS3) 10Umherirrender: Provide escape paramater for fgetcsv/fputcsv [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1120239 [16:24:37] (03CR) 10Ejegg: [C:03+2] Provide escape paramater for fgetcsv/fputcsv [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1120239 (owner: 10Umherirrender) [16:29:05] (03PS1) 10Ejegg: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1126602 [16:31:10] 06Fundraising-Backlog, 10fundraising-tech-ops: Issue new SSL Client Certificate for ccogdill - https://phabricator.wikimedia.org/T386050#10624812 (10Dwisehaupt) 05Open→03Resolved certificate renewed and sent via email. password sent via sms. [16:36:49] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Special:BannerLoader not working on fundraising-dev donut wiki build - https://phabricator.wikimedia.org/T388418#10624847 (10Ejegg) 05Open→03Resolved a:03Ejegg Turns out this is a problem with the specific patch being tested. [16:37:20] 06Fundraising-Backlog, 10fundraising-tech-ops, 10LDAP-Access-Requests, 06SRE: Grant Access to astein for fr-tech icinga acknowledgements - https://phabricator.wikimedia.org/T388186#10624853 (10AStein-WMF) @MoritzMuehlenhoff my user is `astein`! [16:39:15] 10fundraising-tech-ops, 10BDC-Implementation, 06Data-Engineering, 06Data-Engineering-Radar, and 2 others: [Trino] Develop procedure and scripting for Trino cluster maintenance. - https://phabricator.wikimedia.org/T386391#10624861 (10Jgreen) [16:41:54] 10fundraising-tech-ops, 10BDC-Implementation, 06Data-Engineering, 06Data-Engineering-Radar, and 2 others: [Trino] Develop procedure and scripting for Trino cluster maintenance. - https://phabricator.wikimedia.org/T386391#10624866 (10Jgreen) We can use python's trino client to query system.runtime.(tasks|qu... [16:42:11] (03PS2) 10Jforrester: CurrencyRatesModule: Stop using Xml::encodeJsVar, deprecated [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1056171 (https://phabricator.wikimedia.org/T341779) [16:54:02] 06Fundraising Tech Chaos Holding Pen, 06Fundraising-Backlog: ApplePay token amount-mismatch - https://phabricator.wikimedia.org/T324413#10624922 (10AKanji-WMF) [16:55:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [17:00:08] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [17:03:00] 10fundraising-tech-ops, 10BDC-Implementation: Survey Monkey load data into platform - https://phabricator.wikimedia.org/T385743#10624970 (10IAckerman-WMF) a:03AStein-WMF [17:04:55] 10fundraising-tech-ops, 10BDC-Implementation: Survey Monkey load data into platform - https://phabricator.wikimedia.org/T385743#10624977 (10IAckerman-WMF) will check if job is running in Dagster [17:05:08] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [17:06:53] jeez, gate-n-submit queue is way slow [17:10:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [17:15:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [17:16:18] ACKNOWLEDGEMENT - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster Dwisehaupt known - testing in progress https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [17:28:17] 06Fundraising-Backlog, 10MediaWiki-extensions-CentralNotice: Get data about banner closes and maybe more - https://phabricator.wikimedia.org/T324140#10625162 (10AKanji-WMF) Given relative priority of this task in related work described on [[ https://docs.google.com/document/d/18ukLYBxUzu0YqU4KMJ5m1cSHR3xJo5fRT... [17:28:38] (03Merged) 10jenkins-bot: Drop unused code related to sanitizeText methods [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1118471 (owner: 10Thiemo Kreuz (WMDE)) [17:28:39] (03Merged) 10jenkins-bot: Fix amount formatting for locales with hyphens [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1122984 (https://phabricator.wikimedia.org/T387137) (owner: 10Damilare Adedoyin) [17:28:40] (03Merged) 10jenkins-bot: Provide escape paramater for fgetcsv/fputcsv [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1120239 (owner: 10Umherirrender) [17:36:37] (03CR) 10Cstone: [C:03+2] Normalize quotes in Gravy code [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1126588 (owner: 10Ejegg) [17:37:07] (03Merged) 10jenkins-bot: Normalize quotes in Gravy code [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1126588 (owner: 10Ejegg) [17:37:25] thanks cstone ! [17:43:44] (03PS6) 10Jdlrobson: mediawiki.Uri is deprecated, use URL instead [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1125253 (https://phabricator.wikimedia.org/T380079) [17:47:07] (03CR) 10CI reject: [V:04-1] mediawiki.Uri is deprecated, use URL instead [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1125253 (https://phabricator.wikimedia.org/T380079) (owner: 10Jdlrobson) [17:50:58] (03PS7) 10Jdlrobson: mediawiki.Uri is deprecated, use URL instead [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1125253 (https://phabricator.wikimedia.org/T380079) [17:51:12] (03CR) 10Jdlrobson: mediawiki.Uri is deprecated, use URL instead (031 comment) [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1125253 (https://phabricator.wikimedia.org/T380079) (owner: 10Jdlrobson) [17:54:23] (03CR) 10CI reject: [V:04-1] mediawiki.Uri is deprecated, use URL instead [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1125253 (https://phabricator.wikimedia.org/T380079) (owner: 10Jdlrobson) [18:05:42] (03PS4) 10Wfan: Add apple script for adyen apple pay [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1125195 (https://phabricator.wikimedia.org/T382279) [18:13:08] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Special:BannerLoader not working on fundraising-dev donut wiki build - https://phabricator.wikimedia.org/T388418#10625537 (10Jroberson108) Not sure why I was subscribed to this. You might have me mixed up with someone else. Doesn't sound familiar at all. [18:13:23] 06Fundraising-Backlog, 10fundraising-tech-ops, 10LDAP-Access-Requests, 06SRE: Grant Access to astein for fr-tech icinga acknowledgements - https://phabricator.wikimedia.org/T388186#10625540 (10BCornwall) [18:13:41] 06Fundraising-Backlog, 10fundraising-tech-ops, 10LDAP-Access-Requests, 06SRE: Grant Access to astein for fr-tech icinga acknowledgements - https://phabricator.wikimedia.org/T388186#10625542 (10BCornwall) a:03MoritzMuehlenhoff [18:14:50] (03CR) 10Ejegg: [C:03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1126602 (owner: 10Ejegg) [18:15:07] RECOVERY - check_dagster on fran2001 is OK: PROCS OK: 1 process with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [18:19:09] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog: Special:BannerLoader not working on fundraising-dev donut wiki build - https://phabricator.wikimedia.org/T388418#10625608 (10Pppery) [18:23:10] (03CR) 10Cstone: [C:03+2] Move payment method constants to generic class [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1126591 (owner: 10Ejegg) [18:23:40] (03Merged) 10jenkins-bot: Move payment method constants to generic class [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1126591 (owner: 10Ejegg) [18:28:28] 06Fundraising-Backlog, 10FR-donorservices: Feature request assessment: Zendesk macro updater - https://phabricator.wikimedia.org/T387503#10625707 (10Cstone) Looks like zendeski api does let you update macros: [18:30:26] thanks again cstone [18:31:37] np [18:33:55] (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/1126602 (owner: 10Ejegg) [18:35:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [18:40:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [18:45:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [18:49:38] (03PS1) 10Ejegg: Update composer.lock with upgraded libraries [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1126626 [18:49:41] (03CR) 10Ejegg: [C:03+2] Update composer.lock with upgraded libraries [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1126626 (owner: 10Ejegg) [18:50:08] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [18:53:40] ACKNOWLEDGEMENT - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster Dwisehaupt known - testing. https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [18:55:44] 03Fundraising Sprint: Dodos, 06Fundraising-Backlog, 07payments-orchestration: Gr4vy Payments Gateway Optimization - https://phabricator.wikimedia.org/T385856#10625863 (10AnnWF) [18:56:05] (03PS2) 10Ejegg: Update composer.lock with upgraded libraries [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1126626 [18:58:37] (03PS3) 10Jforrester: CurrencyRatesModule: Stop using Xml::encodeJsVar, deprecated [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1056171 (https://phabricator.wikimedia.org/T341779) [18:58:42] (03CR) 10Ejegg: [C:03+2] CurrencyRatesModule: Stop using Xml::encodeJsVar, deprecated [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1056171 (https://phabricator.wikimedia.org/T341779) (owner: 10Jforrester) [19:01:00] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 10Wikimedia-Fundraising-CiviCRM: Come July 1 we need to roll over the donor segment & status values - https://phabricator.wikimedia.org/T383195#10625892 (10AKanji-WMF) [19:01:12] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Did we import a contribution to a deleted contact - https://phabricator.wikimedia.org/T388170#10625894 (10MDemosWMF) These are other examples that look to be imported to the deleted record. I'm moving the gifts to the merged record: 58308656 25200829 63... [19:11:38] (03Merged) 10jenkins-bot: CurrencyRatesModule: Stop using Xml::encodeJsVar, deprecated [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1056171 (https://phabricator.wikimedia.org/T341779) (owner: 10Jforrester) [19:29:24] 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Civi: expand 'deceased' checkbox to cover all outreach methods - https://phabricator.wikimedia.org/T383717#10625960 (10AKanji-WMF) Ideally considered against the larger conversation/design around opt-in/opt-out/consent in Civi. [19:30:49] 06Fundraising-Backlog: Come up with a better name for PaymentDetailResponse in SmashPig - https://phabricator.wikimedia.org/T383400#10625967 (10AKanji-WMF) Moving into Sprint E for discussion - [19:32:39] 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 07fr-acoustic, 13Patch-For-Review: Develop process for tracking & handling SMS consent records - https://phabricator.wikimedia.org/T379702#10625987 (10Eileenmcnaughton) [19:42:28] (03PS8) 10Jdlrobson: mediawiki.Uri is deprecated, use URL instead [extensions/CentralNotice] - 10https://gerrit.wikimedia.org/r/1125253 (https://phabricator.wikimedia.org/T380079) [20:06:07] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog: Scoping: Donor Portal - https://phabricator.wikimedia.org/T388422#10626030 (10AKanji-WMF) [20:06:09] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog: Adyen iDEAL 2.0 Updates - Due April 1st - https://phabricator.wikimedia.org/T387738#10626032 (10AKanji-WMF) [20:06:12] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07payments-orchestration: How will we expose payment processor errors/issues with gravy - https://phabricator.wikimedia.org/T387411#10626033 (10AKanji-WMF) [20:06:13] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 13Patch-For-Review, 07Unplanned-Sprint-Work: Remove address fields for ACH in checkout flow - https://phabricator.wikimedia.org/T387758#10626031 (10AKanji-WMF) [20:06:15] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog: Sprint D - Priorities [2025] - https://phabricator.wikimedia.org/T387241#10626035 (10AKanji-WMF) [20:06:17] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Enable Riverlea theme, disable the Island - https://phabricator.wikimedia.org/T386409#10626038 (10AKanji-WMF) [20:06:20] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10FR-email-preferences: update Email Preferences queue consumer to use api4 - https://phabricator.wikimedia.org/T386871#10626037 (10AKanji-WMF) [20:06:22] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog: Fidelity Mapping Import - Change in gift framework - https://phabricator.wikimedia.org/T386017#10626040 (10AKanji-WMF) [20:06:23] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Replace drupal failmail.php with monolog logger - https://phabricator.wikimedia.org/T386283#10626039 (10AKanji-WMF) [20:06:27] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07payments-orchestration: Gr4vy Payments Gateway Optimization - https://phabricator.wikimedia.org/T385856#10626041 (10AKanji-WMF) [20:06:31] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10FR-donorservices: Request to Revert field back to what it was - https://phabricator.wikimedia.org/T385745#10626043 (10AKanji-WMF) [20:06:35] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10MW-1.44-notes (1.44.0-wmf.20; 2025-03-11), 07payments-orchestration: Gravy Paypal: Update to new integration - https://phabricator.wikimedia.org/T385738#10626044 (10AKanji-WMF) [20:06:39] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10MW-1.44-notes (1.44.0-wmf.20; 2025-03-11), 07payments-orchestration: Gravy dLocal Cash Payments (one-time) - https://phabricator.wikimedia.org/T385014#10626047 (10AKanji-WMF) [20:06:43] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07Epic, 07payments-orchestration: Gravy dLocal Cash Payments (recurring) - https://phabricator.wikimedia.org/T385015#10626046 (10AKanji-WMF) [20:06:47] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07Epic, 07payments-orchestration: Gravy dLocal country traffic routing - https://phabricator.wikimedia.org/T385017#10626045 (10AKanji-WMF) [20:06:51] 14Fundraising Sprint: Abula, 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10FR-Smashpig, and 2 others: Handle PayPal recurring charges that don't include a subscription ID - https://phabricator.wikimedia.org/T385801#10626042 (10AKanji-WMF) [20:06:55] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07payments-orchestration: Gravy dLocal Wallet Payments (recurring) - https://phabricator.wikimedia.org/T385011#10626049 (10AKanji-WMF) [20:06:59] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07payments-orchestration: Gravy dLocal Wallet Payments (one-time) - https://phabricator.wikimedia.org/T385010#10626050 (10AKanji-WMF) [20:07:03] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07payments-orchestration: Gravy dLocal Card Payments (recurring) - https://phabricator.wikimedia.org/T385009#10626051 (10AKanji-WMF) [20:07:07] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07payments-orchestration: Gravy dLocal Bank Transfers (one-time) - https://phabricator.wikimedia.org/T385012#10626048 (10AKanji-WMF) [20:07:11] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog: Come up with a better name for PaymentDetailResponse in SmashPig - https://phabricator.wikimedia.org/T383400#10626055 (10AKanji-WMF) [20:07:15] 14Fundraising Sprint Bibimbap, 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog: 2025 Sprint B Priorities/ End of sprint summary - https://phabricator.wikimedia.org/T384974#10626053 (10AKanji-WMF) [20:07:20] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10MW-1.44-notes (1.44.0-wmf.20; 2025-03-11), 07payments-orchestration: Gravy dLocal Card Payments (one-time) - https://phabricator.wikimedia.org/T385008#10626052 (10AKanji-WMF) [20:07:24] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10FR-Civi-Dedupe: Fix dedupe merge wrapper script to track modified date - https://phabricator.wikimedia.org/T383194#10626056 (10AKanji-WMF) [20:07:28] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07Epic, 07payments-orchestration: Gravy Dlocal - https://phabricator.wikimedia.org/T384967#10626054 (10AKanji-WMF) [20:07:32] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Add wmf-cv to our dev environments - https://phabricator.wikimedia.org/T383097#10626057 (10AKanji-WMF) [20:07:36] 14Fundraising Sprint: didAnyoneTryThis(), 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap: Create new Benevity import - https://phabricator.wikimedia.org/T359219#10626060 (10AKanji-WMF) [20:07:40] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog: 2nd Recurring Failure Email in Civi - https://phabricator.wikimedia.org/T365488#10626059 (10AKanji-WMF) [20:07:44] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 06Fundraising-Tech-Roadmap, 13Patch-For-Review: Apple Pay enablement across all browsers - https://phabricator.wikimedia.org/T382279#10626058 (10AKanji-WMF) [20:07:48] 14Fundraising Sprint: Abula, 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 07FR-Imports, 07Unplanned-Sprint-Work: Checking for code bottlenecks to improve speed of imports - https://phabricator.wikimedia.org/T376337#10626063 (10AKanji-WMF) [20:07:52] 14Fundraising Sprint: Abula, 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog: Duplicates after import - https://phabricator.wikimedia.org/T382516#10626062 (10AKanji-WMF) [20:07:56] 14Fundraising Sprint: Abula, 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 2 others: Move wmf_civicrm module into wmf-civicrm extension - https://phabricator.wikimedia.org/T270677#10626061 (10AKanji-WMF) [20:08:59] cstone: I'm going to deploy your gravy paypal redirect patch [20:09:10] okie [20:09:49] (03CR) 10Ejegg: Update composer.lock with upgraded libraries [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1126626 (owner: 10Ejegg) [20:09:55] (03CR) 10Ejegg: [C:03+2] "recheck" [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1126626 (owner: 10Ejegg) [20:10:09] im gona be afk for like 20 mins but ill be back [20:10:28] ah ok, i seem to be banned from the bastion in any case [20:10:49] ejegg: did you see releng response - starts with "hi, you did send the patch for review and then 1H10 later went to do a git push of that sam" [20:11:29] oh i missed that eileen - on gerrit, phab, or on email? [20:11:36] or IRC? [20:11:37] irc - [20:11:39] lol [20:13:07] just read it. I guess that makes sense, so the push is only blocked if it's making a new patch [20:16:54] (03CR) 10Jforrester: "Thanks!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1056171 (https://phabricator.wikimedia.org/T341779) (owner: 10Jforrester) [20:17:14] (03PS4) 10Umherirrender: Replace call_user_func with dynamic function call [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1115946 [20:19:48] ejegg: yeah but I think he is offering us to change it? [20:20:18] also - it DID push in another patch when I did the push - it was a whatever patch but it didn't show up in gerrit [20:22:08] (03Merged) 10jenkins-bot: Update composer.lock with upgraded libraries [core] (fundraising/REL1_43) - 10https://gerrit.wikimedia.org/r/1126626 (owner: 10Ejegg) [20:32:08] eileen: right, I think we can change that permission here: https://gerrit.wikimedia.org/r/admin/repos/wikimedia/fundraising/crm,general [20:32:27] or rather here: https://gerrit.wikimedia.org/r/admin/repos/wikimedia/fundraising/crm,access [20:33:07] I see "Reject implicit merges when changes are pushed for review" [20:34:47] I think we should change it - I feel *sure* I have not been able to push in the past [20:35:06] RECOVERY - check_dagster on fran2001 is OK: PROCS OK: 1 process with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [20:35:25] oooh is that a new style failmaill [20:35:42] bah im time travelling [20:40:46] cstone: yep, it's the monolog one [20:41:04] unfortunately it means we're getting the removed messages in triplicate now :P [20:41:30] eileen: I think we just want to deny 'push' permission [20:42:39] surely we are only doing duplicate - but I'm looking at that [20:42:52] I'm good with denying the push permission! I can't believe it wasn't [20:45:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [20:48:46] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising-Backlog: Stop supporting iDEAL 1.0 in Adyen code - https://phabricator.wikimedia.org/T387738#10626271 (10Ejegg) [20:49:45] 06Fundraising-Backlog: FailMail: Duplicate contribution errors during audit run - https://phabricator.wikimedia.org/T266124#10626281 (10Eileenmcnaughton) 05Open→03Declined This is too old to follow up on [20:50:08] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [20:54:18] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Restore automatic handling of DUPLICATE_INVOICE WmfExceptions - https://phabricator.wikimedia.org/T366635#10626293 (10Eileenmcnaughton) I just hit this but the issue is the trxn_id NOT the invoice ID is duplicated https... [20:55:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [20:58:49] (03PS1) 10Ejegg: Update a couple comments about iDEAL [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1126656 (https://phabricator.wikimedia.org/T387738) [21:00:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:05:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:10:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:11:38] 10fundraising-tech-ops, 10BDC-Implementation: Install Polars Python package - https://phabricator.wikimedia.org/T388436#10626413 (10Jgreen) 05Open→03Resolved p:05Triage→03Medium done! [21:11:52] (03PS1) 10Ejegg: WIP Use SmashPig PaymentMethod constants in Adyen code [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1126658 [21:13:23] (03CR) 10CI reject: [V:04-1] WIP Use SmashPig PaymentMethod constants in Adyen code [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/1126658 (owner: 10Ejegg) [21:14:47] ok eileen, i've just set it to disallow push to the CRM repo [21:15:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:20:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:25:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:30:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:35:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:40:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:45:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:50:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [21:55:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [22:00:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 2 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [22:00:09] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Restore automatic handling of DUPLICATE_INVOICE WmfExceptions - https://phabricator.wikimedia.org/T366635#10626612 (10Eileenmcnaughton) Just noting the issue with the above one ^^ is that there is a data issue ie origin... [22:05:06] PROBLEM - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 3 processes with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [22:08:57] ACKNOWLEDGEMENT - check_dagster on fran2001 is CRITICAL: PROCS CRITICAL: 3 processes with args python /srv/dagster/bin/dagster Dwisehaupt known - testing. https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [22:28:41] !log payments-wiki upgraded from 6409fffa to 3d4dfab3 [22:28:42] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [22:44:13] 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10MediaWiki-extensions-DonationInterface, 10MW-1.44-notes (1.44.0-wmf.21; 2025-03-18): Incorrect amount formatting on paymentswiki with uselang=es-419 - https://phabricator.wikimedia.org/T387137#10626748 (10Ejegg) OK, this fix is deployed [23:08:19] (03PS2) 10Ejegg: Update a couple comments about iDEAL [wikimedia/fundraising/SmashPig] - 10https://gerrit.wikimedia.org/r/1126656 (https://phabricator.wikimedia.org/T387738) [23:24:04] (03PS1) 10Ejegg: Remove name + email from paypal test link [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1126679 (https://phabricator.wikimedia.org/T385738) [23:24:29] (03CR) 10Wfan: [C:03+2] Remove name + email from paypal test link [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1126679 (https://phabricator.wikimedia.org/T385738) (owner: 10Ejegg) [23:24:40] (03CR) 10Cstone: [C:03+2] Remove name + email from paypal test link [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1126679 (https://phabricator.wikimedia.org/T385738) (owner: 10Ejegg) [23:24:43] (03CR) 10Cstone: [V:03+2 C:03+2] Remove name + email from paypal test link [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/1126679 (https://phabricator.wikimedia.org/T385738) (owner: 10Ejegg) [23:48:07] 03Fundraising Sprint: Elephant Toothpaste, 06Fundraising Tech - Chaos Crew, 06Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Restore automatic handling of DUPLICATE_INVOICE WmfExceptions - https://phabricator.wikimedia.org/T366635#10626856 (10Eileenmcnaughton) [23:50:06] RECOVERY - check_dagster on fran2001 is OK: PROCS OK: 1 process with args python /srv/dagster/bin/dagster https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=fran2001&service=check_dagster [23:54:19] (03PS1) 10Eileen: Fix deprecations [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126684 [23:54:19] (03PS1) 10Eileen: Remove duplicate duplicate check [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/1126685