[00:13:22] <wikibugs>	 10Fundraising Sprint Visual C Saw, 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Universal Cereal Bus, and 4 others: Deal with EOY emails that did NOT go out - https://phabricator.wikimedia.org/T299011 (10Eileenmcnaughton)
[00:19:08] <cstone>	 ejegg: its already there just commented out I must have failed at searching
[00:33:56] <wikibugs>	 10Fundraising-Backlog, 10Analytics-EventLogging, 10Analytics-Kanban, 10Data-Engineering, and 3 others: Determine which remaining legacy EventLogging schemas need to be migrated or decommissioned - https://phabricator.wikimedia.org/T282131 (10odimitrijevic)
[02:57:16] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Wireless Zipline, 10fundraising sprint Yeet-coaster, 10fr-donorservices: Add a second layer of confirmation to the batch merge deduper button - https://phabricator.wikimedia.org/T296042 (10Eileenmcnaughton) 05Open→...
[02:57:23] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Wireless Zipline, 10fundraising sprint Yeet-coaster, 10fr-donorservices: Add a second layer of confirmation to the batch merge deduper button - https://phabricator.wikimedia.org/T296042 (10Eileenmcnaughton)
[02:58:58] <wikibugs>	 (03PS1) 10Ejegg: Move Monthly Convert ask rules to config [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/753201 (https://phabricator.wikimedia.org/T283834)
[03:01:22] <wikibugs>	 (03CR) 10jerkins-bot: [V: 04-1] Move Monthly Convert ask rules to config [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/753201 (https://phabricator.wikimedia.org/T283834) (owner: 10Ejegg)
[03:08:04] <wikibugs>	 (03PS2) 10Ejegg: Move Monthly Convert ask rules to config [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/753201 (https://phabricator.wikimedia.org/T283834)
[03:25:27] <wikibugs>	 10Fundraising-Backlog, 10fr-donorservices: EOY possible code related issue - https://phabricator.wikimedia.org/T298925 (10Eileenmcnaughton) @SHust @krobinson  - this is a deliberate feature. The emails go out with all donations in Hawaii time. This was a change made in previous years because of the problem of...
[03:48:49] <wikibugs>	 10Fundraising Sprint Visual C Saw, 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, and 3 others: Question about blocked contacts in Civi and how they sync to Acoustic - https://phabricator.wikimedia.org/T293587 (10Eileenmcnaughton) @nisrael - I used the a...
[08:41:49] <wikibugs>	 10Fundraising Sprint Visual C Saw, 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Universal Cereal Bus, and 4 others: Deal with EOY emails that did NOT go out - https://phabricator.wikimedia.org/T299011 (10krobinson) Thanks Eileen!   @KHaggard - adding you as the PM...
[13:32:17] <icinga-wm>	 PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1002:down https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1001&service=check_kafkatee
[13:37:17] <icinga-wm>	 RECOVERY - check_kafkatee on frban1001 is OK: OK: brokers:9 topics:1 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1001&service=check_kafkatee
[13:47:17] <icinga-wm>	 PROBLEM - check_kafkatee on frban1001 is CRITICAL: CRITICAL: kafka-jumbo1001:down https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1001&service=check_kafkatee
[13:52:17] <icinga-wm>	 RECOVERY - check_kafkatee on frban1001 is OK: OK: brokers:9 topics:1 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frban1001&service=check_kafkatee
[13:52:17] <icinga-wm>	 PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 14602 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1002&service=check_mysql
[13:57:13] <icinga-wm>	 PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 14902 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1002&service=check_mysql
[14:02:17] <icinga-wm>	 PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 15202 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1002&service=check_mysql
[14:07:17] <icinga-wm>	 PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 15503 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1002&service=check_mysql
[14:12:17] <icinga-wm>	 PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 15448 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1002&service=check_mysql
[14:17:17] <icinga-wm>	 PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 11644 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1002&service=check_mysql
[14:22:15] <icinga-wm>	 PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 7280 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1002&service=check_mysql
[14:24:47] <icinga-wm>	 ACKNOWLEDGEMENT - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 7280 Jeff_Green yes https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1002&service=check_mysql
[14:32:17] <icinga-wm>	 RECOVERY - check_mysql on frdb1002 is OK: Uptime: 4984138 Threads: 18 Questions: 577645452 Slow queries: 2803 Opens: 3081952755 Flush tables: 1 Open tables: 200 Queries per second avg: 115.896 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frdb1002&service=check_mysql
[15:41:41] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Wireless Zipline, 10fundraising sprint Yeet-coaster: Orphan Slayer deep dive documentation - https://phabricator.wikimedia.org/T295926 (10jgleeson)
[15:56:00] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Wireless Zipline, 10fundraising sprint Yeet-coaster: Orphan Slayer deep dive documentation - https://phabricator.wikimedia.org/T295926 (10jgleeson) I've updated the diagram [[ https://gitlab.wikimedia.org/jgleeson/fr-te...
[16:10:27] <wikibugs>	 10Fundraising-Backlog, 10fr-donorservices: EOY possible code related issue - https://phabricator.wikimedia.org/T298925 (10DStrine) Thanks @Eileenmcnaughton   DR: this sounds like a small edge case. I feel like this can be solved in messaging these donors. Let me know what you think.
[16:21:58] <wikibugs>	 10fundraising-tech-ops: install/configure frauth1002 - https://phabricator.wikimedia.org/T299068 (10Jgreen)
[16:24:19] <wikibugs>	 10fundraising-tech-ops: install/configure civi1002 - https://phabricator.wikimedia.org/T296409 (10Jgreen)
[16:24:21] <wikibugs>	 10fundraising-tech-ops: Fundraising environment support for Debian 11 (Bullseye) - https://phabricator.wikimedia.org/T277184 (10Jgreen)
[16:24:50] <wikibugs>	 10fundraising-tech-ops: install/configure frauth1002 - https://phabricator.wikimedia.org/T299068 (10Jgreen)
[16:24:52] <wikibugs>	 10fundraising-tech-ops: Fundraising environment support for Debian 11 (Bullseye) - https://phabricator.wikimedia.org/T277184 (10Jgreen)
[16:26:54] <wikibugs>	 (03PS1) 10Jgleeson: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/753508
[16:27:14] <wikibugs>	 10fundraising-tech-ops: install/configure civi1002 - https://phabricator.wikimedia.org/T296409 (10Jgreen)
[16:27:42] <wikibugs>	 10fundraising-tech-ops: install/configure frauth1002 - https://phabricator.wikimedia.org/T299068 (10Jgreen)
[16:27:53] <wikibugs>	 (03PS1) 10Jgleeson: Update DonationInterface submodule [core] (fundraising/REL1_35) - 10https://gerrit.wikimedia.org/r/753509
[16:30:19] <wikibugs>	 10fundraising-tech-ops: install/configure frpm1002 - https://phabricator.wikimedia.org/T299069 (10Jgreen)
[16:30:30] <wikibugs>	 10fundraising-tech-ops: install/configure frpm1002 - https://phabricator.wikimedia.org/T299069 (10Jgreen)
[16:30:32] <wikibugs>	 10fundraising-tech-ops: Fundraising environment support for Debian 11 (Bullseye) - https://phabricator.wikimedia.org/T277184 (10Jgreen)
[16:30:53] <wikibugs>	 10fundraising-tech-ops: install/configure frpm1002 - https://phabricator.wikimedia.org/T299069 (10Jgreen) p:05Triage→03Medium
[16:36:36] <wikibugs>	 (03CR) 10Jgleeson: [C: 03+2] Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/753508 (owner: 10Jgleeson)
[16:40:13] <wikibugs>	 (03Merged) 10jenkins-bot: Merge branch 'master' into deployment [extensions/DonationInterface] (deployment) - 10https://gerrit.wikimedia.org/r/753508 (owner: 10Jgleeson)
[16:47:22] <wikibugs>	 (03CR) 10Jgleeson: [C: 03+2] Update DonationInterface submodule [core] (fundraising/REL1_35) - 10https://gerrit.wikimedia.org/r/753509 (owner: 10Jgleeson)
[16:57:03] <wikibugs>	 (03Merged) 10jenkins-bot: Update DonationInterface submodule [core] (fundraising/REL1_35) - 10https://gerrit.wikimedia.org/r/753509 (owner: 10Jgleeson)
[17:06:00] <wikibugs>	 10Fundraising-Backlog, 10fr-donorservices: EOY possible code related issue - https://phabricator.wikimedia.org/T298925 (10krobinson) Yes agreed! We were just worried it was a bug. I think we can explain this away, and if it's only in the summary, we're good!
[18:08:29] <wikibugs>	 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising sprint Yeet-coaster, 10FR-AutoTY-Email, and 3 others: implement Italy email the old school way ... this one last time - https://phabricator.wikimedia.org/T298908 (10Cstone) @CDenes_WMF The recurring notification is on staging to test.
[20:00:53] <wikibugs>	 10Fundraising-Backlog: fill out PCI forms for this year - https://phabricator.wikimedia.org/T299089 (10DStrine)
[20:19:20] <jgleeson>	 !log updated payments from 939cb4bc to 8497eae9
[20:19:22] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log
[20:23:40] <jgleeson>	 fr-tech I just pushed out the stuff in this patch https://gerrit.wikimedia.org/r/c/mediawiki/extensions/DonationInterface/+/753508. there's a few that aren't mine but they all look familiar and I don't see anything we'd wanna hold back. 
[20:25:09] <jgleeson>	 damilare: not sure if you're still on but it might be worth dropping a link on the PIX ticket for the guy who has been following it closely as that change is also live! 
[20:26:04] <damilare>	 Hi jgleeson, sure would do after testing it out
[20:26:07] <damilare>	 Thank you
[20:26:12] <jgleeson>	 np
[20:31:51] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Yeet-coaster, 10FR-LATAM, 10MW-1.38-notes (1.38.0-wmf.18; 2022-01-17): Adding PIX as a payment type for Brazil - https://phabricator.wikimedia.org/T280303 (10Damilare) Donors from Brazil now have the option to donate...
[20:47:23] <wikibugs>	 10Fundraising Sprint Visual C Saw, 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Universal Cereal Bus, and 4 others: Deal with EOY emails that did NOT go out - https://phabricator.wikimedia.org/T299011 (10jgleeson) Thanks for this comprehensive follow-up! It's grea...
[20:49:38] <jgleeson>	 I'm calling it a day. Have a good one fr-tech and bye for now!
[21:00:45] <wikibugs>	 10Fundraising-Backlog, 10fr-donorservices: Civi "thank you letter summary" feature request - https://phabricator.wikimedia.org/T299096 (10SHust)
[21:12:05] <wikibugs>	 10Fundraising Sprint Visual C Saw, 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Universal Cereal Bus, and 4 others: Deal with EOY emails that did NOT go out - https://phabricator.wikimedia.org/T299011 (10Eileenmcnaughton) @jgleeson I already fixed all the things t...
[21:30:43] <wikibugs>	 10Fundraising Sprint Visual C Saw, 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Universal Cereal Bus, and 4 others: Deal with EOY emails that did NOT go out - https://phabricator.wikimedia.org/T299011 (10KHaggard) Thanks for looping me in @krobinson ! And thanks @...
[21:33:42] <wikibugs>	 10Fundraising-Backlog, 10FR-Adyen, 10MediaWiki-extensions-DonationInterface, 10Recurring-Donations: Allow rendering MC modal outside of ResultSwitcher - https://phabricator.wikimedia.org/T299100 (10Ejegg)
[21:34:33] <wikibugs>	 10Fundraising-Backlog, 10FR-Adyen: EPIC: Monthly convert for Adyen - https://phabricator.wikimedia.org/T290338 (10Ejegg)
[21:34:35] <wikibugs>	 10Fundraising-Backlog, 10FR-Adyen, 10MediaWiki-extensions-DonationInterface, 10Recurring-Donations: Allow rendering MC modal outside of ResultSwitcher - https://phabricator.wikimedia.org/T299100 (10Ejegg)
[21:34:38] <eileen>	 dwisehaupt: it's probably worth scheduling the upgrade for when you are around (or Jeff_Green ) in case - does Monday evening next week work?
[21:36:20] <dwisehaupt>	 hmmmm... possibly
[21:36:50] <eileen>	 dwisehaupt: is there a better day?
[21:37:47] <dwisehaupt>	 even just tuesday would probably work.
[21:46:44] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Yeet-coaster, 10FR-LATAM, 10MW-1.38-notes (1.38.0-wmf.18; 2022-01-17): Adding PIX as a payment type for Brazil - https://phabricator.wikimedia.org/T280303 (10EMartin) Damilare,  this is great news!!  Many thanks.  We...
[21:54:13] <wikibugs>	 10Fundraising-Backlog, 10FR-Adyen, 10MediaWiki-extensions-DonationInterface, 10Recurring-Donations: Allow rendering MC modal outside of ResultSwitcher - https://phabricator.wikimedia.org/T299100 (10Ejegg)
[22:21:05] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Yeet-coaster, 10FR-LATAM, 10MW-1.38-notes (1.38.0-wmf.18; 2022-01-17): Adding PIX as a payment type for Brazil - https://phabricator.wikimedia.org/T280303 (10Albertoleoncio) > There has been an error processing your r...
[22:55:29] <wikibugs>	 10Fundraising-Backlog, 10FR-Italy: Deploy Donation Interface Translations before Jan 21 - https://phabricator.wikimedia.org/T299105 (10HNordeenWMF)
[23:00:43] <eileen>	 dwisehaupt: OK so https://www.timeanddate.com/worldclock/meetingdetails.html?year=2022&month=1&day=18&hour=23&min=0&sec=0&p1=2099&p2=179&p3=224&p4=125&p5=136&p6=248&p7=47&p8=141
[23:07:42] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Yeet-coaster, 10FR-LATAM, 10MW-1.38-notes (1.38.0-wmf.18; 2022-01-17): Adding PIX as a payment type for Brazil - https://phabricator.wikimedia.org/T280303 (10EMartin) Thank you, Alberto, for proactively testing!  We'l...
[23:11:01] <eileen>	 Based on responses on the EOY email phab I think it's probably closable once https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/753181 is deployed (then they can at least see them)
[23:11:19] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Yeet-coaster, 10FR-LATAM, 10MW-1.38-notes (1.38.0-wmf.18; 2022-01-17): Adding PIX as a payment type for Brazil - https://phabricator.wikimedia.org/T280303 (10EMartin) @Damilare I don't see the transaction made it to D...
[23:30:44] <dwisehaupt>	 eileen: that looks good to me.
[23:43:17] <wikibugs>	 10Fundraising Sprint Xenomorph Petting Zoo, 10Fundraising-Backlog, 10fundraising sprint Yeet-coaster, 10FR-LATAM, 10MW-1.38-notes (1.38.0-wmf.18; 2022-01-17): Adding PIX as a payment type for Brazil - https://phabricator.wikimedia.org/T280303 (10Chicocvenancio) @EMartin its before we actually make the tr...