[00:00:31] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3843 [00:01:19] lemme see if I can ack that [00:02:31] PROBLEM - check_mysql on frdb2001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3960 [00:02:35] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 3965 [00:02:54] nope, looks like i'm not authorized to ack those [00:03:05] (03PS1) 10Eileen: Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 [00:03:29] dang not having CI - normally I'd let CI do the first proofread [00:03:52] yeah, that is a bother [00:03:54] ah well I'll do some more QA myself but it's visible now [00:04:29] ejegg: the proposal to check out our own buildkit in populate-dbs.sh seems good tho [00:04:42] right, you have a patch for that? [00:04:44] ie we still have the ability to change the repo if we want [00:04:52] yeah, seems fine to me [00:04:58] well I put one up but it was just 'how about like this' [00:05:21] ie buildkit is https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/724358 [00:05:35] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4143 [00:05:49] cool cool. so we could actually tell it to check out in the same place that the current docker image expects it [00:06:06] and get our problem solved ourselves? [00:06:31] PROBLEM - check_mysql on frdb2002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4202 [00:07:00] (03CR) 10jerkins-bot: [V: 04-1] Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 (owner: 10Eileen) [00:07:31] PROBLEM - check_mysql on frdb2001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4260 [00:07:35] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4265 [00:07:57] i've gotta help a bit with dinner - is the db ready for those trigger updates right now? [00:08:20] oic that's just the code to generate them [00:09:55] ejegg: yeah - it still needs a bit more work at my end [00:10:15] maybe ready in half an hour or so [00:10:35] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4443 [00:11:31] PROBLEM - check_mysql on frdb2002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4502 [00:12:31] PROBLEM - check_mysql on frdb2001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4560 [00:12:35] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4565 [00:13:09] back [00:13:30] dwisehaupt: cool - I haven't checked on the query cos I'm still trying to sort triggers out [00:13:38] judging by the replication lag, looks like the query finished. [00:13:58] i'll ack those alerts. [00:15:35] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4744 [00:15:50] ACKNOWLEDGEMENT - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4565 Dwisehaupt known - replication lag after alters. [00:15:50] ACKNOWLEDGEMENT - check_mysql on frdb2001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4560 Dwisehaupt known - replication lag after alters. [00:15:50] ACKNOWLEDGEMENT - check_mysql on frdb2002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4502 Dwisehaupt known - replication lag after alters. [00:15:50] ACKNOWLEDGEMENT - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4744 Dwisehaupt known - replication lag after alters. [00:17:01] :-) [00:18:12] (03PS2) 10Eileen: Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 [00:20:28] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/724543 [00:20:55] (03CR) 10Eileen: [C: 03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/724543 (owner: 10Eileen) [00:21:43] (03CR) 10jerkins-bot: [V: 04-1] Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 (owner: 10Eileen) [00:25:52] (03PS3) 10Eileen: Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 [00:31:04] (03CR) 10jerkins-bot: [V: 04-1] Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 (owner: 10Eileen) [00:40:36] RECOVERY - check_mysql on frdev1001 is OK: Uptime: 124992 Threads: 14 Questions: 1515330 Slow queries: 101604 Opens: 10420000 Flush tables: 1 Open tables: 200 Queries per second avg: 12.123 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [00:42:30] RECOVERY - check_mysql on frdb2001 is OK: Uptime: 2788706 Threads: 11 Questions: 164316071 Slow queries: 1315 Opens: 3207 Flush tables: 1 Open tables: 1033 Queries per second avg: 58.921 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [00:42:36] RECOVERY - check_mysql on frdb1002 is OK: Uptime: 2515154 Threads: 11 Questions: 156220432 Slow queries: 1271 Opens: 633487316 Flush tables: 1 Open tables: 200 Queries per second avg: 62.111 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [00:44:37] (03PS4) 10Eileen: Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 [00:46:30] RECOVERY - check_mysql on frdb2002 is OK: Uptime: 2855309 Threads: 12 Questions: 165181086 Slow queries: 1371 Opens: 3001 Flush tables: 1 Open tables: 974 Queries per second avg: 57.850 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [00:49:53] (03CR) 10jerkins-bot: [V: 04-1] Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 (owner: 10Eileen) [00:50:54] (03PS5) 10Eileen: Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 [00:52:20] !log civicrm revision changed from a1929b3dfd to a480bf03c9, config revision is 77cb7ec866 [00:52:26] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [00:56:36] (03CR) 10jerkins-bot: [V: 04-1] Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 (owner: 10Eileen) [01:12:41] replication is all caught up except frdb1003 but this is not unexpected due to cube runs that happen. [01:12:54] i'm still around but going to be starting to make dinner and checking in occasionally. [01:15:22] (03PS6) 10Eileen: Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 [01:15:59] thanks dwisehaupt cstone ejegg - I'm nearly review ready on the triggers if one of you can look in a bit so we can load after dinner ^^ [01:20:32] (03CR) 10jerkins-bot: [V: 04-1] Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 (owner: 10Eileen) [01:21:29] (03PS1) 10Eileen: Fix default in local dev setup [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724567 [01:26:52] (03CR) 10jerkins-bot: [V: 04-1] Fix default in local dev setup [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724567 (owner: 10Eileen) [01:32:15] (03PS7) 10Eileen: Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 [01:32:38] ok I'm happy with that sql now - it needs some else to check... [01:34:31] hi eileen i'm back at the keyboard now [01:35:29] huh, DEFINER= syntax on trigger [01:36:15] (03CR) 10Ejegg: [V: 03+2 C: 03+2] Fix default in local dev setup [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724567 (owner: 10Eileen) [01:37:24] (03CR) 10jerkins-bot: [V: 04-1] Update triggers for new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 (owner: 10Eileen) [01:40:45] ejegg: hmm - that's from my local - not sure if is is local-specific [01:41:33] I'm finding the labels really confusing - ie 'Last donation date' is endowment ex [01:42:15] but we can see if Nora wants to change labels - I feel like she can negotiate the UI with people [01:59:37] oh weird, that definitely should be made more rational [02:08:39] yeah - it can be altered by a user though [02:08:55] so we don't need to decide [02:15:28] ejegg: are you checking that trigger patch at the moment? [02:15:44] yep, just applying them now [02:15:58] after taking a while remembering how to dump them [02:16:11] system.flush triggers=1 didn't seem to output anything [02:20:31] yeah - I normally resort to turning logging off & on [02:21:24] oh shoot, those change columns are double - should probably be decimal like the other money ones [02:21:32] but it's a bit late to realize that :( [02:27:31] ejegg: as in the new fieldss - I guess we can change - I wonder how long an alter would take? [02:28:04] dwisehaupt: any idea how long it would take to alter a bunch of double columns to decimal on the wmf_donor table? [02:28:44] eileen: well, i wonder if folks are going to display them very often [02:28:58] seems like maybe more likely used in where clauses [02:30:03] ejegg: so we should get those triggers merged & then dwisehaupt can load them when he is back - but it would be 40mins at the high end since that's how long it took to add them :-) [02:30:17] oh cool [02:30:37] we might be able to get that done before we see Dallas [02:31:47] howdy. [02:31:52] just popped back in. [02:32:10] hmmm... [02:32:37] (03PS1) 10Eileen: Change field data type to Money [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724573 [02:32:41] well, that trigger patch looks good anyway [02:33:36] yeah. i was going to say somewhere in the 35min - 45min range. but that's just a guess. [02:33:42] (03CR) 10Ejegg: [V: 03+2 C: 03+2] "Looks good to me, seems to calculate good values locally" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724539 (owner: 10Eileen) [02:34:21] (03CR) 10Ejegg: [V: 03+2 C: 03+2] "Thanks! I like the consistency." [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724573 (owner: 10Eileen) [02:35:08] the triggers are currently off and we are in maint mode. so now would be a decent time to alter if we wanted. [02:35:26] or we could wrap up these triggers tonight, and then do the alter tomorrow. [02:36:06] ejegg: i know you have some work you want to do also, so i want to make sure we get that in too. [02:36:17] and it's getting late where you are. [02:36:34] dwisehaupt: that can potentially wait for a while, our code can deal with old + new token formats for now [02:36:48] and I do need to sign off now-ish to sleep [02:37:04] good luck dwisehaupt and eileen [02:37:12] the way i see it, we have at least one more good day where we can do heavy lifting. we could do stuff on thursday also. [02:37:36] g'night. [02:37:43] dwisehaupt: I have the alter pretty close - so if you are comfortable updating we can do that - or leave to tomorrow [02:38:26] i'm comfortable either way. there isn't much for me to do aside from monitor and take care of alerts and such. :) [02:38:54] if we don't do it now, i would opt to do it earlier tomorrow, aka when you are first available. [02:40:11] (03PS1) 10Eileen: Fix field type on money fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724574 [02:40:32] dwisehaupt: that's the sql ^^ https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/724574 [02:42:12] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/724575 [02:42:24] (03CR) 10Eileen: [C: 03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/724575 (owner: 10Eileen) [02:43:02] that would be a big donation. :) [02:43:10] 20,2 that is. [02:43:40] looks good to me. [02:44:01] lol [02:44:36] if you want to run it + 2 & maybe paste in yourself - I have o go offline for 15 [02:45:12] (03CR) 10jerkins-bot: [V: 04-1] Fix field type on money fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724574 (owner: 10Eileen) [02:45:45] (03CR) 10Dwisehaupt: [C: 03+2] "Looks good to me. I await the donation that overruns the 20,2 field. 😊" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724574 (owner: 10Eileen) [02:50:24] query running and downtime set. [02:51:11] (03CR) 10jerkins-bot: [V: 04-1] Fix field type on money fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724574 (owner: 10Eileen) [02:56:43] back now [02:57:30] (03CR) 10Eileen: [V: 03+2] Fix field type on money fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724574 (owner: 10Eileen) [02:59:00] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/724578 [02:59:13] (03CR) 10Eileen: [C: 03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/724578 (owner: 10Eileen) [03:00:35] !log civicrm revision changed from a480bf03c9 to 1b7bae4033, config revision is 77cb7ec866 [03:00:39] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [03:01:07] !log civicrm revision changed from 1b7bae4033 to a0bc324a61, config revision is 77cb7ec866 [03:01:11] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [03:04:40] dwisehaupt: I just checked & didn't see the query so I called the upgrade - which would be a null op if it had already run - but it doesn't seem to have the speed of a null op [03:05:08] the query is still running. 33.7% of stage done it says. [03:05:28] ok - so I had better kill the other - or it's just hung waiting to do a null op? [03:05:49] let me see what i can see. [03:06:33] your's is: Waiting for table metadata lock [03:07:21] patient! [03:07:48] you can kill your query off if you want. [03:08:28] (03PS1) 10Eileen: Update triggers with new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724579 [03:08:40] yeah - do you want to +2 the trigger updates ^^ [03:12:55] that's a wall of text. :) [03:13:10] (03CR) 10Dwisehaupt: [C: 03+2] Update triggers with new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724579 (owner: 10Eileen) [03:13:17] yeah - it's kinda proforma I think since ejegg|away approved the generation [03:13:36] dwisehaupt: I haven't killed it - because if it IS a null op then when it runs it will also mark the db as upgraded - but if it isn't instant when it gets it's turn I'll kill it [03:13:41] (03CR) 10jerkins-bot: [V: 04-1] Update triggers with new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724579 (owner: 10Eileen) [03:13:55] sounds good. [03:14:00] (03CR) 10Eileen: [V: 03+2] Update triggers with new fields [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724579 (owner: 10Eileen) [03:15:38] (03PS1) 10Eileen: Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/724581 [03:15:53] (03CR) 10Eileen: [C: 03+2] Merge branch 'master' of https://gerrit.wikimedia.org/r/wikimedia/fundraising/crm into deployment [wikimedia/fundraising/crm] (deployment) - 10https://gerrit.wikimedia.org/r/724581 (owner: 10Eileen) [03:18:08] !log civicrm revision changed from a0bc324a61 to 2ecb8f0bcd, config revision is 77cb7ec866 [03:18:13] Logged the message at https://wikitech.wikimedia.org/wiki/Server_Admin_Log [03:18:56] dwisehaupt: ok updated triggers now in the 'normal place' drupal/sites/all/modules/wmf_civicrm/scripts/triggers.mysql [03:19:21] ok. i'll start pulling them around for application. [03:20:31] ok - in 10 minutes I'll have to go offline for 15 minutes (I'm currently sitting in the car outside Luke's piano lesson) [03:20:47] heh. it's piano day apparently. [03:21:09] the alter is only 65% done, so we have time. [03:22:38] cool [03:24:07] if you told my 30 year old self that I would be sitting outside my kids piano lesson while deploying code on the other side of the world with a colleague on the other side of that country from the server over my mobile phone connection - which bit would have surprised me? I suspect I would have told you I was never gonna have kids [03:35:32] dwisehaupt: just doing the return chauffeur leg now - talk to you in t15 [03:38:53] ok. query complete. 4.2 secs short of 50mins [03:56:02] back [03:56:44] cool. query is all done. anything else you want to do before applying the triggers? [03:59:21] nope [03:59:31] ok. i'll apply them now. [04:00:44] (03PS1) 10Eileen: Update custom field table to reflect field updates. [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724582 (https://phabricator.wikimedia.org/T288721) [04:00:44] yay [04:02:09] when you send out an email you should probably mention that new fields have been added on request of Erin to track details such as 'All funds number of donations' to augment the existing 'Endowment number of donations' and 'number donations' (non endowment) [04:02:31] ok. triggers applied and diff looks as crazy as expected. :) [04:05:35] (03CR) 10jerkins-bot: [V: 04-1] Update custom field table to reflect field updates. [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724582 (https://phabricator.wikimedia.org/T288721) (owner: 10Eileen) [04:05:36] guess we're ready to start the queues and pull us out of maint mode. any last thing to check before i do so? [04:07:27] I think we are good [04:09:12] ok. puppet run done on civi [04:11:19] cool I can go back to ignoring my children [04:15:27] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint NULL calorie food cart, 10fundraising sprint Parallel processing roller coaster, and 5 others: Create new WMF donor fields - https://phabricator.wikimedia.org/T288721 (10Eileenmcnaughton) These fields have been created now. I note... [04:16:02] dwisehaupt: are queues running yet? [04:17:17] yes. they should be. [04:17:23] (03Abandoned) 10Eileen: Remove events in cart triggers - so we can remove the coupon_code [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724522 (owner: 10Eileen) [04:17:25] checking graphs. [04:18:17] (03Abandoned) 10Eileen: see if order matters [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724214 (owner: 10Eileen) [04:18:22] yeah. i see she queues are clearing. [04:18:45] (03Abandoned) 10Eileen: Trigger updates [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/720909 (https://phabricator.wikimedia.org/T288721) (owner: 10Eileen) [04:31:05] yay [04:50:30] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4357 [04:52:36] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4479 [04:55:36] PROBLEM - check_mysql on frdev1001 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 2634 [04:57:36] PROBLEM - check_mysql on frdb1002 is CRITICAL: SLOW_SLAVE CRITICAL: Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 4779 [05:00:36] RECOVERY - check_mysql on frdev1001 is OK: Uptime: 140593 Threads: 14 Questions: 1672484 Slow queries: 114315 Opens: 11502095 Flush tables: 1 Open tables: 200 Queries per second avg: 11.895 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [05:07:36] RECOVERY - check_mysql on frdb1002 is OK: Uptime: 2531054 Threads: 11 Questions: 156372508 Slow queries: 1272 Opens: 634265027 Flush tables: 1 Open tables: 200 Queries per second avg: 61.781 Slave IO: Yes Slave SQL: Yes Seconds Behind Master: 0 [11:45:49] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10fundraising Sprint NULL calorie food cart, 10fundraising sprint Parallel processing roller coaster, and 5 others: Create new WMF donor fields - https://phabricator.wikimedia.org/T288721 (10EYener) Thanks, @Eileenmcnaughton this is great! I'm seeing... [13:29:55] (03CR) 10Jgleeson: "I think I must have had this applied when testing? lemme test it again WITHOUT this patch to confirm this fixes something :)" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/719681 (https://phabricator.wikimedia.org/T290106) (owner: 10Cstone) [13:33:33] heading out to pickup Oscar, back soon! [15:22:54] 10fundraising-tech-ops: frdb2003: configure RAID, install OS, and add to fr-analytics db replication - https://phabricator.wikimedia.org/T290484 (10Jgreen) [15:27:51] (03CR) 10Jgleeson: [C: 03+2] "Looks good to me! Tested it locally with Dami and can see 'Recurring processing model: Subscription' in the Adyen console vs the previous " [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/719681 (https://phabricator.wikimedia.org/T290106) (owner: 10Cstone) [15:30:47] (03Merged) 10jenkins-bot: Add payment_method to authorize request [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/719681 (https://phabricator.wikimedia.org/T290106) (owner: 10Cstone) [15:31:10] 10fundraising-tech-ops, 10DC-Ops, 10SRE, 10ops-codfw: (Need By: TBD) rack/setup/install frdb2003.frack.codfw.wmnet - https://phabricator.wikimedia.org/T281177 (10Jgreen) [15:31:20] 10fundraising-tech-ops: [FR Analytics]: Cross-site redundancy for fundraising analytics platform - https://phabricator.wikimedia.org/T277884 (10Jgreen) [15:31:22] 10fundraising-tech-ops, 10Patch-For-Review: frdb2003: configure RAID, install OS, and add to fr-analytics db replication - https://phabricator.wikimedia.org/T290484 (10Jgreen) [15:31:38] 10fundraising-tech-ops, 10Patch-For-Review: frdb2003: configure RAID, install OS, and add to fr-analytics db replication - https://phabricator.wikimedia.org/T290484 (10Jgreen) 05Open→03Resolved a:03Jgreen [15:32:01] 10fundraising-tech-ops: [FR Analytics]: Cross-site redundancy for fundraising analytics platform - https://phabricator.wikimedia.org/T277884 (10Jgreen) 05Open→03Resolved a:03Jgreen [15:35:15] thanks jgleeson and damilare ! [15:58:12] (03CR) 10Hashar: "recheck after changing PATH to point to civicrm-build git repo ( https://gerrit.wikimedia.org/r/c/integration/config/+/724772/ )" [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724582 (https://phabricator.wikimedia.org/T288721) (owner: 10Eileen) [15:59:24] 10Fundraising Sprint Esperantoland, 10Fundraising Sprint File Systems Stage Show, 10Fundraising Sprint Git Rebase Jump, 10Fundraising Sprint Humongous bacteria petting zoo, and 15 others: Update Fundraising tech CI image to use upstream buildkit, no symlink for civ... - https://phabricator.wikimedia.org/T277500 [16:43:27] 10Fundraising Sprint Esperantoland, 10Fundraising Sprint File Systems Stage Show, 10Fundraising Sprint Git Rebase Jump, 10Fundraising Sprint Humongous bacteria petting zoo, and 15 others: Update Fundraising tech CI image to use upstream buildkit, no symlink for civ... - https://phabricator.wikimedia.org/T277500 [16:43:27] oops cstone I put an extra shortcut to the 9/15 talk in that folder and it won't let me delete it [16:43:37] even though it says I have edit rights [16:43:42] haha [16:43:42] shrug [16:43:56] 10Fundraising Sprint Esperantoland, 10Fundraising Sprint File Systems Stage Show, 10Fundraising Sprint Git Rebase Jump, 10Fundraising Sprint Humongous bacteria petting zoo, and 16 others: CiviCRM CI tests failing due to half-resolution of T277500 - https://phabricator.wikimedia.org/T291897 (10hashar) 05Op... [16:44:46] it let me ejegg [16:45:39] thanks! [17:23:15] (03PS1) 10Ejegg: Batch update payment tokens [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/724785 [17:23:48] cstone: can you take a look at ^^^ for me if you have time? [17:24:25] I figure you probably have a good number of old adyen recurrings locally :) [17:24:47] if you want to do it a couple at a time just add 'batch=2' or the like [17:24:51] to the command line [17:25:14] i don't any more but I can recreate some [18:21:33] fr-tech: is there any reason to hold up civi imports and hand entering at this point? i know there is the adyen token work and the civi update for later in the day. just didn't think they would impact what mdemos is asking for. [18:28:59] dwisehaupt: as far as I'm concerned it's ok [18:29:56] cool. i figured your work wouldn't impact that but wanted to double check. [18:54:47] ejegg: https://gerrit.wikimedia.org/r/c/operations/puppet/+/724816/1/modules/ssh/templates/sshd_config.erb#b4 [18:54:50] oops [18:54:57] https://gerrit.wikimedia.org/r/c/operations/puppet/+/724816 even [18:55:19] also I think I realised why I wasn't getting traffic [18:55:26] when testing with the cloud vps instance [18:55:42] pretty sure I was running `service sshd reload` and not `service ssh reload` [18:56:29] although they both seem to point to sshd [18:58:51] 10Fundraising-Backlog, 10Analytics-Radar, 10Product-Analytics, 10Wikipedia-iOS-App-Backlog, and 2 others: Understand impact of Apple's Relay Service - https://phabricator.wikimedia.org/T289795 (10mpopov) [19:35:17] thanks jgleeson|away [19:40:42] ejegg: would you be able to do a quick chat about recurring imports [19:40:52] sure cstone [19:40:52] not yours but mine hah [19:41:19] todays standup? [19:41:58] oh sure [19:56:34] 10Fundraising-Backlog: Dlocal IP address additions - https://phabricator.wikimedia.org/T292114 (10EMartin) [21:29:31] 10Fundraising-Backlog: review civi orphan rectifier log use - https://phabricator.wikimedia.org/T272150 (10Jgreen) As a first pass I excluded logs that are clearly irrelevant, i.e. for server roles that have nothing to do with donation processing. [22:49:48] 10Fundraising-Backlog, 10Analytics-Radar, 10Product-Analytics, 10Wikipedia-iOS-App-Backlog, and 2 others: Understand impact of Apple's Relay Service - https://phabricator.wikimedia.org/T289795 (10MMiller_WMF) a:03MMiller_WMF [22:56:56] (03PS3) 10Eileen: 5.43.alpha [wikimedia/fundraising/crm/civicrm] - 10https://gerrit.wikimedia.org/r/723806 [23:31:35] So I just put up the 5.43 alpha into ci - just trying to get it working on staging - but my understanding is the maintenance window means better to get our quickly? [23:31:40] it's passing! [23:32:19] note the new extension is disabled by default & it's probably better not to worry about testing it until I've done some bits & pieces [23:40:32] but the update is up & running on staging.... [23:40:48] note I don't think we need an outage to push it - no major db changes