[06:01:52] (03CR) 10jerkins-bot: [V: 04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_36) - 10https://gerrit.wikimedia.org/r/764504 (owner: 10L10n-bot) [07:06:44] (03PS1) 10AndyRussG: [DO NOT MERGE] Stub for partial mustache template in Email Pref. Ctr. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/764625 (https://phabricator.wikimedia.org/T277196) [07:09:27] 10Fundraising Sprint Cheese String Theory, 10Fundraising-Backlog, 10FR-Email, 10Patch-For-Review: wle_001 variant for e-mail opt-in is broken - https://phabricator.wikimedia.org/T277196 (10AndyRussG) a:03AndyRussG [07:12:58] (03PS3) 10Wfan: WIP: Switch civicrm country to civicrm countries [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/763274 (https://phabricator.wikimedia.org/T301493) [07:14:03] (03PS4) 10Wfan: Filter media wiki country with civicrm countries [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/763274 (https://phabricator.wikimedia.org/T301493) [07:14:32] (03CR) 10jerkins-bot: [V: 04-1] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/764661 (owner: 10L10n-bot) [07:26:35] (03CR) 10Raimond Spekking: [C: 03+2] "false positive" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/764661 (owner: 10L10n-bot) [08:06:12] (03CR) 10Nikerabbit: [V: 03+2] Localisation updates from https://translatewiki.net. [extensions/DonationInterface] (REL1_36) - 10https://gerrit.wikimedia.org/r/764504 (owner: 10L10n-bot) [10:24:40] 10WMSE-Content-partnerships-support-2021-Fundraising, 10User-Jenny_Brandt_WMSE: Research Telemarketing - suppliers/costs - https://phabricator.wikimedia.org/T268596 (10Jenny_Brandt_WMSE) I would suggest this to be finalized and added to future fundraising ideas. [10:25:17] 10WMSE-Content-partnerships-support-2021-Fundraising, 10User-Jenny_Brandt_WMSE: Research Telemarketing - suppliers/costs - https://phabricator.wikimedia.org/T268596 (10Jopparn) 05Openโ†’03Resolved a:03Jopparn Sounds good. [10:26:01] 10WMSE-Content-partnerships-support-2021-Fundraising, 10User-Eric_Luth_WMSE, 10User-Jenny_Brandt_WMSE, 10User-Jopparn: Develop a F2F toolbox for volunteers - https://phabricator.wikimedia.org/T276969 (10Jenny_Brandt_WMSE) Change to 2022. Content partnership support [10:33:27] 10WMSE-Content-partnerships-support-2021-Fundraising, 10User-Jenny_Brandt_WMSE: Photo -session of material F2F - https://phabricator.wikimedia.org/T276753 (10Jenny_Brandt_WMSE) This was done in 2021. Added here: https://drive.google.com/drive/u/0/folders/1--x6REO3fmucaKiwNz_cN9-lYS65Lgj8 [10:35:01] 10WMSE-Content-partnerships-support-2021-Fundraising, 10User-Jenny_Brandt_WMSE: Read report/analyses from F2F campaign - https://phabricator.wikimedia.org/T276115 (10Jenny_Brandt_WMSE) Report finalized. [10:35:47] 10WMSE-Content-partnerships-support-2021-Fundraising, 10User-Jenny_Brandt_WMSE: Contact similar organisations ahead of F2F campaign - https://phabricator.wikimedia.org/T276054 (10Jenny_Brandt_WMSE) This was done but no conclusive information was given. Done [12:11:26] 10WMSE-Content-partnerships-support-2021-Fundraising, 10User-Jenny_Brandt_WMSE: Photo -session of material F2F - https://phabricator.wikimedia.org/T276753 (10Ainali) >>! In T276753#7727425, @Jenny_Brandt_WMSE wrote: > This was done in 2021. > Added here: https://drive.google.com/drive/u/0/folders/1--x6REO3fmu... [14:04:11] hi fr-tech! [14:17:03] 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10KHaggard) [14:25:18] (03PS18) 10Damilare Adedoyin: E-mail Preferences Center header, footer and styling [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) (owner: 10AndyRussG) [14:27:22] (03CR) 10jerkins-bot: [V: 04-1] E-mail Preferences Center header, footer and styling [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) (owner: 10AndyRussG) [14:27:51] (03PS19) 10Damilare Adedoyin: E-mail Preferences Center header, footer and styling [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) (owner: 10AndyRussG) [14:28:54] (03PS20) 10Damilare Adedoyin: E-mail Preferences Center header, footer and styling [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) (owner: 10AndyRussG) [14:30:40] (03CR) 10jerkins-bot: [V: 04-1] E-mail Preferences Center header, footer and styling [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) (owner: 10AndyRussG) [14:43:08] (03PS21) 10Damilare Adedoyin: E-mail Preferences Center header, footer and styling [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) (owner: 10AndyRussG) [15:12:10] PROBLEM - check_log_messages on frav1002 is CRITICAL: CRITICAL: ipset_error 2 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1002&service=check_log_messages [15:17:09] RECOVERY - check_log_messages on frav1002 is OK: OK https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1002&service=check_log_messages [15:57:56] hi fr-tech! [16:06:56] hmm, gerrit's not loading over ssh for me [16:07:02] anon http works [16:07:02] howdy [16:07:16] how was your long weekend? [16:11:58] hi ejegg XenoRyet [16:12:35] Kids had monday off as well, so that makes it a different kind of long weekend, but it was good. [16:12:54] jgleeson, nice to see you back. All better I hope? [16:13:37] hi ejegg XenoRyet jgleeson fr-tech [16:14:27] Hi fr-tech [16:15:24] getting there XenoRyet! just an annoying cough to go [16:15:41] hi damilare cstone :) [16:15:50] Good to hear. That cough stuck around a while for me too. [16:16:16] it's super annoying and seems to worsen at night [16:18:41] heyy fr-tech ejegg XenoRyet jgleeson damilare cstone :) [16:19:27] hey AndyRussG! [16:19:44] :) [17:06:59] hey Andy [17:08:49] urg, I'm having trouble getting my local setup to fully switch back to the old 'hash' parameter [17:09:15] fr-tech anyone want to review the patches for switching to the expiring checksum in email-pref-ctr links? [17:09:46] https://gerrit.wikimedia.org/r/c/mediawiki/extensions/DonationInterface/+/763623 and related [17:09:58] (links in commit message) [17:17:56] 10Fundraising Sprint Cheese String Theory, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Recurring-Donations: Schedule recurring charge job more frequently - https://phabricator.wikimedia.org/T292278 (10Cstone) a:03Cstone [17:29:59] hmm, civiproxy container seems to have a symlink to a nonexistent xdebug conf [17:30:07] 30-xdebug-web.ini -> /srv/config/exposed/civicrm/xdebug-web.ini [17:30:11] ls -l /srv/config/exposed/ [17:30:11] total 0 [17:45:08] (03CR) 10Wfan: [C: 03+2] Email Prefs center - use expiring checksum [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/763623 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [17:45:22] 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10KHaggard) Whoops - spoke a little too soon about database id: 11851009. That one was mid-delete when I logged this ticket, but it failed for some reason so I'm digging into tha... [17:47:18] (03Merged) 10jenkins-bot: Email Prefs center - use expiring checksum [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/763623 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [17:59:37] (03PS22) 10Damilare Adedoyin: E-mail Preferences Center header, footer and styling [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) (owner: 10AndyRussG) [17:59:49] (03CR) 10jerkins-bot: [V: 04-1] E-mail Preferences Center header, footer and styling [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) (owner: 10AndyRussG) [18:02:19] thanks wfan! [18:11:26] :) [18:12:33] wfan did you get your full civi/proxy/e-p-c interaction working locally? [18:12:40] yes! [18:12:45] great! [18:13:37] I actually rebuild a brand new container, thanks for the help, still do not know what's wrong previously, but glad this new env working [18:20:32] AndyRussG and damilare - are you in the middle of making more changes to the E-P-C styling patch, or can I try to do a manual rebase? [18:21:02] ejegg: hmmm I can try to do that if you like... damilare? [18:21:10] I was just about to jump in to do some more tweaks there [18:21:35] ok, sounds good AndyRussG [18:21:51] :) [18:21:54] Sure AndyRussG ejegg, I'm done with the changes [18:22:13] :) [18:23:07] AndyRussG: cool cool, after the rebase you'll need to pull down the civicrm and config patches to switch to the expiring checksum too [18:23:24] ah oki cool [18:23:29] they're linked in the commit message from https://gerrit.wikimedia.org/r/763623 [18:23:47] and I seem to have to restart the civiproxy container for the config changes to take effect [18:24:16] then to get the links with checksums, one of the civi patches adds a new link on the contact summary [18:28:59] huh oki [18:29:44] since they're expiring, we calculate them as needed rather than storing them in the db [18:30:09] i think wfan is reviewing those [18:30:26] wfan let me know if you have any questions [18:31:19] This checksum is been merged already [18:31:57] https://gerrit.wikimedia.org/r/763623 this one [18:33:00] (03PS2) 10Wfan: Update CiviProxy config for expiring checksum [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/763627 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [18:33:24] (03CR) 10Wfan: [C: 03+2] "update hash to checksum" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/763627 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [18:33:51] not sure why this did not get jenkins check? https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/dev/+/763627 [18:35:24] (03CR) 10Wfan: [C: 03+2] Preferences.create uses expiring checksum [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/763626 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [18:36:24] (03CR) 10Wfan: [C: 03+2] Civiproxy.getpreferences uses expiring checksum [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/763625 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [18:39:21] not sure about these two pr https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/763386/3. https://gerrit.wikimedia.org/r/c/wikimedia/fundraising/crm/+/763636/1 [18:41:48] welp this is a complex rebase heheh [18:44:22] I guess we might able to talk the checksum tickets during the tech talk today haha. ๐Ÿ˜‚ [18:46:35] fr-tech ejegg I pushed up a change to localsettings to have the recurring smashpig job run again at :51, I checked average run times recently and they have been 20 minutes [18:46:58] if anyone could check I didn't mess it up [18:48:04] looking cstone [18:49:32] yep cstone, that looks good to me. Thanks! [18:49:42] thanks ejegg ! ill watch it tonight too [18:54:37] (03PS23) 10AndyRussG: E-mail Preferences Center header, footer and styling [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) [18:55:01] 10Fundraising Sprint Cheese String Theory, 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM, 10Recurring-Donations: Schedule recurring charge job more frequently - https://phabricator.wikimedia.org/T292278 (10Cstone) I added a second run at :51. [18:55:11] (03CR) 10AndyRussG: [C: 04-1] "Rebased, not quite ready to be merged tho. Thanks!!" [extensions/DonationInterface] - 10https://gerrit.wikimedia.org/r/758283 (https://phabricator.wikimedia.org/T290986) (owner: 10AndyRussG) [19:04:11] (03CR) 10AndyRussG: [V: 03+2] Update CiviProxy config for expiring checksum [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/763627 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [19:06:03] ejegg wfan thanks for writing and reviewing the patch with the checksum fundraising-dev config... :) just to note for next time, wfan, that repository doesn't yet have CI set up, so to merge a change, in addition to +2 code review, you have to do +2 verified and then click the "submit" button [19:07:38] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Querying contacts from 'Reply Mail Block' events - https://phabricator.wikimedia.org/T300817 (10DStrine) What is a reply mail block? * Generally because a mailbox provider thinks weโ€™re delivering spam, itโ€™s a type of soft bounce * (Note from fr-tech) Some... [19:08:16] Gotcha :AndyRussG Thanks [19:08:30] thank u! :) [19:12:50] 10Fundraising-Backlog, 10Wikimedia-Fundraising-CiviCRM: Querying contacts from 'Reply Mail Block' events - https://phabricator.wikimedia.org/T300817 (10DStrine) So @nisrael needs a list of civi record in "On Hold" who got on hold via a reply mail block. Can this we created in searchkit? [19:17:17] thanks wfan [19:17:31] and thanks AndyRussG [19:18:00] (03PS3) 10Ejegg: Add settings for pref ctr link in CiviCRM [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/763361 (https://phabricator.wikimedia.org/T301289) [19:18:41] AndyRussG: ^^^ will fix the base URL for the new links in the contact summary [19:18:57] ahh cool :) [19:19:15] (though you can also just do it manually in Admin->customize data...->WMF configuration [19:19:18] ) [19:19:57] ejegg: so now to get a working link for a local e-p-c I have to go through Civi, to get a checksum, correct? [19:20:11] yep AndyRussG [19:20:13] (sorry) [19:20:24] but... the expiry period is configurable [19:20:24] heheh ahh got it, thx and no apologies needed ;p [19:20:32] so we could make them last a year in fr-dev [19:20:45] hmmm [19:21:08] though having them expire locally every now and again might serve as a reminder that the also do so on prod? [19:21:20] right right [19:29:06] 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10Eileenmcnaughton) @KHaggard I was already going to ask you about a database for me to test creating groups on - shame I didn't ask yesterday :-) But basically I'm not sure if i... [19:37:38] 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10KHaggard) Hmm it might be better for me to create a new database for that testing purpose (let me know if that is in another phab somewhere) @Eileenmcnaughton These ones are... [19:39:57] 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10Eileenmcnaughton) @KHaggard the phab is this one https://phabricator.wikimedia.org/T301514 - but if you create one for testing I think we should keep it as not being able to t... [19:56:41] 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10KHaggard) @Eileenmcnaughton Ok, that makes sense to me. After we finish this phab, I'll work on creating a sandbox database. Would that also mean we would need to run ForgetMe... [19:57:58] (03CR) 10AndyRussG: [V: 03+2 C: 03+2] "Works great, thanks for this!!" [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/763361 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [19:57:58] 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10Eileenmcnaughton) @KHaggard I think we'd proably just purge contacts out of it - it won't have many in it anyway [20:14:00] ejegg: I see the new tab for the preference center link but what should it look like when I click on it, its just empty on the right [20:19:06] cstone: oh weird [20:19:20] hmm, maybe try a 'drush cvapi system.flush' [20:19:24] entirely possible my civi is messed up just not sure what to expect [20:19:49] ah yeah, system.flush is needed because the hook to make the new tab appear on the left is strictly in the code [20:20:11] but the thing that connects the new path to the content depends on the db cache being rebuilt [20:20:42] It will just be two lines of text [20:22:32] (03CR) 10Ejegg: Add email pref center link to contact summary (031 comment) [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/763386 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [20:34:58] 10Fundraising Sprint Cheese String Theory, 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10DStrine) p:05Triageโ†’03High [20:41:56] 10Fundraising Sprint Cheese String Theory, 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10Eileenmcnaughton) I've removed the 2 dbs from forgetme - only 2 remain 'database_id' => [9644238,14682316], [20:42:16] 10Fundraising Sprint Cheese String Theory, 10Fundraising-Backlog, 10FR-Email, 10Patch-For-Review: wle_001 variant for e-mail opt-in is broken - https://phabricator.wikimedia.org/T277196 (10DStrine) 05Openโ†’03Declined [20:45:47] 10Fundraising Sprint Cheese String Theory, 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10Eileenmcnaughton) a:03Eileenmcnaughton [20:46:02] 10Fundraising Sprint Cheese String Theory, 10Fundraising-Backlog, 10FR-Email: Updating List of Database ids for Forget Me requests - https://phabricator.wikimedia.org/T302286 (10Eileenmcnaughton) [20:51:15] 10Fundraising Sprint Cheese String Theory, 10Fundraising-Backlog: time spent on CN SEO meetings - https://phabricator.wikimedia.org/T302346 (10DStrine) [21:03:31] fr-tech ah here's more chick and pig scrum stuff: https://www.visual-paradigm.com/scrum/scrum-pig-and-chicken/ [21:59:04] (03PS1) 10Eileen: Add getoption to the civiproxy [wikimedia/fundraising/dev] - 10https://gerrit.wikimedia.org/r/764903 [22:18:31] (03PS4) 10Eileen: Preferences.create uses expiring checksum [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/763626 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [22:18:50] (03PS3) 10Eileen: Civiproxy.getpreferences uses expiring checksum [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/763625 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [22:21:30] 10fundraising-tech-ops, 10Patch-For-Review: install/configure civi1002 - https://phabricator.wikimedia.org/T296409 (10Dwisehaupt) [22:25:29] (03CR) 10Eileen: [C: 03+2] Small cleanups to email prefs API calls [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/763636 (owner: 10Ejegg) [22:36:18] PROBLEM - check_puppetrun on frmon1001 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 5 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[prometheus] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frmon1001&service=check_puppetrun [22:37:18] PROBLEM - check_puppetrun on frmon2001 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 6 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[prometheus] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frmon2001&service=check_puppetrun [22:39:27] (03PS4) 10Eileen: Add email pref center link to contact summary [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/763386 (https://phabricator.wikimedia.org/T301289) (owner: 10Ejegg) [22:39:45] (03PS2) 10Eileen: Small cleanups to email prefs API calls [wikimedia/fundraising/crm] - 10https://gerrit.wikimedia.org/r/763636 (owner: 10Ejegg) [22:41:18] RECOVERY - check_puppetrun on frmon1001 is OK: OK: Puppet is currently enabled, last run 2 minutes ago with 0 failures https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frmon1001&service=check_puppetrun [22:42:18] PROBLEM - check_puppetrun on frmon2001 is CRITICAL: CRITICAL: Puppet has 2 failures. Last run 11 minutes ago with 2 failures. Failed resources (up to 3 shown): Service[prometheus] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frmon2001&service=check_puppetrun [22:47:18] RECOVERY - check_puppetrun on frmon2001 is OK: OK: Puppet is currently enabled, last run 1 minute ago with 0 failures https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frmon2001&service=check_puppetrun [23:12:17] PROBLEM - check_log_messages on frav1002 is CRITICAL: CRITICAL: Adyen_endpoint_critical 1 [=1],Amazon_endpoint_critical 1 [=1],Paypal_endpoint_critical 1 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1002&service=check_log_messages [23:16:38] 10fundraising-tech-ops: install/configure civi1002 - https://phabricator.wikimedia.org/T296409 (10Dwisehaupt) [23:17:17] PROBLEM - check_log_messages on frav1002 is CRITICAL: CRITICAL: Adyen_endpoint_critical 1 [=1],Amazon_endpoint_critical 1 [=1],Paypal_endpoint_critical 1 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1002&service=check_log_messages [23:20:54] ^^^ that is related to the new civi host i just spun up and it not having firewall rules yet. looking at how to properly address it. [23:22:17] PROBLEM - check_log_messages on frav1002 is CRITICAL: CRITICAL: Adyen_endpoint_critical 1 [=1],Amazon_endpoint_critical 1 [=1],Paypal_endpoint_critical 1 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1002&service=check_log_messages [23:27:13] PROBLEM - check_log_messages on frav1002 is CRITICAL: CRITICAL: Adyen_endpoint_critical 1 [=1],Amazon_endpoint_critical 1 [=1],Paypal_endpoint_critical 1 [=1] https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1002&service=check_log_messages [23:28:02] ACKNOWLEDGEMENT - check_log_messages on frav1002 is CRITICAL: CRITICAL: Adyen_endpoint_critical 1 [=1],Amazon_endpoint_critical 1 [=1],Paypal_endpoint_critical 1 [=1] Dwisehaupt acking while we sort out the issue with a newly built host failing the checks by design. https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1002&service=check_log_messages [23:32:48] thanks for the CR Eileen! [23:33:58] Ahh, so the getOptions call will be to get the lists of languages and countries? [23:43:17] thanks for the explanation dwisehaupt [23:47:13] RECOVERY - check_log_messages on frav1002 is OK: OK https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=frav1002&service=check_log_messages [23:55:22] the heck... I keep getting 'permission denied publickey' trying to pull from gerrit [23:55:55] confirmed ssh pubkey specified for identityfile is identical to that listed in gerrit settings ui [23:56:15] killed the ssh agent and tried again and it doesn't even ask me to unlock a key [23:56:52] guess I'll try the windows-style solution and log out and log in again