[08:26:14] !log admin codfw ceph enabled diskprediction_local module, will take a bit to populate/start getting predictions (T348716) [08:26:19] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [08:26:20] T348716: [ceph] export number of bad sectors per-disk - https://phabricator.wikimedia.org/T348716 [08:28:20] it seems it will need at least 6 days worth of data (started collecting today): Oct 20 08:24:34 cloudcephmon2005-dev ceph-mgr[17446]: 2023-10-20T08:24:34.203+0000 7fe3ffdc3700 0 [diskprediction_local ERROR root] unable to predict device due to health data records less than 6 days [10:11:52] !log toolsbeta taking harbor down for upgrade (T346241) [10:11:57] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [10:11:57] T346241: Upgrade harbor from 2.5 to 2.9 - https://phabricator.wikimedia.org/T346241 [10:33:15] !log admin upgraded cloudcephosd1001 to v15 (T349363) [10:33:20] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [10:33:21] T349363: [ceph.eqiad] upgrade all hosts to 15 - https://phabricator.wikimedia.org/T349363 [10:37:07] !log toolsbeta harbor up again and upgraded from 2.5 to 2.9 (T346241) [10:37:10] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Toolsbeta/SAL [10:37:11] T346241: Upgrade harbor from 2.5 to 2.9 - https://phabricator.wikimedia.org/T346241 [13:20:32] !log admin upgraded cloudcephosd1002 to v15 (T349363) [13:20:38] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [13:20:38] T349363: [ceph.eqiad] upgrade all hosts to 15 - https://phabricator.wikimedia.org/T349363 [14:25:45] !log admin upgraded cloudcephosd1003 to v15 (T349363) [14:25:50] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [14:25:51] T349363: [ceph.eqiad] upgrade all hosts to 15 - https://phabricator.wikimedia.org/T349363 [15:17:10] !log admin upgraded cloudcephosd1004 to v15 (T349363) [15:17:15] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Admin/SAL [15:17:16] T349363: [ceph.eqiad] upgrade all hosts to 15 - https://phabricator.wikimedia.org/T349363 [15:35:27] !log tools.admin add Vgutierrez (WMF SRE) as a maintainer to troubleshoot an acme-chief issue [15:35:30] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.admin/SAL [15:35:46] taavi: <3 thx [17:34:37] !log tools.lexeme-forms deployed df7cf04757 (i18n updates: io, ms-arab) [17:34:41] Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.lexeme-forms/SAL [20:07:18] Hi. The Bot I wrote used to use https://google-api-proxy.wmflabs.org/ and I guess it worked (ref: https://wikitech.wikimedia.org/wiki/Nova_Resource:Google-api-proxy ) but dropped to disuse. Now trying to use it again I think I get "API key expired. Please renew the API key.". I don't remember how I got the API key, nor do  I know how to renew it.. [20:07:18] andrewbogott  maybe/ [20:09:01] sounds like that would be your google api key? About that I know nothing. [20:10:26] Looking in my emails I got it from user Kaldari   ? [21:50:33] Kotz: sorry to ghost, I'm doing lots of things today. Even though Kaldari was staff, I doubt that that was a WMF-managed google account. Might be worth asking on a mailing list? [22:34:28] i have a patch up for labs-private for the new community-crm project that i think is right, but i'm not 100% https://gerrit.wikimedia.org/r/c/labs/private/+/967519 [22:35:56] the thing that has me questioning is, when testing this in a standalone puppetserver instance, i could not get hiera to find the password data if i have it in a new file. however, it ran fine if I added it to the existing private/hieradata/labs.yaml file. [22:40:47] what i'm wondering is, does the yaml file name need to follow the labs project and not the profile/role? ie is the standard for this file to live in private/hieradata/civicrm-prototype.yaml instead of the profile that we are intending for prod vps