[07:44:01] <taavi>	 moritzm: good morning! RelEng has +1'd https://gerrit.wikimedia.org/r/c/operations/puppet/+/896318
[07:49:49] <moritzm>	 ack, thanks! We have a focused effort this week called SRE sprint week where we focus on a certain topic only (like upgrading remaining Buster ones or working through the backlog of incident actionable), we'll merge this next week
[10:56:45] <jbond>	 elukey: thanks for the cookbook fixes i sent something on thursday but forgot about it :(
[10:57:18] <elukey>	 jbond: I saw it thanks! Going to test your last patch now :)
[10:57:25] <jbond>	 great thanks
[11:21:02] <volans>	 !incidents
[11:21:03] <sirenbot>	 3482 (UNACKED)  kafka-main2005/Kafka Broker Server (paged)
[11:21:08] <volans>	 !ack 3482
[11:21:09] <sirenbot>	 3482 (ACKED)  kafka-main2005/Kafka Broker Server (paged)
[11:26:06] <slyngs>	 !incidents
[11:26:06] <sirenbot>	 3482 (ACKED)  kafka-main2005/Kafka Broker Server (paged)
[14:26:01] <slyngs>	 claime, jhathaway I have to run in 20 minutes, but my shifts ends in 35mins anyway
[14:26:21] <jhathaway>	 sounds good, thanks slyngs 
[14:26:54] <claime>	 slyngs: no worries, I'm here 'till 1600, and will be near a laptop 'till 1700
[14:27:56] <slyngs>	 thanks :-)
[15:15:33] <marostegui>	 jhathaway: let's go for the reimage "soon" if you can, as I will still be online for a couple of hours
[15:15:53] <jhathaway>	 sounds good, i'll kick it off nowish
[15:15:58] <marostegui>	 thanks
[15:52:12] <marostegui>	 jhathaway: it finished, right?
[15:52:16] <marostegui>	 Or still the last reboot pending?
[15:52:20] <elukey>	 !incidents
[15:52:21] <sirenbot>	 3498 (ACKED)  kafka-main2004/Kafka Broker Server (paged)
[15:52:21] <sirenbot>	 3482 (RESOLVED)  kafka-main2005/Kafka Broker Server (paged)
[15:52:49] <jhathaway>	 marostegui: just finishing the post re-imaging puppet runs
[15:52:53] <marostegui>	 great
[15:57:41] <marostegui>	 jhathaway: heh, 1002 took over as primary
[15:57:48] <marostegui>	 I have stopped it to let 1001 do the checks
[15:57:55] <jhathaway>	 ok
[15:58:47] <marostegui>	 yeah all the checks are essentially down
[15:59:24] <jhathaway>	 marostegui: puppet is clean, so box should be ready
[15:59:32] <marostegui>	 yeah, it is ready but orchestrator is down
[16:00:28] <marostegui>	 it can check any host
[16:01:00] <marostegui>	 Mar 22 16:00:50 dborch1001 orchestrator[5741]: DiscoverInstance(db2183.codfw.wmnet:3306) instance is nil in 0.931s (Backend: 0.748s, Instance: 0.182s), error=x509: certificate relies on legacy Common Name field, use SANs or temporarily enable Common Name matching with GODEBUG=x509ignoreCN=0
[16:01:14] <marostegui>	 No idea what that is
[16:02:23] <jhathaway>	 hmm
[16:02:58] <marostegui>	 https://jfrog.com/knowledge-base/general-what-should-i-do-if-i-get-an-x509-certificate-relies-on-legacy-common-name-field-error/
[16:05:23] <jhathaway>	 hmm, I think this my fault for not reading the pkg docs carefully, looks like we can only use golang 1.14
[16:05:36] <marostegui>	 let's go back to Buster then \o/
[16:05:47] <jhathaway>	 "It's not currently possible to build orchestrator on the standard build host due to its golang version requirements. (Until [[phab:T273637|Puppet host certs do not contain Subject Alt Name entries]] is fixed, or a workaround implemented, we're limited to golang 1.14)."
[16:05:47] <stashbot>	 T273637: Puppet host certs do not contain Subject Alt Name entries - https://phabricator.wikimedia.org/T273637
[16:05:56] <jhathaway>	 let me rebuild with 1.14 and upload
[16:06:00] <marostegui>	 ok :)