[00:00:28] <wm-bot>	 !log tools.poty-stuff <legoktm> Updated from 398d3de to def9acb
[00:00:32] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.poty-stuff/SAL
[08:31:26] <tgr_>	 the extensions cluster of codesearch is down: https://codesearch-backend.wmcloud.org/extensions/
[14:43:18] * legoktm looks
[14:44:30] <wm-bot>	 !log tools.bridgebot <lucaswerkmeister> Double IRC messages to other bridges
[14:44:33] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.bridgebot/SAL
[14:46:07] <legoktm>	 hmmm
[14:56:56] <legoktm>	 tgr_: thanks, it's down because the "search" cluster is still in startup mode, but that's because requests to Gerrit are timing out so it's been going for hours. T335197
[14:56:56] <stashbot>	 T335197: codesearch is getting Failed to connect to gerrit-replica.wikimedia.org port 443: Connection timed out - https://phabricator.wikimedia.org/T335197
[14:57:46] <legoktm>	 !log codesearch rebooting codesearch8 to see if that fixes networking issues (T335197)
[14:57:50] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Codesearch/SAL
[15:00:16] <bd808>	 legoktm: hmmm... I saw a puppet patch yesterday that had something to do with gerrit-replica.wm.o. https://gerrit.wikimedia.org/r/c/operations/puppet/+/909794
[15:01:03] <legoktm>	 the server can't even ping en.wikipedia.org/dyna.wikimedia.org
[15:01:32] <taavi>	 which server?
[15:02:22] <legoktm>	 codesearch8.codesearch.eqiad1.wikimedia.cloud
[15:04:45] <taavi>	 bd808: sigh. that no longer matches https://gerrit.wikimedia.org/r/plugins/gitiles/operations/homer/public/+/refs/heads/master/definitions/static.net#19
[15:10:08] <taavi>	 and I think the ping issue is unrelated
[15:10:50] <legoktm>	 hm yeah, I can curl it fine
[15:15:09] <legoktm>	 taavi: should I re-triage the task as netops/serviceops then? or if you want to leave a comment explaining what that file is for since it's totally new to me
[16:41:25] <arturo>	 cc mutante ^^^
[17:55:43] <mutante>	 I reverted the change in question. 
[17:56:13] <mutante>	 legoktm: should be back to normal. we can debug it closer next week 
[17:56:19] <arturo>	 thanks, really appreciated 
[17:56:31] <arturo>	 I'll be happy to help next week
[17:56:54] <mutante>	 ok, cool. I might have similar question about gitlab service IP in cloud. so that's appreciated.
[17:56:57] <mutante>	 cu later
[17:59:26] <legoktm>	 mutante: thanks :)
[18:00:11] <mutante>	 np, sorry for the breakage. probably there is a service and a server IP and things got mixed up somewhere along the way
[18:00:23] <mutante>	 seemed like fixing a bug..but apparently not
[18:07:35] <mutante>	 back to Earth Day, afk
[21:36:56] <wm-bot>	 !log tools.toolviewstest <bd808> Update to 7033053
[21:37:00] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.toolviewstest/SAL
[21:58:39] <andrewbogott>	 !log metricsinfra added raymond-ndibe as project member
[21:58:42] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Metricsinfra/SAL
[22:01:28] <wm-bot>	 !log tools.toolviews <bd808> Update to 7033053
[22:01:30] <stashbot>	 Logged the message at https://wikitech.wikimedia.org/wiki/Nova_Resource:Tools.toolviews/SAL