[08:40:16] 10serviceops, 10SRE, 10Datacenter-Switchover: Various services hardcode api.svc.eqiad.wmnet - https://phabricator.wikimedia.org/T285518 (10Joe) This is not an issue because that codesearch mostly finds stuff that in not really hardcoded in production, where we use envoy to have services talk to each other, a... [08:40:41] 10serviceops, 10SRE, 10Datacenter-Switchover: Various services hardcode api.svc.eqiad.wmnet - https://phabricator.wikimedia.org/T285518 (10Joe) 05Open→03Invalid [12:52:40] oh man.. finally I am back. had hardware trouble the last 2 days.. included 2 broken laptops, replaced SSD [12:52:59] but looking better now, just need to get back into phab 2fa.. restored my data though [12:53:07] welcome back!! [12:53:10] thanks :) [13:04:50] 2 broken laptops? [13:27:07] 10serviceops, 10GitLab, 10SRE, 10vm-requests: codfw: 1 of VMs requested for gitlab - https://phabricator.wikimedia.org/T285456 (10Jelto) [14:36:52] yes, the old one and the new one I just received as replacement from ITS [15:07:59] 10serviceops, 10MW-on-K8s, 10SRE, 10User-jijiki: Create a mwdebug deployment for mediawiki on kubernetes - https://phabricator.wikimedia.org/T283056 (10Joe) [15:08:05] 10serviceops, 10MW-on-K8s, 10SRE, 10Patch-For-Review: Add the puppet CA to the MediaWiki deployment - https://phabricator.wikimedia.org/T284417 (10Joe) 05Open→03Resolved [15:55:58] so I tried istioctl for ml-serve-eqiad aaaand [15:56:14] no pods came up, I suspect some extra config is needed :D [16:35:39] 10serviceops, 10SRE, 10Datacenter-Switchover: Various services hardcode api.svc.eqiad.wmnet - https://phabricator.wikimedia.org/T285518 (10Legoktm) 05Invalid→03Open p:05High→03Lowest OK, I think those repos should be cleaned up then to not confuse people. [16:35:46] elukey: sounds linke progress :D [16:50:25] jayme: sort of :D Do you have in mind what could be limiting the pods creation? Like PSP/RBAC rules that I need to add for istio etc.. [16:50:38] that part is still "hic sunt leones" for me [16:51:13] if it's psp/rbac, you should be seeing errors in kubectl events [16:51:15] do you? [16:55:38] sorry, need to leave again. :-| [16:58:05] ah yes of course, we can discuss it next week :) [17:01:17] ahhh TIL kubectl get events [17:01:18] Error creating: pods "istiod-7c49cdc6bd-" is forbidden: unable to validate against any pod security policy: [] [19:01:42] 10serviceops, 10SRE, 10decommission-hardware, 10Patch-For-Review: decom 44 eqiad appservers purchased on 2016-04-12/13 (mw1261 through mw1301) - https://phabricator.wikimedia.org/T280203 (10wiki_willy)