[06:26:11] hello folks! [06:26:42] I know it is hackathon time but I see wdqs1004 and 1006 returning 503 to icinga [06:27:03] do they need a depool + restart? [06:45:05] done for 1003 [06:45:08] err 1004 [06:51:50] ok 1004 seems recovering - https://grafana.wikimedia.org/d/000000489/wikidata-query-service?orgId=1&viewPanel=8&refresh=1m&from=now-3h&to=now&var-cluster_name=wdqs [06:52:09] it is depooled, 1006 is in a similar status IIUC [07:13:50] elukey: thanks! [07:16:28] dcausse: bonjour! Should I do the same for 1006? [07:17:29] elukey: yes 1006 seems completly hung [07:17:34] ack doing so [07:18:19] elukey: thanks! [07:18:36] I've set both of them to pooled=inactive [07:19:50] (1006 done :) [07:20:04] thanks! [09:42:35] zpapierski: reading back on oauth conversation above: we don't do sticky sessions with LVS [10:18:59] lunch [10:23:36] gehel: oh, that's a bummer :( [10:24:25] that means that we will probably need a distributed store, at least for auth calls (we could use JWT for the rest to minimize the interaction with additional service) [10:24:48] volans: mind taking another look, when convenient? https://gerrit.wikimedia.org/r/c/operations/software/spicerack/+/723214 [10:28:02] zpapierski: sure will do! [10:28:38] Thx! [11:06:06] lunch [16:00:18] generally still completely lost on what i'll do :P [16:02:58] same here XD [16:03:50] :) [16:04:19] I guess we would figure next week [16:06:26] Emmanuel: hey, welcome! :) [16:20:49] Emmanuel: \o [16:22:11] dcausse Thanks [17:34:58] Emmanuel: Hello :)