[00:00:09] RhinosF1: https://www.mediawiki.org/wiki/Requests_for_comment/Reevaluate_LocalisationUpdate_extension may be relevant for any talks about l10nupdate at miraheze [00:00:11] *nod* [00:00:30] bd808: very likely [00:00:40] probably not midnight reading though [00:01:14] our big turn off trigger was https://lists.wikimedia.org/hyperkitty/list/wikitech-l@lists.wikimedia.org/message/KIOMZKXRWG5DSQHDMSZ3Z65AQCIYQI7N/ (somebody tried to hack us via messages) [00:03:17] hmm [00:03:28] i could easily rewrite how it's deployed [00:03:39] to not be completely blind [00:03:52] but then is it worth it [00:04:12] localisationupdate also doesn't seem to fit too well into the immutable images model that would be used in e.g. mw on k8s world [00:04:47] the hotness in k8s world will be getting to full CD :) [00:05:18] * bd808 imagines that as only 5-6 years after mw-on-k8s [00:05:42] I have a small fun CD story to tell you at the next event :D [00:12:38] i created https://phabricator.miraheze.org/T8251 for awake me [00:17:02] it seems ionice exists [00:17:18] i wonder if that applies to commands created by a command [07:01:38] good morning folks [07:02:20] there are some transport links down, tried to quickly check for outstanding tasks etc.. but didn't find much [07:03:16] - Lumen link down between esams and eqiad (again https://phabricator.wikimedia.org/T287469 ?) [07:03:45] - Two Telia transport links down in eqord (ulsfo and codfw) [07:06:44] lovely, for Telia it seems a fiber cut [07:12:11] and for Lumen I see weird light power values on the cr2-eqiad side [07:13:02] elukey: Lumen is fixing the Atlantic fiber again [07:13:14] * elukey cries in a corner [07:15:46] XioNoX: qq - how do I find what's wrong on cr2-codfw? I see an alert for an interface but can't find it atm (I am checking with show interfaces description etc..) [07:16:08] sorry cr1-codfw [07:16:48] elukey: need to disable the down interfaces from the old linecard. On some routers the interface disappear when you pull the SFP, on other it stays as down [07:17:08] elukey: show interfaces description only show interfaces with descriptions [07:17:37] ack thanks [07:23:25] elukey: the interfaces are also listed in the alert details: https://icinga.wikimedia.org/cgi-bin/icinga/extinfo.cgi?type=2&host=cr1-codfw&service=Router+interfaces [07:24:36] XioNoX: noted :) [17:25:18] who can I trick into merging https://gerrit.wikimedia.org/r/c/operations/puppet/+/737093/? beta cluster only, already tested there, trivial one line change [17:26:06] I can do it right quick [17:27:12] majavah: [done] [17:27:15] thanks! [18:19:52] bblack: I cc'd you on https://phabricator.wikimedia.org/T286066#7486254 for moving lists behind the caching layer, whenever you have time to look at it :)