[08:13:33] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad: Q1:(Need By: TBD) rack/setup/install kubernetes10[18-21] - https://phabricator.wikimedia.org/T290202 (10akosiaris) [08:13:35] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: setup/install kubernetes10[18-21] - https://phabricator.wikimedia.org/T293728 (10akosiaris) 05Stalled→03Open Cool, moving back to open, I 'll tend to this early next week. [08:26:57] 10serviceops, 10Prod-Kubernetes, 10Kubernetes: setup/install kubernetes10[18-21] - https://phabricator.wikimedia.org/T293728 (10elukey) Important note - we had to modify grub's config to add `systemd.unified_cgroup_hierarchy=0` (the kubelets do not support the new cgroup hierarchy in 1.16) so a reboot is nee... [08:29:53] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad, 10GitLab (Infrastructure): Q3:(Need By: TBD) rack/setup/install gitlab100[2|3] and gitlab-runner100[2|3|4] - https://phabricator.wikimedia.org/T301177 (10LSobanski) a:05LSobanski→03RobH Fine by me. [09:39:24] shouldn't apache2 be included in profile::lvs::realserver::pools of hieradata/role/common/parsoid.yaml? (noticed it when trying to figure out why restart-apache2 isn't present on Parsoid hosts) [11:16:34] <_joe_> moritzm: no [11:16:42] <_joe_> we only have the https lvs endpoint [11:16:54] <_joe_> but also yes, as it's part of the stack [11:17:06] <_joe_> so yes, we should have that, uhm lemme fix that in a few [11:20:24] ack :-) [11:25:49] 10serviceops, 10MW-on-K8s, 10Patch-For-Review, 10Release-Engineering-Team (Done by Feb 23🔥): Build MediaWiki images for kubernetes on the deployment servers - https://phabricator.wikimedia.org/T297673 (10Joe) >>! In T297673#7733295, @dancy wrote: > @joe I tried running this today but it failed: > ` > dancy... [11:39:26] <_joe_> moritzm: https://gerrit.wikimedia.org/r/c/operations/puppet/+/765495 will merge now [11:44:42] thanks! [11:44:43] 10serviceops, 10MW-on-K8s, 10Patch-For-Review, 10Release-Engineering-Team (Done by Feb 23🔥): Build MediaWiki images for kubernetes on the deployment servers - https://phabricator.wikimedia.org/T297673 (10Joe) aaand should be fixed now. [12:59:48] 10serviceops, 10Performance-Team, 10Patch-For-Review: Deprecate "/static/current" at WMF in favour of similar long-cache unversioned /w/ URLs - https://phabricator.wikimedia.org/T302465 (10Krinkle) [13:29:41] 10serviceops, 10Performance-Team, 10Patch-For-Review: Deprecate "/static/current" at WMF in favour of similar long-cache unversioned /w/ URLs - https://phabricator.wikimedia.org/T302465 (10Krinkle) [13:30:04] 10serviceops, 10Performance-Team, 10Patch-For-Review, 10Technical-Debt: Deprecate "/static/current" at WMF in favour of similar long-cache unversioned /w/ URLs - https://phabricator.wikimedia.org/T302465 (10Krinkle) [13:30:10] 10serviceops, 10Performance-Team, 10Patch-For-Review, 10Technical-Debt: Deprecate "/static/current" at WMF in favour of similar long-cache unversioned /w/ URLs - https://phabricator.wikimedia.org/T302465 (10Krinkle) p:05Triage→03Medium [13:31:55] 10serviceops, 10Performance-Team, 10Patch-For-Review, 10Technical-Debt: Deprecate "/static/current" at WMF in favour of similar long-cache unversioned /w/ URLs - https://phabricator.wikimedia.org/T302465 (10Krinkle) @Joe Would be interested in your thoughts on this proposal, as well as whether you consider... [15:31:45] 10serviceops, 10MW-on-K8s, 10Patch-For-Review, 10Release-Engineering-Team (Done by Feb 23🔥): Build MediaWiki images for kubernetes on the deployment servers - https://phabricator.wikimedia.org/T297673 (10dancy) >>! In T297673#7734748, @Joe wrote: > aaand should be fixed now. Confirmed. Thanks @Joe! [16:37:29] 10serviceops, 10MW-on-K8s, 10SRE-swift-storage, 10Shellbox, and 2 others: Support large files in Shellbox - https://phabricator.wikimedia.org/T292322 (10mark) [16:50:05] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad, 10GitLab (Infrastructure): Q3:(Need By: TBD) rack/setup/install gitlab100[3|4] and gitlab-runner100[2|3|4] - https://phabricator.wikimedia.org/T301177 (10RobH) [16:50:40] 10serviceops, 10DC-Ops, 10SRE, 10ops-eqiad, 10GitLab (Infrastructure): Q3:(Need By: TBD) rack/setup/install gitlab100[3|4] and gitlab-runner100[2|3|4] - https://phabricator.wikimedia.org/T301177 (10RobH) a:05RobH→03Jclark-ctr >>! In T301177#7734357, @LSobanski wrote: > Fine by me. Thanks, updated th... [18:06:24] 10serviceops, 10InternetArchiveBot: IABot 301 POST requests - https://phabricator.wikimedia.org/T274090 (10Harej) [18:19:37] 10serviceops, 10Data-Engineering, 10Data-Engineering-Kanban, 10SRE, 10observability: Upgrade Kafka to 2.x - https://phabricator.wikimedia.org/T300102 (10EChetty) [22:07:54] 10serviceops, 10Prod-Kubernetes, 10Kubernetes, 10Patch-For-Review: Implement POC for istio ingress - https://phabricator.wikimedia.org/T290966 (10Dzahn) deployed @JMeybohm's change https://gerrit.wikimedia.org/r/c/operations/puppet/+/765572 Now miscweb/https://static-bugzilla.wikimedia.org/ is behind the... [22:53:08] 10serviceops, 10MW-on-K8s, 10Patch-For-Review, 10Release-Engineering-Team (Done by Feb 23🔥): Build MediaWiki images for kubernetes on the deployment servers - https://phabricator.wikimedia.org/T297673 (10dancy) [23:00:40] 10serviceops, 10MW-on-K8s, 10Release-Engineering-Team, 10Scap: Deploy MediaWiki images for kubernetes from the deployment servers - https://phabricator.wikimedia.org/T302539 (10dancy) [23:02:14] 10serviceops, 10MW-on-K8s, 10Patch-For-Review, 10Release-Engineering-Team (Done by Feb 23🔥): Build MediaWiki images for kubernetes on the deployment servers - https://phabricator.wikimedia.org/T297673 (10dancy) [23:38:28] 10serviceops, 10Internet-Archive, 10InternetArchiveBot: Determine appropriate API request limits for InternetArchiveBot - https://phabricator.wikimedia.org/T296577 (10Harej)