[00:56:27] (03PS4) 10Krinkle: frontend: Server-side rendering (take 2) [labs/codesearch] - 10https://gerrit.wikimedia.org/r/1056248 [01:10:55] FIRING: MaxConntrack: Max conntrack at 80.15% on cloudvirt1040:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_conntrack - https://grafana.wikimedia.org/d/oITUqwKIk/netfilter-connection-tracking - https://alerts.wikimedia.org/?q=alertname%3DMaxConntrack [01:15:55] RESOLVED: MaxConntrack: Max conntrack at 80.15% on cloudvirt1040:9100 - https://wikitech.wikimedia.org/wiki/Monitoring/check_conntrack - https://grafana.wikimedia.org/d/oITUqwKIk/netfilter-connection-tracking - https://alerts.wikimedia.org/?q=alertname%3DMaxConntrack [01:18:57] FIRING: CloudVPSDesignateLeaks: Detected 22 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [01:44:34] (03approved) 10raymond-ndibe: builds: override default imagemagick config [repos/cloud/toolforge/builds-builder] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/56 (https://phabricator.wikimedia.org/T370610) (owner: 10dcaro) [01:45:54] (03update) 10raymond-ndibe: builds: override default imagemagick config [repos/cloud/toolforge/builds-builder] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/builds-builder/-/merge_requests/56 (https://phabricator.wikimedia.org/T370610) (owner: 10dcaro) [02:27:03] FIRING: ToolforgeKubernetesWorkerTooManyDProcesses: Kubernetes worker tools-k8s-worker-nfs-19 has many processes stuck on IO (probably NFS) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses - https://grafana.wmcloud.org/d/3jhWxB8Vk/toolforge-general-overview - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeKubernetesWorkerTooManyDProcesses [02:42:03] RESOLVED: ToolforgeKubernetesWorkerTooManyDProcesses: Kubernetes worker tools-k8s-worker-nfs-19 has many processes stuck on IO (probably NFS) - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses - https://grafana.wmcloud.org/d/3jhWxB8Vk/toolforge-general-overview - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeKubernetesWorkerTooManyDProcesses [03:11:52] (03open) 10raymond-ndibe: [toolforge-weld] support back python 3.7 [repos/cloud/toolforge/toolforge-weld] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-weld/-/merge_requests/50 (https://phabricator.wikimedia.org/T370932) [03:28:39] (03update) 10raymond-ndibe: [toolforge-weld] support back python 3.7 [repos/cloud/toolforge/toolforge-weld] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-weld/-/merge_requests/50 (https://phabricator.wikimedia.org/T370932) [03:47:50] (03update) 10raymond-ndibe: [toolforge-weld] support back python 3.7 [repos/cloud/toolforge/toolforge-weld] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-weld/-/merge_requests/50 (https://phabricator.wikimedia.org/T370932) [04:06:56] FIRING: SystemdUnitDown: The service unit purge_vm_rbd_images.service is in failed status on host cloudcontrol1005. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1005 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [05:18:57] FIRING: CloudVPSDesignateLeaks: Detected 22 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [05:45:02] (03update) 10sstefanova: components-api: bump to 0.0.3-20240725133653-f188d2d0 [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/450 (owner: 10project_1317_bot_df3177307bed93c3f34e421e26c86e38) [06:01:56] FIRING: SystemdUnitDown: The systemd unit purge_vm_rbd_images.service on node cloudcontrol1005 has been failing for more than two hours. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1005 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [06:28:58] 10Cloud-VPS (Debian Buster Deprecation), 10Community-Tech (Darwin's Fox (July 15-26, 2024)): Cloud VPS "eventmetrics" project Buster deprecation - https://phabricator.wikimedia.org/T367530#10017018 (10MusikAnimal) [06:29:39] 10Cloud-VPS (Debian Buster Deprecation), 10Community-Tech (Darwin's Fox (July 15-26, 2024)): Cloud VPS "eventmetrics" project Buster deprecation - https://phabricator.wikimedia.org/T367530#10017019 (10MusikAnimal) [06:33:16] 10Cloud-VPS (Debian Buster Deprecation), 10Google-api-proxy, 10Community-Tech (Darwin's Fox (July 15-26, 2024)): Cloud VPS "google-api-proxy" project Buster deprecation - https://phabricator.wikimedia.org/T367532#10017023 (10MusikAnimal) p:05Medium→03High [07:29:31] 10Toolforge (Toolforge iteration 13): [gateway-api] something is caching the openapi docs - https://phabricator.wikimedia.org/T371033#10017072 (10Slst2020) [08:17:38] (03update) 10sstefanova: toolforge_get_versions: show component names [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/453 (owner: 10dcaro) [08:17:40] (03approved) 10sstefanova: toolforge_get_versions: show component names [repos/cloud/toolforge/toolforge-deploy] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/toolforge-deploy/-/merge_requests/453 (owner: 10dcaro) [08:22:22] 06cloud-services-team, 10wikitech.wikimedia.org: Move Wikitech onto the production MW cluster - https://phabricator.wikimedia.org/T237773#10017165 (10jijiki) →14Duplicate dup:03T292707 [08:22:55] 10wikitech.wikimedia.org, 10MW-on-K8s, 06serviceops: Migrate Wikitech to Kubernetes - https://phabricator.wikimedia.org/T292707#10017167 (10jijiki) [08:23:32] (03update) 10sstefanova: toolforge_deploy_mr: add toolforge-weld package [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/176 (owner: 10dcaro) [08:23:33] (03approved) 10sstefanova: toolforge_deploy_mr: add toolforge-weld package [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/176 (owner: 10dcaro) [08:26:50] (03update) 10sstefanova: toolforge_get_version: add back wrapper [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/175 (owner: 10dcaro) [08:26:52] (03approved) 10sstefanova: toolforge_get_version: add back wrapper [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/175 (owner: 10dcaro) [08:34:39] 10wikitech.wikimedia.org, 10MW-on-K8s, 06serviceops: Migrate Wikitech to Kubernetes - https://phabricator.wikimedia.org/T292707#10017214 (10jijiki) [08:34:42] 06cloud-services-team, 10wikitech.wikimedia.org: Move Wikitech onto the production MW cluster - https://phabricator.wikimedia.org/T237773#10017216 (10jijiki) [08:34:43] 06cloud-services-team, 10wikitech.wikimedia.org, 07Epic, 07Security: sustainability of wikitech.wikimedia.org - https://phabricator.wikimedia.org/T363125#10017215 (10jijiki) [08:34:49] 10wikitech.wikimedia.org, 10MW-on-K8s, 06serviceops: Migrate Wikitech to Kubernetes - https://phabricator.wikimedia.org/T292707#10017219 (10jijiki) [08:34:51] 06cloud-services-team, 10wikitech.wikimedia.org, 07Epic, 07Security: sustainability of wikitech.wikimedia.org - https://phabricator.wikimedia.org/T363125#10017220 (10jijiki) [09:18:57] FIRING: CloudVPSDesignateLeaks: Detected 22 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [10:02:11] FIRING: SystemdUnitDown: The systemd unit purge_vm_rbd_images.service on node cloudcontrol1005 has been failing for more than two hours. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1005 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [10:51:36] 10Data-Services, 06DBA: Prepare and check storage layer for cswikivoyage - https://phabricator.wikimedia.org/T370912#10017567 (10Ladsgroup) On it [11:18:25] 10Data-Services, 06DBA: Prepare and check storage layer for cswikivoyage - https://phabricator.wikimedia.org/T370912#10017595 (10Ladsgroup) It is now ready for DE team. [11:21:56] RESOLVED: SystemdUnitDown: The service unit purge_vm_rbd_images.service is in failed status on host cloudcontrol1005. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1005 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [11:21:56] RESOLVED: SystemdUnitDown: The systemd unit purge_vm_rbd_images.service on node cloudcontrol1005 has been failing for more than two hours. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudcontrol1005 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [12:02:53] 10VPS-project-Codesearch, 10Gerrit: Codesearch shows .md files as rendered - https://phabricator.wikimedia.org/T371092 (10Tgr) 03NEW [12:07:31] 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation), 10video2commons: Replace or remove Debian Buster VMs in 'video' cloud-vps project - https://phabricator.wikimedia.org/T360711#10017704 (10fnegri) > I have deleted instances encoding04 and encoding05 and recreated them with the same name. These o... [12:15:29] 10VPS-project-Codesearch, 10Gerrit: Codesearch shows .md files as rendered - https://phabricator.wikimedia.org/T371092#10017712 (10Tgr) Upstream issue is https://issues.gerritcodereview.com/issues/40014899. [12:37:13] 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation), 10video2commons: Replace or remove Debian Buster VMs in 'video' cloud-vps project - https://phabricator.wikimedia.org/T360711#10017734 (10fnegri) @Don-vip I removed the 2 extra records (the reverse DNS records), and manually updated the A record... [12:49:37] 10Cloud-VPS (Quota-requests), 06collaboration-services: Increase quota for volumes in devtools project - https://phabricator.wikimedia.org/T371093 (10Jelto) 03NEW [12:58:42] RESOLVED: CloudVPSDesignateLeaks: Detected 3 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [13:43:11] 10Tool-lists, 10Projects-Cleanup: Archive Gerrit repository "labs/tools/lists" - https://phabricator.wikimedia.org/T371095 (10Incola) 03NEW [13:55:45] (03open) 10sstefanova: calico: upgrade to 3.26.4 [repos/cloud/toolforge/calico] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/calico/-/merge_requests/8 (https://phabricator.wikimedia.org/T370046) [14:04:03] (03open) 10incola: Move project to GitLab [toolforge-repos/lists] - 10https://gitlab.wikimedia.org/toolforge-repos/lists/-/merge_requests/1 [14:06:05] (03update) 10incola: Move project to GitLab [toolforge-repos/lists] - 10https://gitlab.wikimedia.org/toolforge-repos/lists/-/merge_requests/1 [14:06:07] (03update) 10incola: Move project to GitLab [toolforge-repos/lists] - 10https://gitlab.wikimedia.org/toolforge-repos/lists/-/merge_requests/1 [14:06:14] (03update) 10incola: Move project to GitLab [toolforge-repos/lists] - 10https://gitlab.wikimedia.org/toolforge-repos/lists/-/merge_requests/1 [14:35:27] 06cloud-services-team, 10Toolforge: [lima-kilo, k8s] Upgrade Kubernetes in lima-kilo to version 1.26 - https://phabricator.wikimedia.org/T370244#10018037 (10Slst2020) a:03Slst2020 [14:36:26] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [lima-kilo, k8s] Upgrade Kubernetes in lima-kilo to version 1.26 - https://phabricator.wikimedia.org/T370244#10018039 (10Slst2020) [14:36:34] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [lima-kilo, k8s] Upgrade Kubernetes in lima-kilo to version 1.26 - https://phabricator.wikimedia.org/T370244#10018042 (10Slst2020) 05Open→03In progress [15:16:32] 10Tools: [Wudele] give a link to source code and a place to discuss tool or report a bug - https://phabricator.wikimedia.org/T371105 (10jeremyb-phone) 03NEW [15:18:10] (03open) 10sstefanova: kind: upgrade k8s to 1.26 [repos/cloud/toolforge/lima-kilo] - 10https://gitlab.wikimedia.org/repos/cloud/toolforge/lima-kilo/-/merge_requests/177 (https://phabricator.wikimedia.org/T370244) [15:22:38] 06cloud-services-team, 10Toolforge: [infra,k8s] Upgrade Tools to k8s version 1.26 - https://phabricator.wikimedia.org/T370249#10018299 (10Slst2020) a:03Slst2020 [15:22:59] 06cloud-services-team, 10Toolforge: [infra,k8s] Upgrade Tools to k8s version 1.26 - https://phabricator.wikimedia.org/T370249#10018300 (10Slst2020) [15:23:00] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [infra,k8s] prepare deb packages for k8s 1.26 - https://phabricator.wikimedia.org/T370246#10018297 (10Slst2020) [15:23:25] 06cloud-services-team, 10Toolforge: [infra,k8s] Upgrade Toolsbeta to k8s 1.26 - https://phabricator.wikimedia.org/T370248#10018303 (10Slst2020) [15:24:33] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [infra,k8s] review kubelet flags before 1.26 upgrade - https://phabricator.wikimedia.org/T370245#10018295 (10Slst2020) [15:25:11] 10Tools: [Wudele] best choice box ics link yields file with wrong TZ timezone - https://phabricator.wikimedia.org/T371106 (10jeremyb-phone) 03NEW [15:26:25] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [infra,k8s] review k8s API usage by custom components for 1.26 upgrade - https://phabricator.wikimedia.org/T370247#10018324 (10Slst2020) a:03Slst2020 [15:29:11] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [infra,k8s] review k8s API usage by custom components for 1.26 upgrade - https://phabricator.wikimedia.org/T370247#10018334 (10Slst2020) [15:29:23] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [infra,k8s] review k8s API usage by custom components for 1.26 upgrade - https://phabricator.wikimedia.org/T370247#10018335 (10Slst2020) We don't seem to be using any deprecated k8s APIs. We dealt with the `autoscaling.apiserver.k8s.io/v2beta2` depre... [15:30:08] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [infra,k8s] review k8s API usage by custom components for 1.26 upgrade - https://phabricator.wikimedia.org/T370247#10018340 (10Slst2020) 05Open→03Resolved [15:30:17] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [infra,k8s] prepare deb packages for k8s 1.26 - https://phabricator.wikimedia.org/T370246#10018343 (10Slst2020) a:03Slst2020 [15:31:20] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [infra,k8s] review kubelet flags before 1.26 upgrade - https://phabricator.wikimedia.org/T370245#10018345 (10Slst2020) a:03Slst2020 [15:33:46] 10Toolforge (Toolforge iteration 13): [lima-kilo] add ingress-admission - https://phabricator.wikimedia.org/T370774#10018354 (10Slst2020) a:03Slst2020 [15:34:54] 06cloud-services-team, 10Toolforge (Toolforge iteration 13): [infra,k8s] review kubelet flags before 1.26 upgrade - https://phabricator.wikimedia.org/T370245#10018352 (10Slst2020) 05Open→03In progress [15:52:55] 06cloud-services-team, 10Cloud-VPS (Quota-requests): Subdomain for DUCT project - https://phabricator.wikimedia.org/T370826#10018506 (10fnegri) 05Open→03In progress a:03fnegri [16:25:17] 06cloud-services-team, 10Cloud-VPS (Quota-requests): Subdomain for DUCT project - https://phabricator.wikimedia.org/T370826#10018704 (10fnegri) p:05Triage→03Medium I did read the wiki page, but I'm not sure how this is supposed to work. I can see there's already a DNS zone `duct.wmcloud.org` in the `duct`... [16:39:56] FIRING: SystemdUnitDown: The service unit wikitech_run_jobs.service is in failed status on host cloudweb1003. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudweb1003 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [16:41:09] 06cloud-services-team, 10Cloud-VPS (Quota-requests): Subdomain for DUCT project - https://phabricator.wikimedia.org/T370826#10018794 (10fnegri) Ok, after thinking about it a little bit longer I think I understand it better: the subdomain can be created, but the steps listed at https://wikitech.wikimedia.org/wi... [16:44:56] RESOLVED: SystemdUnitDown: The service unit wikitech_run_jobs.service is in failed status on host cloudweb1003. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://grafana.wikimedia.org/d/000000377/host-overview?orgId=1&var-server=cloudweb1003 - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [16:48:56] FIRING: [2x] SystemdUnitDown: The service unit wikitech_run_jobs.service is in failed status on host cloudweb1003. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [16:53:56] RESOLVED: [2x] SystemdUnitDown: The service unit wikitech_run_jobs.service is in failed status on host cloudweb1003. - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/SystemdUnitDown - https://alerts.wikimedia.org/?q=alertname%3DSystemdUnitDown [17:13:05] 06cloud-services-team, 10Cloud-VPS (Quota-requests): Subdomain for DUCT project - https://phabricator.wikimedia.org/T370826#10018879 (10fnegri) 05In progress→03Resolved Following the instructions on the wiki page, and using the setup for the `catalyst` project as a reference, I first added the required... [18:03:42] 10cloud-services-team (Hardware), 06DC-Ops, 10ops-eqiad, 06SRE: Q4:rack/setup/install new cloudcephmon hosts - https://phabricator.wikimedia.org/T364870#10019024 (10Jclark-ctr) [18:03:57] 10cloud-services-team (Hardware), 06DC-Ops, 10ops-eqiad, 06SRE: Q4:rack/setup/install new cloudcephmon hosts - https://phabricator.wikimedia.org/T364870#10019025 (10Jclark-ctr) 05Open→03Resolved [18:19:41] FIRING: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [18:29:41] RESOLVED: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [19:35:36] 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation), 06Traffic: Replace or remove Debian Buster VMs in 'traffic' cloud-vps project - https://phabricator.wikimedia.org/T360710#10019366 (10BCornwall) I defer to @Vgutierrez for that since I don't know if there's any data we want to keep/migrate. [20:19:05] 06cloud-services-team, 10Cloud-VPS (Debian Buster Deprecation), 10video2commons: Replace or remove Debian Buster VMs in 'video' cloud-vps project - https://phabricator.wikimedia.org/T360711#10019442 (10Don-vip) @fnegri thanks a lot, it works! Is there a procedure for me to follow to avoid this problem? I am... [20:58:55] 10Cloud-VPS (Debian Buster Deprecation), 06Infrastructure-Foundations, 10Puppet CI: Cloud VPS "puppet-diffs" project Buster deprecation - https://phabricator.wikimedia.org/T367547#10019575 (10Dzahn) >>! In T367547#10015192, @jhathaway wrote: > I think this code creates a chicken and egg type scenerio. Since... [23:31:51] (03PS1) 10Krinkle: build: Add .gitreview file [labs/tools/intuition] - 10https://gerrit.wikimedia.org/r/1057304 [23:32:04] (03CR) 10Krinkle: [C:03+2] build: Add .gitreview file [labs/tools/intuition] - 10https://gerrit.wikimedia.org/r/1057304 (owner: 10Krinkle) [23:32:32] (03Merged) 10jenkins-bot: build: Add .gitreview file [labs/tools/intuition] - 10https://gerrit.wikimedia.org/r/1057304 (owner: 10Krinkle)