[07:25:11] (03PS2) 10Aklapper: BE - search for lexemes forms matching word [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1133586 (https://phabricator.wikimedia.org/T388191) (owner: 10Bovimacoco) [07:26:33] (03Abandoned) 10Aklapper: T390368 and T386329 [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1132124 (owner: 10Bovimacoco) [07:26:43] (03Abandoned) 10Aklapper: T386329 and this T390368 [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1132125 (owner: 10Bovimacoco) [07:27:17] (03PS2) 10Aklapper: Remove app pycache files from git [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1133587 (https://phabricator.wikimedia.org/T386329) (owner: 10Bovimacoco) [07:31:21] (03Abandoned) 10Aklapper: T386329 and T390368 and T386326 [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1132126 (owner: 10Bovimacoco) [09:21:47] (03CR) 10Eugene233: "recheck" [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1133577 (owner: 10Bovimacoco) [10:03:41] FIRING: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [10:13:41] RESOLVED: CloudVPSDesignateLeaks: Detected 1 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [10:52:03] FIRING: ToolforgeKubernetesWorkerTooManyDProcesses: Node tools-k8s-worker-nfs-42 has at least 12 procs in D state, and may be having NFS/IO issues - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses - https://grafana.wmcloud.org/d/3jhWxB8Vk/toolforge-general-overview - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeKubernetesWorkerTooManyDProcesses [10:57:03] RESOLVED: ToolforgeKubernetesWorkerTooManyDProcesses: Node tools-k8s-worker-nfs-42 has at least 12 procs in D state, and may be having NFS/IO issues - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolforgeKubernetesWorkerTooManyDProcesses - https://grafana.wmcloud.org/d/3jhWxB8Vk/toolforge-general-overview - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolforgeKubernetesWorkerTooManyDProcesses [11:17:15] (03PS1) 10Bovimacoco: T386712 Suppress SQLAlchemy Database track warning message bug: T386712 [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1134332 [11:31:01] (03CR) 10Eugene233: [C:03+1] T386712 Suppress SQLAlchemy Database track warning message bug: T386712 [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1134332 (owner: 10Bovimacoco) [11:31:26] (03CR) 10Eugene233: T386712 Suppress SQLAlchemy Database track warning message bug: T386712 [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1134332 (owner: 10Bovimacoco) [11:31:46] (03CR) 10Eugene233: "recheck" [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1134332 (owner: 10Bovimacoco) [11:50:48] (03PS2) 10Ketulucas: T225806. Setup browser history states for image participation [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/1132174 [11:50:48] (03PS1) 10Ketulucas: T225806. Remove all unwanted indentation [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/1134334 [11:53:01] (03CR) 10Ketulucas: "I just remove all the unwanted indentation" [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/1132174 (owner: 10Ketulucas) [12:51:31] FIRING: ToolsNfsAlmostFull: Toolforge NFS is 0.8524320886383798/1 full - https://wikitech.wikimedia.org/wiki/Portal:Toolforge/Admin/Runbooks/ToolsNfsAlmostFull - https://prometheus-alerts.wmcloud.org/?q=alertname%3DToolsNfsAlmostFull [13:58:01] 10Tools, 10Wikidata, 07Security: Blocked Wikidata user sockpuppets are doing automated misconduct with QuickStatements - https://phabricator.wikimedia.org/T386978#10715073 (10matej_suchanek) >>! In T386978#10573119, @Epidosis wrote: > By the way, restoring the right for Wikidata administrators to block batch... [14:03:41] FIRING: CloudVPSDesignateLeaks: Detected 2 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [14:13:41] RESOLVED: CloudVPSDesignateLeaks: Detected 2 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [15:43:03] (03CR) 10Wandji collins: "I think this can be abandoned since it has a duplicate Patch." [labs/tools/wdaudiolex-be] - 10https://gerrit.wikimedia.org/r/1132166 (owner: 10Bovimacoco) [16:24:42] (03CR) 10Josefanthony: [C:04-1] "Thanks for the effort here. However, the content in this file could use improvement. Also, instead of creating a new file (ISA_window_setu" [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/1132185 (owner: 10Ennyfav) [16:34:02] (03CR) 10Josefanthony: Create documentation instruction on windows setup bug: T390421 [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/1132185 (owner: 10Ennyfav) [19:58:51] (03PS1) 10Ketulucas: Bug:T357238. Updated the Help Page on the ISA Tool. [labs/tools/Isa] - 10https://gerrit.wikimedia.org/r/1134338 [20:43:05] 10Tool-global-search: Global Search displays most search results twice - https://phabricator.wikimedia.org/T391175 (10matmarex) 03NEW [21:33:41] FIRING: CloudVPSDesignateLeaks: Detected 2 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks [21:43:41] RESOLVED: CloudVPSDesignateLeaks: Detected 2 stray dns records - https://wikitech.wikimedia.org/wiki/Portal:Cloud_VPS/Admin/Runbooks/Designate_record_leaks - https://grafana.wikimedia.org/d/ebJoA6VWz/wmcs-openstack-eqiad-nova-fullstack - https://alerts.wikimedia.org/?q=alertname%3DCloudVPSDesignateLeaks