[06:35:17] FIRING: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=eqiad%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [06:40:17] RESOLVED: EventgateProduceRateAnomaly: Significant produce rate deviation (+-25%) on eventgate-logging-external in eqiad. - https://wikitech.wikimedia.org/wiki/Event_Platform/EventGate - https://grafana.wikimedia.org/d/ZB39Izmnz/eventgate?orgId=1&refresh=1m&var-dc=eqiad%2Bprometheus/k8s&var-service=eventgate-logging-external - https://alerts.wikimedia.org/?q=alertname%3DEventgateProduceRateAnomaly [09:22:37] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add `cul_target` index to `cu_log` in WMF prod - https://phabricator.wikimedia.org/T401891 (10mszwarc) 03NEW [09:22:48] 06Data-Engineering, 06DBA, 07Schema-change-in-production: Add `cul_target` index to `cu_log` in WMF prod - https://phabricator.wikimedia.org/T401891#11085064 (10mszwarc) [09:23:39] 06Data-Engineering, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add `cul_target` index to `cu_log` in WMF prod - https://phabricator.wikimedia.org/T401891#11085068 (10mszwarc) [09:24:10] 06Data-Engineering: Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892 (10GGoncalves-WMF) 03NEW [09:34:02] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892#11085097 (10GGoncalves-WMF) [09:39:51] 06Data-Engineering, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add `cul_target` index to `cu_log` in WMF prod - https://phabricator.wikimedia.org/T401891#11085121 (10Dreamy_Jazz) For context, we are planning to drop the `cul_type_target` index (T401884) and replac... [10:37:42] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests, and 2 others: Request for Kerberos identity for querying SSAC table via statmachines - https://phabricator.wikimedia.org/T401827#11085580 (10tappof) Created KRB principal and notified user by email. Submitted patch to set KRB fla... [10:46:30] 06Data-Engineering, 10AbuseFilter, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906 (10Dreamy_Jazz) 03NEW [10:51:20] 06Data-Engineering, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add `cul_target` index to `cu_log` in WMF prod - https://phabricator.wikimedia.org/T401891#11085691 (10Ladsgroup) a:03Ladsgroup Running with replication on master. The table is so tiny it's adorable. [10:55:12] 06Data-Engineering, 10CheckUser, 06DBA, 06Trust and Safety Product Team, 07Schema-change-in-production: Add `cul_target` index to `cu_log` in WMF prod - https://phabricator.wikimedia.org/T401891#11085714 (10Ladsgroup) 05Open→03Resolved [11:03:06] 06Data-Engineering, 06Data-Platform-SRE, 06Java-Scala-Standardization, 10Discovery-Search (2025.07.25 - 2025.08.15), 13Patch-For-Review: Migrate existing Java packages to deploying to Gitlab, including new version of parent pom, validation that all depen... - https://phabricator.wikimedia.org/T367405#11085789 [11:07:57] 06Data-Engineering, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team, 07Schema-change: Duplicate rc_name_type_patrolled_timestamp index on rc_source - https://phabricator.wikimedia.org/T401912 (10Ladsgroup) 03NEW [11:08:19] 06Data-Engineering, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team, 07Schema-change: Duplicate rc_name_type_patrolled_timestamp index on rc_source - https://phabricator.wikimedia.org/T401912#11085843 (10Ladsgroup) @Zabe do you think you can pick this up? Thanks! [11:11:52] 06Data-Engineering, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11085846 (10A_smart_kitten) [11:41:09] 06Data-Engineering, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11085968 (10Ladsgroup) We are a bit under-staffed. I try to take care of it next week. [11:43:14] 06Data-Engineering, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11085970 (10Dreamy_Jazz) >>! In T401906#11085968, @Ladsgroup wrote: > We are a bit under-staffe... [12:57:42] 06Data-Engineering, 10CheckUser, 06Trust and Safety Product Team, 07OKR-Work, and 2 others: Drop index cul_target_type from cu_log - https://phabricator.wikimedia.org/T401884#11086142 (10Dreamy_Jazz) `cu_log` exists in the data lake, so tagging with #data-engineering to check that these changes don't affec... [13:07:07] 06Data-Engineering, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team, 07Schema-change: Duplicate rc_name_type_patrolled_timestamp index on rc_source - https://phabricator.wikimedia.org/T401912#11086177 (10Zabe) a:03Zabe yup [13:19:43] 06Data-Engineering, 06Data-Engineering-Radar, 06SRE, 10SRE-Access-Requests, 10Data-Platform-SRE (2025.07.26 - 2025.08.15): Request for Kerberos identity for querying SSAC table via statmachines - https://phabricator.wikimedia.org/T401827#11086211 (10tappof) 05Open→03Resolved a:03tappof [13:23:06] 06Data-Engineering, 10MediaWiki-Recent-changes, 06Moderator-Tools-Team, 07Schema-change: Duplicate rc_name_type_patrolled_timestamp index on rc_source - https://phabricator.wikimedia.org/T401912#11086214 (10Ladsgroup) Thanks! [13:37:32] 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Hack unique_devices_per_domain recreating `.m` subdomain use `x_analytics` `ismobile` value - https://phabricator.wikimedia.org/T401666#11086252 (10JAllemandou) After talking to @Milimetric and @mforns , we are in agreement that it would be better to not... [15:33:48] (03PS1) 10Joal: Update artifacts download script to use gitlab [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1178895 (https://phabricator.wikimedia.org/T367405) [16:36:13] (03CR) 10Mforns: [C:03+1] "LGTM!" [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1178895 (https://phabricator.wikimedia.org/T367405) (owner: 10Joal) [16:36:33] (03CR) 10Mforns: [C:03+1] "LGTM!" [analytics/refinery/source] - 10https://gerrit.wikimedia.org/r/1147771 (https://phabricator.wikimedia.org/T367405) (owner: 10Peter Fischer) [20:35:25] (03CR) 10Aleksandar Mastilovic: [C:03+2] Update artifacts download script to use gitlab [analytics/refinery] - 10https://gerrit.wikimedia.org/r/1178895 (https://phabricator.wikimedia.org/T367405) (owner: 10Joal)