[08:52:52] <wikibugs>	 06Data-Engineering, 06Data-Engineering-Radar, 10AbuseFilter, 06DBA, 07Schema-change-in-production: Add default value for afl_ip and remove default value for afl_ip_hex in abuse_filter_log table - https://phabricator.wikimedia.org/T401906#11131114 (10FCeratto-WMF)
[09:08:15] <wikibugs>	 06Data-Engineering-Radar, 10HaproxyKafka, 10Observability-Logging, 06Traffic, 13Patch-For-Review: Shutdown varnishkafka webrequest instances - https://phabricator.wikimedia.org/T393772#11131144 (10Fabfur) >>! In T393772#11129887, @ssingh wrote: > @Fabfur: I think this all done and the alerts have been re...
[10:05:53] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Update unique_devices tables to add the `access_method` field - https://phabricator.wikimedia.org/T401666#11131295 (10JAllemandou)
[10:34:05] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Movement-Insights: mediawiki_history - account for temp accounts in mediawiki_user_history_check_error - https://phabricator.wikimedia.org/T401325#11131389 (10JAllemandou) I think updating the checker for fine-tuning the config is ideal! I wonder if,...
[11:07:18] <wikibugs>	 06Data-Engineering, 06Data-Engineering-Radar, 06DBA, 07Schema-change-in-production: Drop cl_to and cl_collation from categorylinks in wmf production - https://phabricator.wikimedia.org/T402925#11131448 (10Ladsgroup)
[12:03:14] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Update unique_devices tables to add the `access_method` field - https://phabricator.wikimedia.org/T401666#11131571 (10JAllemandou) I have generated data in `joal.unique_devices_per_project_family_daily_access_method`  table. I have also copied aggregated...
[15:07:12] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Optimize metrics computation for the MW Content Pipeline - https://phabricator.wikimedia.org/T401010#11132282 (10tchin) oo very nice!! I wonder how it'd compare to a pure java version of the deequ code. Maybe if we switch to SQL we can take the opportuni...
[15:45:56] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Optimize metrics computation for the MW Content Pipeline - https://phabricator.wikimedia.org/T401010#11132459 (10xcollazo) >  I wonder how it'd compare to a pure java version of the deequ code. I suspect the majority of the improvements comes from the fa...
[16:11:05] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th), 06Movement-Insights: mediawiki_history - account for temp accounts in mediawiki_user_history_check_error - https://phabricator.wikimedia.org/T401325#11132522 (10amastilovic) As far as I can see, all these checkers already use `DeequColumnAnalysis` so t...
[16:14:07] <wikibugs>	 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking): RFC: Remove m-dot subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998#11132525 (10Krinkle)
[16:16:14] <wikibugs>	 06Data-Engineering, 06SRE, 06Traffic-Icebox, 10MobileFrontend (Tracking), 07User-notice: RFC: Remove m-dot subdomain, serve mobile and desktop variants through the same URL - https://phabricator.wikimedia.org/T214998#11132527 (10Krinkle)
[16:37:45] <wikibugs>	 06Data-Engineering, 10Wikidata, 10Wikidata Analytics: Airflow processes to import dump logs and generate monthly metrics - https://phabricator.wikimedia.org/T403159#11132568 (10AndrewTavis_WMDE)
[18:25:11] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892#11132968 (10xcollazo) Over at https://wikitech.wikimedia.org/wiki/SLO/MediaWiki_Content_Pipelines we talk about the following SLOs:  > correctness: ensu...
[19:17:48] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892#11133032 (10xcollazo) Here are some calculations to inform discussion.  We can calculate total //completeness// by doing something like this:  ` spark.s...
[19:26:05] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Update unique_devices tables to add the `access_method` field - https://phabricator.wikimedia.org/T401666#11133036 (10Hghani) @JAllemandou Thanks for generating the test data. The domain data looks okay to me. I agree with @Mayakp.wiki  that we don't wan...
[19:35:19] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892#11133052 (10xcollazo) For //freshness//, we could use a similar mechanism as before, but we can look at the detected inconsistencies over the last consu...
[19:38:18] <wikibugs>	 10Data-Engineering (Q1 FY25/26 July 1st - September 30th): Update MediaWiki Content History SLO draft for SRE review - https://phabricator.wikimedia.org/T401892#11133074 (10xcollazo) (Side note: now that I'v been playing with these numbers, I think it would be interesting to //repeated// our reconcile over data...